2024-04-26T20:59:44.142 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T20:59:44.142 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/cap-flush} --owner scheduled_rishabh@teuthology --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/orig.config.yaml 2024-04-26T20:59:44.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T20:59:44.280 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201 branch: wip-rishabh-testing-20240426.111959 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/cap-flush} email: null first_in_suite: false job_id: '7675201' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Replacing daemon mds.a sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcpSpnpXqcqA8+TYrlLQ9S56vKafZgtdbXj/DB/9ZSXn7D3s131WDCFvRDqQwYPethApYXp+E361o7/Y+d6ty0= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN0/hyRZtYMfUwFnVNyrIkRCGja8UbbYbi0s8rYw9HwYeunrzm/bZx/FQZkxmiypzzedw9hUH3jn91gMfWQmVx8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_cap_flush teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T20:59:44.280 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T20:59:44.281 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T20:59:44.281 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T20:59:44.282 INFO:teuthology.task.internal:Checking packages... 2024-04-26T20:59:44.306 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T20:59:44.306 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:59:44.306 INFO:teuthology.packaging:ref: None 2024-04-26T20:59:44.306 INFO:teuthology.packaging:tag: None 2024-04-26T20:59:44.306 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T20:59:44.307 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:59:44.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T20:59:44.519 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:59:44.521 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T20:59:44.528 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T20:59:44.528 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T20:59:44.543 INFO:teuthology.task.internal:Saving configuration 2024-04-26T20:59:44.560 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T20:59:44.566 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T20:59:44.593 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:54:18.145196', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIDEQxg0ny7iszUYMMs1g8urKIiq04mF12r7K/oRiDXI'} 2024-04-26T20:59:44.613 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:54:18.143720', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDH7sa31s5abRnOF0YEj6+HJl49lF95/vjtg/7SwwyyG'} 2024-04-26T20:59:44.613 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T20:59:44.619 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-26T20:59:44.620 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-26T20:59:44.620 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T20:59:44.697 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f33a78cf4c0>, signals=[15]) 2024-04-26T20:59:44.697 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T20:59:44.704 INFO:teuthology.task.internal:Opening connections... 2024-04-26T20:59:44.704 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T20:59:44.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:59:44.783 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T20:59:44.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:59:44.859 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T20:59:44.866 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-04-26T20:59:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-04-26T20:59:44.872 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="22.04" 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=jammy 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T20:59:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=jammy 2024-04-26T20:59:44.918 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-26T20:59:44.935 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-04-26T20:59:44.940 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-04-26T20:59:44.941 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-26T20:59:44.986 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T20:59:44.986 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2024-04-26T20:59:44.986 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="22.04" 2024-04-26T20:59:44.986 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T20:59:44.986 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=jammy 2024-04-26T20:59:44.987 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2024-04-26T20:59:44.987 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2024-04-26T20:59:44.987 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T20:59:44.987 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T20:59:44.987 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T20:59:44.987 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T20:59:44.987 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=jammy 2024-04-26T20:59:44.987 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-26T20:59:45.010 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T20:59:45.019 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T20:59:45.025 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T20:59:45.026 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:59:45.028 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:59:45.034 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T20:59:45.040 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T20:59:45.040 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:59:45.075 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:59:45.084 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T20:59:45.136 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T20:59:45.152 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T20:59:45.152 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-26T20:59:45.152 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:59:45.153 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:59:45.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:59:45.157 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:45.157 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T20:59:45.158 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-04-26T20:59:45.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:59:45.159 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:45.159 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T20:59:45.159 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-04-26T20:59:45.207 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-56-generic 2024-04-26T20:59:45.207 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:45.207 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T20:59:45.208 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:45.212 INFO:teuthology.orchestra.run.smithi106.stdout:5.15.0-56-generic 2024-04-26T20:59:45.212 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:45.212 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T20:59:45.212 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:59:45.348 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-04-26T20:59:45.348 DEBUG:teuthology.orchestra.run.smithi112:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T20:59:45.349 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-04-26T20:59:45.349 DEBUG:teuthology.orchestra.run.smithi106:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T20:59:45.365 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T20:59:45.371 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T20:59:45.492 INFO:teuthology.orchestra.run.smithi112.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T20:59:45.492 INFO:teuthology.orchestra.run.smithi112.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T20:59:45.492 INFO:teuthology.orchestra.run.smithi112.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T20:59:45.492 INFO:teuthology.orchestra.run.smithi112.stderr:hint: 2024-04-26T20:59:45.492 INFO:teuthology.orchestra.run.smithi112.stderr:hint: git config --global init.defaultBranch 2024-04-26T20:59:45.493 INFO:teuthology.orchestra.run.smithi112.stderr:hint: 2024-04-26T20:59:45.493 INFO:teuthology.orchestra.run.smithi112.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T20:59:45.493 INFO:teuthology.orchestra.run.smithi112.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T20:59:45.493 INFO:teuthology.orchestra.run.smithi112.stderr:hint: 2024-04-26T20:59:45.493 INFO:teuthology.orchestra.run.smithi112.stderr:hint: git branch -m 2024-04-26T20:59:45.493 INFO:teuthology.orchestra.run.smithi112.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T20:59:45.496 DEBUG:teuthology.orchestra.run.smithi112:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T20:59:45.505 INFO:teuthology.orchestra.run.smithi106.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T20:59:45.505 INFO:teuthology.orchestra.run.smithi106.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T20:59:45.505 INFO:teuthology.orchestra.run.smithi106.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T20:59:45.505 INFO:teuthology.orchestra.run.smithi106.stderr:hint: 2024-04-26T20:59:45.505 INFO:teuthology.orchestra.run.smithi106.stderr:hint: git config --global init.defaultBranch 2024-04-26T20:59:45.505 INFO:teuthology.orchestra.run.smithi106.stderr:hint: 2024-04-26T20:59:45.505 INFO:teuthology.orchestra.run.smithi106.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T20:59:45.505 INFO:teuthology.orchestra.run.smithi106.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T20:59:45.506 INFO:teuthology.orchestra.run.smithi106.stderr:hint: 2024-04-26T20:59:45.506 INFO:teuthology.orchestra.run.smithi106.stderr:hint: git branch -m 2024-04-26T20:59:45.508 INFO:teuthology.orchestra.run.smithi106.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T20:59:45.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T20:59:45.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T20:59:45.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T20:59:45.616 DEBUG:teuthology.orchestra.run.smithi112:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T20:59:45.619 DEBUG:teuthology.orchestra.run.smithi106:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T21:01:13.106 INFO:teuthology.orchestra.run.smithi112.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T21:01:13.106 INFO:teuthology.orchestra.run.smithi112.stderr: * [new branch] main -> origin/main 2024-04-26T21:01:13.137 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T21:01:13.138 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T21:01:13.141 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T21:01:13.142 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T21:01:13.143 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T21:01:13.145 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T21:01:13.145 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T21:01:13.145 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T21:01:13.145 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T21:01:13.146 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T21:01:14.564 INFO:teuthology.orchestra.run.smithi106.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T21:01:14.564 INFO:teuthology.orchestra.run.smithi106.stderr: * [new branch] main -> origin/main 2024-04-26T21:01:14.590 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T21:01:14.591 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T21:01:14.594 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T21:01:14.595 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T21:01:14.596 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T21:01:14.598 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T21:01:14.598 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T21:01:14.598 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T21:01:14.598 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T21:01:14.598 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T21:01:14.598 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T21:01:14.599 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T21:01:14.599 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T21:01:14.599 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T21:01:14.599 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T21:01:14.599 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T21:01:14.599 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T21:01:14.599 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T21:01:14.599 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T21:01:14.599 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T21:01:17.428 INFO:teuthology.orchestra.run.smithi112.stderr:Updating files: 44% (1524/3390) Updating files: 45% (1526/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2014/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2819/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T21:01:17.433 INFO:teuthology.orchestra.run.smithi112.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T21:01:17.455 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T21:01:17.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:01:17.605 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T21:01:17.605 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T21:01:17.608 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi112.front.sepia.ceph.com to complete... 2024-04-26T21:01:18.856 INFO:teuthology.orchestra.run.smithi106.stderr:Updating files: 45% (1536/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2019/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2822/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T21:01:18.861 INFO:teuthology.orchestra.run.smithi106.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T21:01:18.881 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T21:01:18.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T21:01:19.100 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T21:01:19.100 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T21:01:19.103 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi106.front.sepia.ceph.com to complete... 2024-04-26T21:01:20.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26 21:01:20 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T21:01:20.127 INFO:teuthology.orchestra.run.smithi112.stderr:FINISHED --2024-04-26 21:01:20-- 2024-04-26T21:01:20.127 INFO:teuthology.orchestra.run.smithi112.stderr:Total wall clock time: 2.5s 2024-04-26T21:01:20.127 INFO:teuthology.orchestra.run.smithi112.stderr:Downloaded: 1 files, 43M in 2.4s (18.0 MB/s) 2024-04-26T21:01:20.131 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T21:01:20.131 DEBUG:teuthology.orchestra.run.smithi112:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T21:01:20.322 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T21:01:22.208 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T21:01:22.212 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T21:01:22.318 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T21:01:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26 21:01:22 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T21:01:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:FINISHED --2024-04-26 21:01:22-- 2024-04-26T21:01:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:Total wall clock time: 3.8s 2024-04-26T21:01:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:Downloaded: 1 files, 43M in 3.3s (12.8 MB/s) 2024-04-26T21:01:22.888 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T21:01:22.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T21:01:23.149 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T21:01:25.231 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T21:01:25.234 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T21:01:25.510 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T21:01:26.298 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T21:01:26.409 INFO:teuthology.orchestra.run.smithi112.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:29.248 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T21:01:29.386 INFO:teuthology.orchestra.run.smithi106.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:47.164 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2024-04-26T21:01:47.180 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T21:01:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-04-26T21:01:47.479 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:47.491 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:47.761 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T21:01:47.771 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T21:01:47.828 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T21:01:47.833 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T21:01:47.983 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T21:01:47.983 INFO:teuthology.orchestra.run.smithi112.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T21:01:47.983 INFO:teuthology.orchestra.run.smithi112.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T21:01:48.021 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-04-26T21:01:48.199 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T21:01:48.207 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T21:01:48.207 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T21:01:48.207 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:48.225 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:48.225 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:48.246 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T21:01:48.246 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T21:01:48.246 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T21:01:48.246 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T21:01:48.247 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T21:01:48.250 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T21:01:48.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T21:01:48.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T21:01:48.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T21:01:48.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T21:01:48.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T21:01:48.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T21:01:48.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T21:01:48.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T21:01:48.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T21:01:48.252 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T21:01:48.253 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T21:01:48.253 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T21:01:48.253 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T21:01:48.253 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T21:01:48.253 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T21:01:48.253 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T21:01:48.253 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T21:01:48.254 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T21:01:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T21:01:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T21:01:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T21:01:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T21:01:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T21:01:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T21:01:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T21:01:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T21:01:48.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T21:01:48.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T21:01:48.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T21:01:48.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T21:01:48.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T21:01:48.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T21:01:48.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T21:01:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T21:01:48.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T21:01:48.284 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T21:01:48.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T21:01:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T21:01:48.287 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T21:01:48.288 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T21:01:48.289 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T21:01:48.290 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T21:01:48.290 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T21:01:48.290 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T21:01:48.290 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T21:01:48.290 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T21:01:48.290 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T21:01:48.290 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T21:01:48.356 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T21:01:48.356 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T21:01:48.356 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T21:01:48.356 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T21:01:48.356 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T21:01:48.356 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T21:01:48.356 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T21:01:48.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T21:01:48.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T21:01:48.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T21:01:48.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T21:01:48.359 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T21:01:48.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T21:01:48.359 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T21:01:48.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T21:01:48.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T21:01:48.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T21:01:48.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T21:01:48.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T21:01:48.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T21:01:48.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T21:01:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T21:01:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T21:01:48.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T21:01:48.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T21:01:48.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T21:01:48.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T21:01:48.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T21:01:48.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T21:01:48.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T21:01:48.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T21:01:48.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T21:01:48.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T21:01:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T21:01:48.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T21:01:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T21:01:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T21:01:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T21:01:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T21:01:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T21:01:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T21:01:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T21:01:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T21:01:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T21:01:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T21:01:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T21:01:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T21:01:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T21:01:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T21:01:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T21:01:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T21:01:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T21:01:48.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T21:01:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T21:01:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T21:01:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T21:01:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T21:01:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T21:01:48.381 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T21:01:48.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T21:01:48.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T21:01:48.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T21:01:48.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T21:01:48.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T21:01:48.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T21:01:48.388 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T21:01:48.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T21:01:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T21:01:48.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T21:01:48.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T21:01:48.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T21:01:48.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T21:01:48.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T21:01:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T21:01:48.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T21:01:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T21:01:48.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T21:01:48.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T21:01:48.401 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T21:01:48.402 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T21:01:48.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T21:01:48.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T21:01:48.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T21:01:48.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T21:01:48.407 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T21:01:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T21:01:48.409 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T21:01:48.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T21:01:48.411 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T21:01:48.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T21:01:48.413 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T21:01:48.414 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T21:01:48.504 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T21:01:48.504 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T21:01:48.504 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T21:01:48.504 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T21:01:48.504 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T21:01:48.504 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T21:01:48.504 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T21:01:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T21:01:48.506 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T21:01:48.507 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T21:01:48.508 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T21:01:48.509 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T21:01:48.510 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T21:01:48.511 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T21:01:48.512 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T21:01:48.513 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T21:01:48.514 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T21:01:48.515 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T21:01:48.516 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T21:01:48.517 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T21:01:48.518 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T21:01:48.519 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T21:01:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T21:01:48.521 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T21:01:48.522 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T21:01:48.523 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T21:01:48.524 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T21:01:48.525 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T21:01:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T21:01:48.527 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T21:01:48.528 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T21:01:48.529 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T21:01:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T21:01:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T21:01:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T21:01:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T21:01:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T21:01:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T21:01:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T21:01:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T21:01:48.530 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T21:01:48.531 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T21:01:48.532 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T21:01:48.533 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T21:01:48.534 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T21:01:48.535 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T21:01:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T21:01:48.537 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T21:01:48.538 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T21:01:48.539 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T21:01:48.540 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T21:01:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T21:01:48.542 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T21:01:48.542 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T21:01:48.542 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T21:01:48.542 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T21:01:48.542 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T21:01:48.542 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T21:01:48.542 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T21:01:48.542 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T21:01:48.542 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T21:01:48.543 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T21:01:48.544 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T21:01:48.545 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T21:01:48.546 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T21:01:48.547 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T21:01:48.548 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T21:01:48.549 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T21:01:48.550 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T21:01:48.551 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T21:01:48.552 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T21:01:48.553 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T21:01:48.554 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T21:01:48.555 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T21:01:48.556 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T21:01:48.556 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T21:01:48.556 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T21:01:48.556 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T21:01:48.556 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T21:01:48.556 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T21:01:48.556 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T21:01:48.556 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T21:01:48.556 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T21:01:48.557 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T21:01:48.558 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T21:01:48.559 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T21:01:48.560 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T21:01:48.560 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T21:01:48.560 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T21:01:48.560 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T21:01:48.560 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T21:01:48.562 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T21:01:48.563 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T21:01:48.563 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T21:01:48.563 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T21:01:48.563 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T21:01:48.563 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T21:01:48.563 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T21:01:48.563 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T21:01:48.563 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T21:01:48.563 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T21:01:48.564 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T21:01:48.564 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T21:01:48.564 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T21:01:48.564 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T21:01:48.564 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T21:01:48.564 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T21:01:48.564 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T21:01:48.564 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T21:01:48.564 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T21:01:48.565 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T21:01:48.565 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T21:01:48.565 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T21:01:48.565 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T21:01:48.565 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T21:01:48.565 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T21:01:48.565 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T21:01:48.565 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T21:01:48.565 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T21:01:48.566 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T21:01:48.567 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T21:01:48.568 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T21:01:48.569 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T21:01:48.570 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T21:01:48.571 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T21:01:48.572 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T21:01:48.573 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T21:01:48.574 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T21:01:48.575 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T21:01:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T21:01:48.577 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T21:01:48.578 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T21:01:48.579 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T21:01:48.580 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T21:01:48.581 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T21:01:48.582 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T21:01:48.583 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T21:01:48.584 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T21:01:48.628 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T21:01:48.628 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T21:01:48.629 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T21:01:48.630 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T21:01:48.631 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T21:01:48.632 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T21:01:48.633 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T21:01:48.634 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T21:01:48.635 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T21:01:48.636 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T21:01:48.637 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T21:01:48.638 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T21:01:48.639 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T21:01:48.640 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T21:01:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T21:01:48.642 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T21:01:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T21:01:48.644 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T21:01:48.645 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T21:01:48.646 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T21:01:48.647 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T21:01:48.648 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T21:01:48.649 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T21:01:48.650 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T21:01:48.651 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T21:01:48.652 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T21:01:48.653 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T21:01:48.654 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T21:01:48.655 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T21:01:48.656 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T21:01:48.657 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T21:01:48.658 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T21:01:48.659 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T21:01:48.660 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T21:01:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T21:01:48.662 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T21:01:48.663 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T21:01:48.664 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T21:01:48.665 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T21:01:48.666 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T21:01:48.667 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T21:01:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T21:01:48.669 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T21:01:48.670 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T21:01:48.671 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T21:01:48.671 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T21:01:48.671 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T21:01:48.671 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T21:01:48.671 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T21:01:48.671 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T21:01:48.676 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:48.677 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:48.677 DEBUG:teuthology.orchestra.run.smithi112:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T21:01:48.684 INFO:teuthology.orchestra.run.smithi112.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T21:01:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T21:01:48.684 INFO:teuthology.orchestra.run.smithi112.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T21:01:48.684 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T21:01:48.685 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:48.685 DEBUG:teuthology.orchestra.run.smithi112:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T21:01:48.730 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi112.front.sepia.ceph.com to complete... 2024-04-26T21:01:49.099 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2024-04-26T21:01:49.100 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T21:01:49.131 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-04-26T21:01:49.293 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:49.299 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:49.525 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T21:01:49.531 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T21:01:49.573 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T21:01:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T21:01:49.700 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T21:01:49.700 INFO:teuthology.orchestra.run.smithi112.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T21:01:49.701 INFO:teuthology.orchestra.run.smithi112.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T21:01:49.713 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-04-26T21:01:51.960 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2024-04-26T21:01:51.973 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T21:01:52.007 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-04-26T21:01:52.351 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:52.375 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:52.698 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T21:01:52.709 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T21:01:52.774 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T21:01:52.780 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T21:01:52.933 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T21:01:52.933 INFO:teuthology.orchestra.run.smithi106.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T21:01:52.933 INFO:teuthology.orchestra.run.smithi106.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T21:01:52.987 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-04-26T21:01:53.187 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T21:01:53.194 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T21:01:53.195 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T21:01:53.195 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:53.213 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:53.213 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:53.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T21:01:53.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T21:01:53.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T21:01:53.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T21:01:53.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T21:01:53.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T21:01:53.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T21:01:53.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T21:01:53.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T21:01:53.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T21:01:53.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T21:01:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T21:01:53.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T21:01:53.290 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T21:01:53.291 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T21:01:53.292 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T21:01:53.293 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T21:01:53.294 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T21:01:53.295 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T21:01:53.296 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T21:01:53.296 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T21:01:53.296 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T21:01:53.296 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T21:01:53.296 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T21:01:53.296 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T21:01:53.296 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T21:01:53.296 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T21:01:53.296 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T21:01:53.297 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T21:01:53.298 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T21:01:53.299 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T21:01:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T21:01:53.301 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T21:01:53.302 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T21:01:53.303 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T21:01:53.304 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T21:01:53.305 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T21:01:53.306 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T21:01:53.307 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T21:01:53.308 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T21:01:53.309 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T21:01:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T21:01:53.311 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T21:01:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T21:01:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T21:01:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T21:01:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T21:01:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T21:01:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T21:01:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T21:01:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T21:01:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T21:01:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T21:01:53.314 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T21:01:53.315 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T21:01:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T21:01:53.317 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T21:01:53.318 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T21:01:53.319 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T21:01:53.320 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T21:01:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T21:01:53.322 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T21:01:53.323 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T21:01:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T21:01:53.325 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T21:01:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T21:01:53.327 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T21:01:53.328 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T21:01:53.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T21:01:53.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T21:01:53.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T21:01:53.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T21:01:53.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T21:01:53.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T21:01:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T21:01:53.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T21:01:53.336 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T21:01:53.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T21:01:53.396 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T21:01:53.396 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T21:01:53.396 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T21:01:53.396 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T21:01:53.396 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T21:01:53.396 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T21:01:53.396 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T21:01:53.397 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T21:01:53.398 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T21:01:53.399 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T21:01:53.400 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T21:01:53.401 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T21:01:53.402 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T21:01:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T21:01:53.404 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T21:01:53.405 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T21:01:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T21:01:53.407 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T21:01:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T21:01:53.409 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T21:01:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T21:01:53.411 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T21:01:53.412 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T21:01:53.413 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T21:01:53.414 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T21:01:53.415 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T21:01:53.416 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T21:01:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T21:01:53.418 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T21:01:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T21:01:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T21:01:53.421 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T21:01:53.422 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T21:01:53.423 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T21:01:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T21:01:53.425 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T21:01:53.426 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T21:01:53.427 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T21:01:53.428 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T21:01:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T21:01:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T21:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T21:01:53.432 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T21:01:53.433 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T21:01:53.434 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T21:01:53.435 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T21:01:53.436 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T21:01:53.437 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T21:01:53.438 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T21:01:53.439 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T21:01:53.440 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T21:01:53.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T21:01:53.442 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T21:01:53.443 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T21:01:53.444 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T21:01:53.445 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T21:01:53.446 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T21:01:53.447 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T21:01:53.448 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T21:01:53.449 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T21:01:53.450 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T21:01:53.451 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T21:01:53.452 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T21:01:53.453 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T21:01:53.453 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T21:01:53.453 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T21:01:53.453 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T21:01:53.453 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T21:01:53.453 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T21:01:53.500 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T21:01:53.500 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T21:01:53.500 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T21:01:53.500 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T21:01:53.500 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T21:01:53.500 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T21:01:53.500 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T21:01:53.500 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T21:01:53.501 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T21:01:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T21:01:53.503 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T21:01:53.504 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T21:01:53.505 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T21:01:53.506 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T21:01:53.507 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T21:01:53.508 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T21:01:53.509 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T21:01:53.510 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T21:01:53.511 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T21:01:53.512 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T21:01:53.513 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T21:01:53.514 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T21:01:53.515 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T21:01:53.516 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T21:01:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T21:01:53.518 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T21:01:53.519 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T21:01:53.520 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T21:01:53.521 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T21:01:53.522 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T21:01:53.523 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T21:01:53.524 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T21:01:53.525 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T21:01:53.526 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T21:01:53.527 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T21:01:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T21:01:53.529 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T21:01:53.530 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T21:01:53.531 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T21:01:53.532 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T21:01:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T21:01:53.534 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T21:01:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T21:01:53.536 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T21:01:53.537 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T21:01:53.538 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T21:01:53.539 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T21:01:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T21:01:53.541 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T21:01:53.542 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T21:01:53.543 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T21:01:53.544 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T21:01:53.544 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T21:01:53.583 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T21:01:53.584 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T21:01:53.585 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T21:01:53.586 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T21:01:53.587 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T21:01:53.588 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T21:01:53.589 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T21:01:53.590 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T21:01:53.591 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T21:01:53.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T21:01:53.593 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T21:01:53.594 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T21:01:53.595 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T21:01:53.596 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T21:01:53.597 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T21:01:53.598 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T21:01:53.599 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T21:01:53.600 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T21:01:53.601 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T21:01:53.602 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T21:01:53.603 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T21:01:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T21:01:53.605 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T21:01:53.606 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T21:01:53.607 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T21:01:53.608 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T21:01:53.609 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T21:01:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T21:01:53.611 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T21:01:53.611 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T21:01:53.611 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T21:01:53.611 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T21:01:53.611 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T21:01:53.611 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T21:01:53.611 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T21:01:53.611 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T21:01:53.612 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T21:01:53.613 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T21:01:53.614 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T21:01:53.615 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T21:01:53.616 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T21:01:53.617 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T21:01:53.618 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T21:01:53.619 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T21:01:53.620 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T21:01:53.621 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T21:01:53.627 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:53.627 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:53.627 DEBUG:teuthology.orchestra.run.smithi106:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T21:01:53.634 INFO:teuthology.orchestra.run.smithi106.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T21:01:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T21:01:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T21:01:53.635 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T21:01:53.635 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:53.635 DEBUG:teuthology.orchestra.run.smithi106:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T21:01:53.677 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi106.front.sepia.ceph.com to complete... 2024-04-26T21:01:54.103 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2024-04-26T21:01:54.103 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T21:01:54.126 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-04-26T21:01:54.294 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:54.301 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T21:01:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T21:01:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T21:01:54.569 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T21:01:54.574 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T21:01:54.681 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T21:01:54.681 INFO:teuthology.orchestra.run.smithi106.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T21:01:54.681 INFO:teuthology.orchestra.run.smithi106.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T21:01:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-04-26T21:02:20.850 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-26T21:02:20.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:02:20.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:02:25.857 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T21:02:25.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-26T21:02:25.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:02:55.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-26T21:03:04.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:03:04.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:03:22.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-26T21:03:25.862 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T21:03:34.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-26T21:03:34.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:03:34.873 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-26T21:03:34.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:03:34.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:03:35.745 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-26T21:03:36.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:03:36.745 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T21:03:36.745 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-04-26T21:03:36.798 INFO:teuthology.orchestra.run.smithi112.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T21:03:36.798 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T21:03:36.798 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T21:03:36.798 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T21:03:37.799 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-26T21:03:37.799 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T21:03:38.112 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-04-26T21:03:38.194 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:46.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-26T21:03:46.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:03:47.288 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-26T21:03:47.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-26T21:03:47.969 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T21:03:47.969 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-04-26T21:03:48.019 INFO:teuthology.orchestra.run.smithi106.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T21:03:48.019 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T21:03:48.020 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T21:03:48.020 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T21:03:49.021 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T21:03:49.021 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T21:03:49.403 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2024-04-26T21:03:49.463 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:49.463 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T21:03:49.471 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T21:03:49.471 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T21:03:49.475 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T21:03:49.485 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T21:03:49.497 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T21:03:49.577 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T21:03:49.577 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T21:03:49.580 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T21:03:49.609 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T21:03:49.616 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T21:03:49.617 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T21:03:49.646 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T21:03:49.675 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:03:49.675 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:03:49.688 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:03:49.690 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:03:49.692 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T21:03:49.702 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T21:03:49.702 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T21:03:49.737 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T21:03:49.758 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T21:03:49.768 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T21:03:49.768 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T21:03:49.802 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T21:03:49.810 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:03:49.859 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:03:49.911 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:03:49.911 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T21:03:49.990 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:03:50.000 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:03:50.051 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:03:50.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T21:03:50.122 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-04-26T21:03:50.125 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-04-26T21:03:50.244 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T21:03:50.252 INFO:teuthology.task.internal:Starting timer... 2024-04-26T21:03:50.252 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T21:03:50.268 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T21:03:50.277 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2024-04-26T21:03:50.277 DEBUG:teuthology.task.selinux:Excluding smithi112: OS 'ubuntu' does not support SELinux 2024-04-26T21:03:50.278 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T21:03:50.278 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T21:03:50.278 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T21:03:50.278 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T21:03:50.287 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T21:03:50.309 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T21:03:50.310 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi106.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T21:11:32.423 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2024-04-26T21:11:32.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-26T21:11:32.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:11:32.511 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-26T21:11:32.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-26T21:11:32.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:11:32.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:11:32.727 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-26T21:11:32.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T21:11:32.845 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T21:11:32.856 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T21:11:32.856 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T21:11:32.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:11:32.860 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T21:11:32.860 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:11:32.897 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T21:11:32.897 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: Command line: ntpd -gq 2024-04-26T21:11:32.897 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: ---------------------------------------------------- 2024-04-26T21:11:32.897 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T21:11:32.897 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T21:11:32.897 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: corporation. Support and training for ntp-4 are 2024-04-26T21:11:32.897 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: available at https://www.nwtime.org/support 2024-04-26T21:11:32.897 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: ---------------------------------------------------- 2024-04-26T21:11:32.898 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: proto: precision = 0.044 usec (-24) 2024-04-26T21:11:32.898 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: basedate set to 2022-02-04 2024-04-26T21:11:32.898 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: gps base set to 2022-02-06 (week 2196) 2024-04-26T21:11:32.899 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T21:11:32.899 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T21:11:32.899 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T21:11:32.900 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T21:11:32.900 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T21:11:32.900 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T21:11:32.901 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T21:11:32.901 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2024-04-26T21:11:32.901 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: Listen normally on 4 lo [::1]:123 2024-04-26T21:11:32.901 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2024-04-26T21:11:32.901 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:32 ntpd[17213]: Listening on routing socket on fd #22 for interface updates 2024-04-26T21:11:32.926 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T21:11:32.926 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: Command line: ntpd -gq 2024-04-26T21:11:32.926 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: ---------------------------------------------------- 2024-04-26T21:11:32.927 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T21:11:32.927 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T21:11:32.927 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: corporation. Support and training for ntp-4 are 2024-04-26T21:11:32.927 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: available at https://www.nwtime.org/support 2024-04-26T21:11:32.927 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: ---------------------------------------------------- 2024-04-26T21:11:32.928 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: proto: precision = 0.043 usec (-24) 2024-04-26T21:11:32.928 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: basedate set to 2022-02-04 2024-04-26T21:11:32.928 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: gps base set to 2022-02-06 (week 2196) 2024-04-26T21:11:32.928 INFO:teuthology.orchestra.run.smithi112.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T21:11:32.928 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T21:11:32.929 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T21:11:32.929 INFO:teuthology.orchestra.run.smithi112.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T21:11:32.930 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T21:11:32.930 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T21:11:32.930 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T21:11:32.930 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: Listen normally on 3 enp3s0f1 172.21.15.112:123 2024-04-26T21:11:32.930 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: Listen normally on 4 lo [::1]:123 2024-04-26T21:11:32.930 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb69%5]:123 2024-04-26T21:11:32.931 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:32 ntpd[17216]: Listening on routing socket on fd #22 for interface updates 2024-04-26T21:11:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:33 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:33 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:33 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:33 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:33 ntpd[17216]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:33 ntpd[17216]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:34.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:34 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:34.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:34 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:34.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:34 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:34.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:34 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:34.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:34 ntpd[17216]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:34.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:34 ntpd[17216]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:35.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:35 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:35.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:35 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:35.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:35 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:35.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:35 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:35.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:35 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:35.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:35 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:35.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:35 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:35.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:35 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:35.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:35 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:35.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:35 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:35.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:35 ntpd[17216]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:35.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:35 ntpd[17216]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:36.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:36 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:36 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:36 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:36 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:36 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:36 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:36 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:36.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:36 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:36.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:36.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:36 ntpd[17216]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:37.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:37.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:37.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:37.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:37.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:37.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:37.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:37.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:37.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:37.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:37.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:37.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:37 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:37 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:37 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:37 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:37 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:37 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:37 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:37 ntpd[17216]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:37 ntpd[17216]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:38.897 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:38 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:38 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:38 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:38 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:38 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:38.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:38 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:38.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:38.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:38 ntpd[17216]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:39.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:39.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:39 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:39.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:39 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:39.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:39 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:39.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:39 ntpd[17216]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:39.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:39 ntpd[17216]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:39.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:39 ntpd[17216]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:39.927 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:39 ntpd[17216]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:39.927 INFO:teuthology.orchestra.run.smithi112.stdout:26 Apr 21:11:39 ntpd[17216]: ntpd: time slew -0.001197 s 2024-04-26T21:11:39.927 INFO:teuthology.orchestra.run.smithi112.stdout:ntpd: time slew -0.001197s 2024-04-26T21:11:39.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:39 ntpd[17216]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T21:11:39.928 INFO:teuthology.orchestra.run.smithi112.stderr:26 Apr 21:11:39 ntpd[17216]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T21:11:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T21:11:40.026 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-04-26T21:11:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:11:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:11:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:11:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:11:40.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:40 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:40.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:40 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:40.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:40 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:40.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:40 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:40.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:40 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:40.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:40 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:41.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:41.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:41.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:41.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:41.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T21:11:41.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T21:11:41.898 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T21:11:41.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T21:11:41.899 INFO:teuthology.orchestra.run.smithi106.stdout:26 Apr 21:11:41 ntpd[17213]: ntpd: time slew -0.000228 s 2024-04-26T21:11:41.899 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time slew -0.000228s 2024-04-26T21:11:41.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T21:11:41.899 INFO:teuthology.orchestra.run.smithi106.stderr:26 Apr 21:11:41 ntpd[17213]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T21:11:42.021 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T21:11:42.021 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-04-26T21:11:42.021 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:11:42.021 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:11:42.021 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:11:42.021 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:11:42.022 INFO:teuthology.run_tasks:Running task install... 2024-04-26T21:11:42.030 DEBUG:teuthology.task.install:project ceph 2024-04-26T21:11:42.031 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T21:11:42.031 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T21:11:42.031 INFO:teuthology.task.install:Using flavor: default 2024-04-26T21:11:42.036 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T21:11:42.037 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T21:11:42.037 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2024-04-26T21:11:42.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-key list | grep Ceph 2024-04-26T21:11:42.143 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T21:11:42.163 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T21:11:42.194 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T21:11:42.194 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T21:11:42.195 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T21:11:42.195 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T21:11:42.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:11:42.213 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T21:11:42.213 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T21:11:42.214 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T21:11:42.214 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T21:11:42.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:11:42.338 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T21:11:42.338 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T21:11:42.353 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T21:11:42.353 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T21:11:42.510 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:11:42.510 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T21:11:42.521 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:11:42.521 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T21:11:42.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-04-26T21:11:42.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-04-26T21:11:42.740 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T21:11:42.741 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T21:11:42.750 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T21:11:42.750 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T21:11:42.772 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T21:11:42.793 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T21:11:42.815 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T21:11:42.822 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T21:11:42.831 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T21:11:42.836 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T21:11:42.839 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T21:11:42.847 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T21:11:42.847 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T21:11:42.858 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T21:11:42.870 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T21:11:42.895 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T21:11:42.931 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T21:11:42.978 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T21:11:43.328 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 148 kB in 1s (261 kB/s) 2024-04-26T21:11:43.328 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 148 kB in 1s (256 kB/s) 2024-04-26T21:11:44.307 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-04-26T21:11:44.321 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-26T21:11:44.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T21:11:44.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T21:11:44.396 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-04-26T21:11:44.410 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-26T21:11:44.569 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-04-26T21:11:44.570 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-04-26T21:11:44.585 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-04-26T21:11:44.585 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-04-26T21:11:44.744 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T21:11:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T21:11:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T21:11:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T21:11:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T21:11:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T21:11:44.745 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T21:11:44.746 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-04-26T21:11:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T21:11:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T21:11:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T21:11:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T21:11:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T21:11:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T21:11:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T21:11:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T21:11:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-04-26T21:11:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: btrfs-tools 2024-04-26T21:11:44.760 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T21:11:44.760 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T21:11:44.760 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T21:11:44.760 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T21:11:44.760 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T21:11:44.760 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T21:11:44.761 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T21:11:44.761 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-04-26T21:11:44.762 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T21:11:44.762 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T21:11:44.762 INFO:teuthology.orchestra.run.smithi106.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T21:11:44.762 INFO:teuthology.orchestra.run.smithi106.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T21:11:44.763 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T21:11:44.763 INFO:teuthology.orchestra.run.smithi106.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T21:11:44.763 INFO:teuthology.orchestra.run.smithi106.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T21:11:44.763 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T21:11:44.763 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T21:11:44.764 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T21:11:44.765 INFO:teuthology.orchestra.run.smithi106.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T21:11:44.765 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-04-26T21:11:44.765 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T21:11:44.765 INFO:teuthology.orchestra.run.smithi106.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T21:11:44.765 INFO:teuthology.orchestra.run.smithi106.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T21:11:44.765 INFO:teuthology.orchestra.run.smithi106.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T21:11:44.765 INFO:teuthology.orchestra.run.smithi106.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T21:11:44.765 INFO:teuthology.orchestra.run.smithi106.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T21:11:44.766 INFO:teuthology.orchestra.run.smithi106.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T21:11:44.766 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2024-04-26T21:11:44.766 INFO:teuthology.orchestra.run.smithi106.stdout: btrfs-tools 2024-04-26T21:11:44.897 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-04-26T21:11:44.897 INFO:teuthology.orchestra.run.smithi112.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T21:11:44.897 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T21:11:44.897 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T21:11:44.897 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T21:11:44.897 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T21:11:44.897 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T21:11:44.897 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T21:11:44.897 INFO:teuthology.orchestra.run.smithi112.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T21:11:44.899 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T21:11:44.900 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T21:11:44.900 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T21:11:44.900 INFO:teuthology.orchestra.run.smithi112.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T21:11:44.900 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T21:11:44.900 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T21:11:44.900 INFO:teuthology.orchestra.run.smithi112.stdout: socat unzip xmlstarlet zip 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T21:11:44.913 INFO:teuthology.orchestra.run.smithi106.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T21:11:44.914 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T21:11:44.915 INFO:teuthology.orchestra.run.smithi106.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T21:11:44.915 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T21:11:44.915 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T21:11:44.915 INFO:teuthology.orchestra.run.smithi106.stdout: socat unzip xmlstarlet zip 2024-04-26T21:11:44.987 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T21:11:44.987 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 182 MB of archives. 2024-04-26T21:11:44.987 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T21:11:44.987 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T21:11:45.010 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T21:11:45.020 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T21:11:45.046 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T21:11:45.046 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 182 MB of archives. 2024-04-26T21:11:45.046 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T21:11:45.046 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T21:11:45.060 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T21:11:45.076 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T21:11:45.093 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T21:11:45.105 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T21:11:45.108 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T21:11:45.124 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T21:11:45.177 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T21:11:45.180 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T21:11:45.188 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T21:11:45.190 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T21:11:45.191 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T21:11:45.191 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T21:11:45.199 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T21:11:45.201 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T21:11:45.203 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T21:11:45.204 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T21:11:45.205 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T21:11:45.229 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T21:11:45.233 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T21:11:45.235 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T21:11:45.236 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T21:11:45.236 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T21:11:45.237 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T21:11:45.242 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T21:11:45.251 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T21:11:45.252 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T21:11:45.252 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T21:11:45.252 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T21:11:45.297 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T21:11:45.298 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T21:11:45.300 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T21:11:45.300 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T21:11:45.301 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T21:11:45.301 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T21:11:45.318 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T21:11:45.318 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T21:11:45.319 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T21:11:45.320 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T21:11:45.338 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T21:11:45.339 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T21:11:45.343 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T21:11:45.344 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T21:11:45.345 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T21:11:45.345 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T21:11:45.363 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T21:11:45.365 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T21:11:45.366 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T21:11:45.367 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T21:11:45.384 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T21:11:45.386 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T21:11:45.386 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T21:11:45.387 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T21:11:45.389 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T21:11:45.434 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T21:11:45.456 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T21:11:45.457 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T21:11:45.458 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T21:11:45.459 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T21:11:45.460 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T21:11:45.478 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T21:11:45.479 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T21:11:45.481 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T21:11:45.482 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T21:11:45.489 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T21:11:45.521 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T21:11:45.521 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T21:11:45.522 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T21:11:45.523 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T21:11:45.524 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T21:11:45.524 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T21:11:45.538 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T21:11:45.539 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T21:11:45.542 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T21:11:45.558 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T21:11:45.560 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T21:11:45.561 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T21:11:45.565 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T21:11:45.567 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T21:11:45.568 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T21:11:45.569 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T21:11:45.580 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T21:11:45.585 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T21:11:45.585 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T21:11:45.601 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T21:11:45.602 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T21:11:45.603 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T21:11:45.603 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T21:11:45.605 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T21:11:45.606 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T21:11:45.613 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T21:11:45.621 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T21:11:45.622 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T21:11:45.624 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T21:11:45.642 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T21:11:45.657 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T21:11:45.718 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T21:11:45.755 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T21:11:45.769 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T21:11:45.770 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T21:11:45.778 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T21:11:45.780 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T21:11:45.794 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T21:11:45.820 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T21:11:45.856 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T21:11:45.874 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T21:11:45.875 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T21:11:45.882 INFO:teuthology.orchestra.run.smithi106.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T21:11:45.884 INFO:teuthology.orchestra.run.smithi106.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T21:11:45.899 INFO:teuthology.orchestra.run.smithi106.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T21:11:45.912 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T21:11:46.285 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T21:11:46.286 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T21:11:46.338 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T21:11:46.398 INFO:teuthology.orchestra.run.smithi106.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T21:11:46.400 INFO:teuthology.orchestra.run.smithi106.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T21:11:46.409 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T21:11:46.456 INFO:teuthology.orchestra.run.smithi106.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T21:11:47.992 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T21:11:48.179 INFO:teuthology.orchestra.run.smithi106.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T21:11:48.290 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T21:11:48.330 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T21:11:48.334 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T21:11:48.420 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T21:11:48.523 INFO:teuthology.orchestra.run.smithi106.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T21:11:48.530 INFO:teuthology.orchestra.run.smithi106.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T21:11:48.534 INFO:teuthology.orchestra.run.smithi106.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T21:11:48.660 INFO:teuthology.orchestra.run.smithi106.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T21:11:48.840 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T21:11:49.058 INFO:teuthology.orchestra.run.smithi106.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T21:11:49.450 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T21:11:50.115 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T21:11:50.305 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T21:11:50.306 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T21:11:50.330 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T21:11:50.481 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T21:11:50.534 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T21:11:50.538 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T21:11:50.651 INFO:teuthology.orchestra.run.smithi106.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T21:11:50.652 INFO:teuthology.orchestra.run.smithi106.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T21:11:50.669 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T21:11:50.714 INFO:teuthology.orchestra.run.smithi106.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T21:11:50.920 INFO:teuthology.orchestra.run.smithi106.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T21:11:50.988 INFO:teuthology.orchestra.run.smithi106.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T21:11:50.994 INFO:teuthology.orchestra.run.smithi106.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T21:11:51.154 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T21:11:51.154 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T21:11:51.192 INFO:teuthology.orchestra.run.smithi106.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T21:11:51.862 INFO:teuthology.orchestra.run.smithi106.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T21:11:51.862 INFO:teuthology.orchestra.run.smithi106.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T21:11:51.895 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T21:11:52.650 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T21:11:52.911 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T21:11:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T21:11:53.540 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T21:11:53.557 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T21:11:53.567 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T21:11:53.568 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T21:11:53.586 INFO:teuthology.orchestra.run.smithi112.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T21:11:53.620 INFO:teuthology.orchestra.run.smithi112.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T21:11:53.719 INFO:teuthology.orchestra.run.smithi112.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T21:11:53.965 INFO:teuthology.orchestra.run.smithi112.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T21:11:54.049 INFO:teuthology.orchestra.run.smithi112.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T21:11:54.191 INFO:teuthology.orchestra.run.smithi112.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T21:11:54.192 INFO:teuthology.orchestra.run.smithi112.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T21:11:54.220 INFO:teuthology.orchestra.run.smithi112.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T21:11:54.221 INFO:teuthology.orchestra.run.smithi112.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T21:11:54.223 INFO:teuthology.orchestra.run.smithi112.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T21:11:54.224 INFO:teuthology.orchestra.run.smithi112.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T21:11:54.383 INFO:teuthology.orchestra.run.smithi112.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T21:11:54.465 INFO:teuthology.orchestra.run.smithi112.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T21:11:54.480 INFO:teuthology.orchestra.run.smithi112.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T21:11:54.547 INFO:teuthology.orchestra.run.smithi112.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T21:11:54.576 INFO:teuthology.orchestra.run.smithi112.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T21:11:54.594 INFO:teuthology.orchestra.run.smithi112.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T21:11:54.629 INFO:teuthology.orchestra.run.smithi112.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T21:11:54.803 INFO:teuthology.orchestra.run.smithi112.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T21:11:54.818 INFO:teuthology.orchestra.run.smithi112.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T21:11:54.825 INFO:teuthology.orchestra.run.smithi112.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T21:11:54.830 INFO:teuthology.orchestra.run.smithi112.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T21:11:55.014 INFO:teuthology.orchestra.run.smithi112.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T21:11:55.096 INFO:teuthology.orchestra.run.smithi112.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T21:11:55.110 INFO:teuthology.orchestra.run.smithi112.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T21:11:55.153 INFO:teuthology.orchestra.run.smithi112.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T21:11:55.294 INFO:teuthology.orchestra.run.smithi112.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T21:11:55.342 INFO:teuthology.orchestra.run.smithi112.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T21:11:55.356 INFO:teuthology.orchestra.run.smithi112.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T21:11:55.518 INFO:teuthology.orchestra.run.smithi112.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T21:11:55.519 INFO:teuthology.orchestra.run.smithi112.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T21:11:55.523 INFO:teuthology.orchestra.run.smithi112.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T21:11:55.529 INFO:teuthology.orchestra.run.smithi112.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T21:11:55.543 INFO:teuthology.orchestra.run.smithi112.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T21:11:55.729 INFO:teuthology.orchestra.run.smithi112.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T21:11:55.863 INFO:teuthology.orchestra.run.smithi106.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T21:11:55.864 INFO:teuthology.orchestra.run.smithi106.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T21:11:55.866 INFO:teuthology.orchestra.run.smithi106.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T21:11:55.867 INFO:teuthology.orchestra.run.smithi106.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T21:11:55.867 INFO:teuthology.orchestra.run.smithi106.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T21:11:55.874 INFO:teuthology.orchestra.run.smithi106.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T21:11:55.992 INFO:teuthology.orchestra.run.smithi112.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T21:11:56.124 INFO:teuthology.orchestra.run.smithi112.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T21:11:56.167 INFO:teuthology.orchestra.run.smithi112.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T21:11:56.258 INFO:teuthology.orchestra.run.smithi112.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T21:11:56.268 INFO:teuthology.orchestra.run.smithi112.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T21:11:56.280 INFO:teuthology.orchestra.run.smithi112.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T21:11:56.323 INFO:teuthology.orchestra.run.smithi112.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T21:11:56.588 INFO:teuthology.orchestra.run.smithi112.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T21:11:56.589 INFO:teuthology.orchestra.run.smithi112.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T21:11:56.591 INFO:teuthology.orchestra.run.smithi112.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T21:11:56.618 INFO:teuthology.orchestra.run.smithi106.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T21:11:56.757 INFO:teuthology.orchestra.run.smithi112.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T21:11:57.103 INFO:teuthology.orchestra.run.smithi112.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T21:11:57.260 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 182 MB in 12s (15.5 MB/s) 2024-04-26T21:11:57.440 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T21:11:57.506 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T21:11:57.507 INFO:teuthology.orchestra.run.smithi112.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T21:11:57.510 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T21:11:57.517 INFO:teuthology.orchestra.run.smithi112.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T21:11:57.517 INFO:teuthology.orchestra.run.smithi112.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T21:11:57.547 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T21:11:57.587 INFO:teuthology.orchestra.run.smithi112.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T21:11:57.588 INFO:teuthology.orchestra.run.smithi112.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T21:11:57.589 INFO:teuthology.orchestra.run.smithi112.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T21:11:57.590 INFO:teuthology.orchestra.run.smithi112.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T21:11:57.591 INFO:teuthology.orchestra.run.smithi112.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T21:11:57.591 INFO:teuthology.orchestra.run.smithi112.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T21:11:57.757 INFO:teuthology.orchestra.run.smithi112.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T21:11:57.850 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T21:11:57.864 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T21:11:57.908 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T21:11:57.961 INFO:teuthology.orchestra.run.smithi112.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T21:11:58.203 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T21:11:58.216 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T21:11:58.261 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T21:11:58.283 INFO:teuthology.orchestra.run.smithi112.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T21:11:58.330 INFO:teuthology.orchestra.run.smithi112.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T21:11:58.357 INFO:teuthology.orchestra.run.smithi112.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T21:11:58.365 INFO:teuthology.orchestra.run.smithi112.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T21:11:58.411 INFO:teuthology.orchestra.run.smithi112.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T21:11:58.437 INFO:teuthology.orchestra.run.smithi112.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T21:11:58.439 INFO:teuthology.orchestra.run.smithi112.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T21:11:58.446 INFO:teuthology.orchestra.run.smithi112.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T21:11:58.448 INFO:teuthology.orchestra.run.smithi112.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T21:11:58.581 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T21:11:58.594 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T21:11:58.646 INFO:teuthology.orchestra.run.smithi112.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T21:11:58.672 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T21:11:58.908 INFO:teuthology.orchestra.run.smithi112.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T21:11:58.976 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T21:11:58.990 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T21:11:59.035 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T21:11:59.309 INFO:teuthology.orchestra.run.smithi112.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T21:11:59.311 INFO:teuthology.orchestra.run.smithi112.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T21:11:59.445 INFO:teuthology.orchestra.run.smithi112.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T21:11:59.533 INFO:teuthology.orchestra.run.smithi112.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T21:11:59.654 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T21:11:59.669 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T21:11:59.738 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T21:11:59.841 INFO:teuthology.orchestra.run.smithi112.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T21:12:00.014 INFO:teuthology.orchestra.run.smithi112.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T21:12:00.200 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T21:12:00.214 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T21:12:00.266 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:12:00.636 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T21:12:00.650 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T21:12:00.694 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:12:01.022 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T21:12:01.037 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T21:12:01.080 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:12:01.434 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T21:12:01.448 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T21:12:01.492 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T21:12:01.795 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librados2. 2024-04-26T21:12:01.809 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:01.853 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:02.108 INFO:teuthology.orchestra.run.smithi112.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T21:12:02.175 INFO:teuthology.orchestra.run.smithi112.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T21:12:02.237 INFO:teuthology.orchestra.run.smithi112.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T21:12:02.273 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librbd1. 2024-04-26T21:12:02.287 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:02.323 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:02.725 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T21:12:02.739 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:02.784 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:03.045 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2024-04-26T21:12:03.059 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:03.103 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:03.205 INFO:teuthology.orchestra.run.smithi112.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T21:12:03.439 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T21:12:03.453 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:03.478 INFO:teuthology.orchestra.run.smithi112.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T21:12:03.488 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:03.708 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T21:12:03.722 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:03.758 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:04.077 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T21:12:04.092 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:04.136 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:04.568 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 182 MB in 19s (9,551 kB/s) 2024-04-26T21:12:04.614 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T21:12:04.629 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T21:12:04.672 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T21:12:04.744 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T21:12:04.808 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T21:12:04.812 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T21:12:04.860 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T21:12:04.891 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T21:12:04.906 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:04.942 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:05.121 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T21:12:05.134 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T21:12:05.196 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T21:12:05.253 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T21:12:05.267 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T21:12:05.311 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T21:12:05.499 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T21:12:05.512 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T21:12:05.549 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T21:12:05.613 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T21:12:05.628 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T21:12:05.672 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T21:12:05.918 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T21:12:05.932 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T21:12:05.983 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T21:12:05.998 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T21:12:06.019 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T21:12:06.041 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T21:12:06.320 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua5.1. 2024-04-26T21:12:06.335 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T21:12:06.370 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T21:12:06.372 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T21:12:06.387 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T21:12:06.430 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T21:12:06.673 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua-any. 2024-04-26T21:12:06.687 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T21:12:06.764 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T21:12:06.792 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T21:12:06.807 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T21:12:06.850 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T21:12:07.001 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package zip. 2024-04-26T21:12:07.015 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T21:12:07.058 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T21:12:07.270 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T21:12:07.285 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T21:12:07.328 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:12:07.329 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package unzip. 2024-04-26T21:12:07.343 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T21:12:07.379 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T21:12:07.749 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T21:12:07.763 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T21:12:07.782 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package luarocks. 2024-04-26T21:12:07.796 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T21:12:07.806 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:12:07.841 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T21:12:08.168 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T21:12:08.183 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T21:12:08.223 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2024-04-26T21:12:08.226 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:12:08.237 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:08.281 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:08.571 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T21:12:08.586 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T21:12:08.621 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T21:12:08.751 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T21:12:08.765 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:08.809 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:08.949 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librados2. 2024-04-26T21:12:08.964 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:09.041 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:09.162 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T21:12:09.177 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T21:12:09.212 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T21:12:09.498 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T21:12:09.513 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:09.556 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:09.710 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librbd1. 2024-04-26T21:12:09.725 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:09.768 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:09.985 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2024-04-26T21:12:09.999 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:10.043 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:10.213 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T21:12:10.226 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:10.263 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:10.548 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rados. 2024-04-26T21:12:10.563 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:10.607 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:10.939 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T21:12:10.954 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:11.001 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:11.040 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2024-04-26T21:12:11.054 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:11.098 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:11.237 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T21:12:11.251 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:11.295 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:11.621 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T21:12:11.631 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T21:12:11.634 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T21:12:11.646 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:11.679 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T21:12:11.698 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:11.982 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T21:12:11.996 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T21:12:12.040 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T21:12:12.051 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T21:12:12.065 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T21:12:12.101 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T21:12:12.304 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T21:12:12.318 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:12.362 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:12.368 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T21:12:12.383 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T21:12:12.427 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T21:12:12.722 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T21:12:12.723 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T21:12:12.737 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T21:12:12.738 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T21:12:12.780 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T21:12:12.781 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T21:12:13.083 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T21:12:13.084 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T21:12:13.097 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T21:12:13.099 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T21:12:13.141 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T21:12:13.142 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T21:12:13.445 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T21:12:13.453 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T21:12:13.460 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T21:12:13.467 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T21:12:13.495 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T21:12:13.510 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T21:12:13.824 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua5.1. 2024-04-26T21:12:13.839 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T21:12:13.847 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-portend. 2024-04-26T21:12:13.862 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T21:12:13.905 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T21:12:13.915 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T21:12:14.183 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T21:12:14.198 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T21:12:14.218 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-any. 2024-04-26T21:12:14.233 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T21:12:14.241 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T21:12:14.277 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T21:12:14.544 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T21:12:14.559 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T21:12:14.562 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package zip. 2024-04-26T21:12:14.577 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T21:12:14.602 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T21:12:14.621 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T21:12:14.960 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package unzip. 2024-04-26T21:12:14.974 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T21:12:15.018 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T21:12:15.173 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T21:12:15.188 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T21:12:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T21:12:15.421 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package luarocks. 2024-04-26T21:12:15.436 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T21:12:15.480 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T21:12:15.542 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T21:12:15.557 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T21:12:15.600 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T21:12:15.870 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T21:12:15.885 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T21:12:15.920 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T21:12:16.231 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2024-04-26T21:12:16.246 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T21:12:16.290 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T21:12:16.621 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librgw2. 2024-04-26T21:12:16.626 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T21:12:16.636 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:16.641 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T21:12:16.679 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:16.684 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T21:12:16.971 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T21:12:16.985 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T21:12:17.029 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T21:12:17.182 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T21:12:17.196 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:17.232 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:17.265 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2024-04-26T21:12:17.279 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T21:12:17.340 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T21:12:17.543 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T21:12:17.558 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T21:12:17.627 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T21:12:17.634 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T21:12:17.641 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T21:12:17.687 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T21:12:17.938 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T21:12:17.953 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:17.996 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:18.449 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-common. 2024-04-26T21:12:18.464 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:18.499 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:18.647 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T21:12:18.662 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T21:12:18.705 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T21:12:18.991 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2024-04-26T21:12:19.006 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T21:12:19.041 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T21:12:19.336 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T21:12:19.350 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T21:12:19.402 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T21:12:19.621 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-base. 2024-04-26T21:12:19.636 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:19.688 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:19.722 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T21:12:19.737 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T21:12:19.839 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T21:12:20.092 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T21:12:20.107 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T21:12:20.141 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T21:12:20.442 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T21:12:20.444 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T21:12:20.456 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T21:12:20.460 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T21:12:20.500 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T21:12:20.502 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T21:12:20.837 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T21:12:20.851 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T21:12:20.857 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T21:12:20.872 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T21:12:20.895 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T21:12:20.915 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T21:12:21.230 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-idna. 2024-04-26T21:12:21.239 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T21:12:21.241 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T21:12:21.254 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T21:12:21.285 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T21:12:21.298 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T21:12:21.559 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T21:12:21.563 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T21:12:21.574 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T21:12:21.578 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T21:12:21.613 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T21:12:21.642 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T21:12:21.945 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T21:12:21.950 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests. 2024-04-26T21:12:21.960 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T21:12:21.965 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T21:12:22.003 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T21:12:22.033 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T21:12:22.315 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T21:12:22.328 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T21:12:22.330 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T21:12:22.342 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T21:12:22.373 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T21:12:22.386 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T21:12:22.673 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T21:12:22.675 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-portend. 2024-04-26T21:12:22.684 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:22.691 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T21:12:22.722 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:22.734 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T21:12:23.020 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T21:12:23.035 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T21:12:23.102 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T21:12:23.103 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T21:12:23.117 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:23.160 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:23.406 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T21:12:23.421 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T21:12:23.465 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T21:12:23.488 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T21:12:23.501 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T21:12:23.538 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T21:12:23.816 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T21:12:23.818 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T21:12:23.829 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T21:12:23.833 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T21:12:23.866 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T21:12:23.877 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T21:12:24.152 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T21:12:24.165 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:24.210 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:24.221 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T21:12:24.236 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T21:12:24.279 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T21:12:24.574 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T21:12:24.589 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T21:12:24.624 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T21:12:24.664 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T21:12:24.677 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:24.722 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:24.927 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-mako. 2024-04-26T21:12:24.942 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T21:12:24.985 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T21:12:25.276 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T21:12:25.288 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:25.325 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:25.338 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T21:12:25.353 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T21:12:25.397 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T21:12:25.725 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T21:12:25.739 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T21:12:25.782 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T21:12:26.069 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webob. 2024-04-26T21:12:26.084 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T21:12:26.095 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2024-04-26T21:12:26.108 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:26.127 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T21:12:26.153 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:26.414 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T21:12:26.427 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:26.456 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:26.458 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T21:12:26.473 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T21:12:26.524 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T21:12:26.817 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T21:12:26.830 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:26.833 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T21:12:26.847 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T21:12:26.867 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:26.891 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T21:12:27.227 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-paste. 2024-04-26T21:12:27.242 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T21:12:27.254 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2024-04-26T21:12:27.266 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:27.285 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T21:12:27.312 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:27.598 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T21:12:27.611 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T21:12:27.630 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T21:12:27.645 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T21:12:27.648 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T21:12:27.688 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T21:12:27.984 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T21:12:27.996 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T21:12:28.000 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T21:12:28.014 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T21:12:28.033 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T21:12:28.057 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T21:12:28.361 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T21:12:28.376 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T21:12:28.454 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T21:12:28.781 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T21:12:28.796 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T21:12:28.839 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T21:12:28.981 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-babel. 2024-04-26T21:12:28.993 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T21:12:29.030 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T21:12:29.227 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T21:12:29.242 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T21:12:29.285 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T21:12:29.375 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T21:12:29.387 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T21:12:29.425 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T21:12:29.638 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-idna. 2024-04-26T21:12:29.653 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T21:12:29.696 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T21:12:29.769 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T21:12:29.784 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:29.828 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:30.024 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T21:12:30.039 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T21:12:30.074 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T21:12:30.356 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T21:12:30.371 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T21:12:30.411 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests. 2024-04-26T21:12:30.414 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T21:12:30.426 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T21:12:30.461 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T21:12:30.717 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2024-04-26T21:12:30.731 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T21:12:30.747 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T21:12:30.762 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T21:12:30.775 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T21:12:30.805 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T21:12:31.045 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T21:12:31.061 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:31.095 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:31.099 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T21:12:31.115 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:31.150 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:31.563 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T21:12:31.578 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:31.621 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:31.932 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T21:12:31.943 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T21:12:31.982 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T21:12:32.235 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T21:12:32.248 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T21:12:32.250 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T21:12:32.263 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T21:12:32.300 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T21:12:32.312 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T21:12:32.655 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T21:12:32.666 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:32.705 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:32.787 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T21:12:32.801 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T21:12:32.846 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T21:12:33.117 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T21:12:33.128 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:33.166 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:33.174 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T21:12:33.185 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T21:12:33.293 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T21:12:33.621 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T21:12:33.632 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T21:12:33.670 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T21:12:33.778 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T21:12:33.789 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:33.861 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:34.363 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T21:12:34.374 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:34.413 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:34.631 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph. 2024-04-26T21:12:34.641 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:34.681 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:34.967 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T21:12:34.978 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:35.016 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:35.316 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T21:12:35.328 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T21:12:35.358 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T21:12:35.403 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T21:12:35.414 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:35.453 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:35.610 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T21:12:35.622 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T21:12:35.660 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T21:12:35.864 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephadm. 2024-04-26T21:12:35.875 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:35.914 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:35.981 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T21:12:35.992 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T21:12:36.030 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T21:12:36.233 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T21:12:36.244 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T21:12:36.283 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T21:12:36.359 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T21:12:36.370 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T21:12:36.408 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T21:12:36.636 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T21:12:36.650 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T21:12:36.694 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T21:12:36.729 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T21:12:36.740 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T21:12:36.779 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T21:12:37.065 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T21:12:37.077 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T21:12:37.107 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T21:12:37.485 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T21:12:37.497 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T21:12:37.535 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T21:12:37.816 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-babel. 2024-04-26T21:12:37.827 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T21:12:37.863 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T21:12:37.866 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T21:12:37.875 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T21:12:37.913 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T21:12:38.210 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T21:12:38.224 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T21:12:38.269 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T21:12:38.610 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T21:12:38.613 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T21:12:38.621 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:38.626 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:38.660 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:38.663 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:38.975 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T21:12:38.980 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T21:12:38.988 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T21:12:38.991 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T21:12:39.016 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T21:12:39.030 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T21:12:39.311 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-routes. 2024-04-26T21:12:39.324 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T21:12:39.332 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T21:12:39.343 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T21:12:39.369 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T21:12:39.374 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T21:12:39.594 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2024-04-26T21:12:39.605 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T21:12:39.644 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T21:12:39.722 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T21:12:39.736 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:39.781 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:39.905 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2024-04-26T21:12:39.916 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T21:12:39.955 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T21:12:40.258 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T21:12:40.270 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T21:12:40.308 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T21:12:40.662 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2024-04-26T21:12:40.672 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:40.711 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:41.228 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T21:12:41.240 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T21:12:41.278 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T21:12:41.798 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T21:12:41.810 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T21:12:41.847 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T21:12:42.209 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T21:12:42.217 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T21:12:42.336 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T21:12:42.664 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T21:12:42.672 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T21:12:42.708 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T21:12:42.714 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T21:12:42.720 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:42.758 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:43.079 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T21:12:43.091 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:43.128 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:43.398 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T21:12:43.398 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T21:12:43.406 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:43.410 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T21:12:43.448 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T21:12:43.448 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:43.725 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T21:12:43.737 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:43.775 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:44.036 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T21:12:44.048 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:44.086 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:44.339 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T21:12:44.354 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:44.389 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:44.428 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T21:12:44.438 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T21:12:44.477 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T21:12:44.633 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T21:12:44.646 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T21:12:44.675 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T21:12:44.782 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T21:12:44.789 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T21:12:44.829 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T21:12:45.038 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T21:12:45.052 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T21:12:45.096 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T21:12:45.158 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T21:12:45.168 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T21:12:45.199 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T21:12:45.450 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T21:12:45.463 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T21:12:45.477 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T21:12:45.487 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T21:12:45.508 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T21:12:45.527 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T21:12:45.873 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T21:12:45.882 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T21:12:45.923 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T21:12:46.146 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package pkg-config. 2024-04-26T21:12:46.159 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T21:12:46.188 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T21:12:46.292 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T21:12:46.305 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T21:12:46.342 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T21:12:46.458 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T21:12:46.470 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T21:12:46.508 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T21:12:46.654 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T21:12:46.665 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T21:12:46.704 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T21:12:46.861 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T21:12:46.873 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T21:12:46.910 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T21:12:46.982 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T21:12:46.992 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T21:12:47.048 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T21:12:47.224 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T21:12:47.239 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T21:12:47.282 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T21:12:47.602 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T21:12:47.615 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T21:12:47.660 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T21:12:47.745 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T21:12:47.755 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:47.787 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:47.921 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T21:12:47.935 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T21:12:47.971 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T21:12:48.106 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T21:12:48.116 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T21:12:48.156 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T21:12:48.291 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2024-04-26T21:12:48.304 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T21:12:48.349 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T21:12:48.526 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T21:12:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T21:12:48.576 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T21:12:48.652 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T21:12:48.666 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T21:12:48.710 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T21:12:48.820 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package jq. 2024-04-26T21:12:48.830 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T21:12:48.862 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T21:12:49.115 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package socat. 2024-04-26T21:12:49.125 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T21:12:49.131 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T21:12:49.144 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T21:12:49.164 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T21:12:49.189 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T21:12:49.434 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-toml. 2024-04-26T21:12:49.447 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T21:12:49.492 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T21:12:49.504 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T21:12:49.525 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T21:12:49.542 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T21:12:49.828 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T21:12:49.842 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T21:12:49.886 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T21:12:49.896 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-test. 2024-04-26T21:12:49.907 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:49.972 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:50.214 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T21:12:50.227 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T21:12:50.264 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T21:12:50.517 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T21:12:50.530 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T21:12:50.567 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T21:12:51.237 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2024-04-26T21:12:51.250 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:51.287 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:51.932 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T21:12:51.946 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:51.951 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T21:12:51.962 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:51.990 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:51.992 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:52.283 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T21:12:52.338 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T21:12:52.349 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:52.380 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:52.554 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T21:12:52.680 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T21:12:52.716 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T21:12:52.727 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T21:12:52.766 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T21:12:52.923 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T21:12:53.010 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T21:12:53.021 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:53.052 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:53.326 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T21:12:53.348 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T21:12:53.359 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T21:12:53.398 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:53.684 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T21:12:53.695 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:12:53.734 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:53.913 INFO:teuthology.orchestra.run.smithi106.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T21:12:53.966 INFO:teuthology.orchestra.run.smithi106.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T21:12:54.006 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:54.054 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T21:12:54.067 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T21:12:54.128 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T21:12:54.475 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T21:12:54.475 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2024-04-26T21:12:54.489 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T21:12:54.533 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T21:12:54.596 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T21:12:54.864 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T21:12:54.928 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T21:12:54.944 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T21:12:54.986 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T21:12:55.107 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T21:12:55.283 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T21:12:55.425 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pkg-config. 2024-04-26T21:12:55.439 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T21:12:55.483 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T21:12:55.542 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T21:12:55.778 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T21:12:55.791 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T21:12:55.810 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T21:12:55.836 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T21:12:55.944 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T21:12:56.254 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T21:12:56.298 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T21:12:56.311 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T21:12:56.356 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T21:12:56.623 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T21:12:56.684 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T21:12:56.697 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T21:12:56.741 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T21:12:56.874 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T21:12:57.087 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T21:12:57.100 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T21:12:57.142 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T21:12:57.145 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T21:12:57.419 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T21:12:57.456 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T21:12:57.470 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T21:12:57.531 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T21:12:57.686 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T21:12:57.884 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-py. 2024-04-26T21:12:57.898 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T21:12:57.929 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T21:12:57.942 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T21:12:58.289 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T21:12:58.296 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T21:12:58.309 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T21:12:58.345 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T21:12:58.531 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:12:58.800 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T21:12:58.833 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T21:12:58.846 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T21:12:58.891 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T21:12:58.925 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T21:12:59.051 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T21:12:59.202 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-toml. 2024-04-26T21:12:59.216 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T21:12:59.252 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T21:12:59.327 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T21:12:59.453 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T21:12:59.588 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T21:12:59.602 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T21:12:59.646 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T21:12:59.712 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T21:13:00.025 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T21:13:00.045 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T21:13:00.084 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T21:13:00.095 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T21:13:00.152 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T21:13:00.207 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T21:13:00.334 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T21:13:00.361 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T21:13:00.373 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T21:13:00.444 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T21:13:00.693 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T21:13:00.819 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T21:13:01.095 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T21:13:01.198 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package radosgw. 2024-04-26T21:13:01.210 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:13:01.248 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:01.654 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T21:13:01.901 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T21:13:01.915 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T21:13:01.947 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T21:13:01.959 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:02.098 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T21:13:02.268 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T21:13:02.573 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T21:13:02.715 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T21:13:02.792 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T21:13:03.013 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T21:13:03.076 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T21:13:03.177 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T21:13:03.295 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T21:13:03.420 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T21:13:03.638 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T21:13:04.039 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T21:13:04.111 INFO:teuthology.orchestra.run.smithi112.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T21:13:04.162 INFO:teuthology.orchestra.run.smithi112.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T21:13:04.209 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:04.298 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T21:13:04.683 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T21:13:04.985 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T21:13:05.071 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user cephadm....done 2024-04-26T21:13:05.233 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T21:13:05.302 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T21:13:05.576 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T21:13:05.687 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T21:13:05.836 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T21:13:05.946 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T21:13:05.961 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T21:13:06.072 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:06.246 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T21:13:06.374 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T21:13:06.514 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T21:13:06.623 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T21:13:06.717 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T21:13:06.967 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T21:13:07.335 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T21:13:07.595 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T21:13:07.879 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T21:13:07.997 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T21:13:08.249 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:13:08.272 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T21:13:08.392 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T21:13:08.532 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T21:13:08.659 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T21:13:08.785 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T21:13:08.800 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T21:13:08.911 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T21:13:09.076 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T21:13:09.204 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T21:13:09.335 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:09.472 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T21:13:09.586 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T21:13:09.731 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:13:09.754 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T21:13:09.855 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T21:13:09.866 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T21:13:10.098 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T21:13:10.175 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T21:13:10.249 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T21:13:10.443 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T21:13:10.508 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T21:13:10.711 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T21:13:10.934 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T21:13:10.970 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T21:13:10.980 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T21:13:11.036 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T21:13:11.196 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T21:13:11.221 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T21:13:11.497 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T21:13:11.555 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T21:13:11.623 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T21:13:11.690 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T21:13:11.916 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T21:13:12.042 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T21:13:12.299 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T21:13:12.326 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T21:13:12.575 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T21:13:12.653 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T21:13:12.901 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T21:13:12.912 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T21:13:13.013 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T21:13:13.027 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T21:13:13.139 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T21:13:13.227 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T21:13:13.466 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T21:13:13.592 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T21:13:13.729 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T21:13:13.977 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T21:13:13.997 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T21:13:14.148 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T21:13:14.236 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T21:13:14.274 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T21:13:14.353 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T21:13:14.596 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:13:14.625 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T21:13:14.722 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T21:13:15.018 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T21:13:15.048 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T21:13:15.303 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T21:13:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T21:13:15.651 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T21:13:15.679 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T21:13:15.854 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T21:13:15.964 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T21:13:16.113 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T21:13:16.298 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T21:13:16.406 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T21:13:16.658 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T21:13:16.683 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T21:13:16.934 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T21:13:17.060 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:17.068 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T21:13:17.352 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T21:13:17.369 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T21:13:17.704 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T21:13:17.705 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T21:13:17.831 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:17.957 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:18.091 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T21:13:18.411 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:18.537 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:18.663 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T21:13:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T21:13:18.956 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:19.082 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:19.187 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:13:19.217 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:19.304 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T21:13:19.425 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T21:13:19.425 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T21:13:19.580 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T21:13:19.698 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T21:13:19.824 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T21:13:20.076 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:20.151 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T21:13:20.185 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:20.295 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:20.421 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:20.435 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T21:13:20.547 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T21:13:20.678 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:13:20.804 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T21:13:21.139 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T21:13:21.406 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T21:13:21.683 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T21:13:21.826 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:21.950 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T21:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:22.077 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:22.186 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:22.201 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T21:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:22.439 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:22.452 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T21:13:22.570 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T21:13:22.863 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T21:13:22.980 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T21:13:23.000 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2024-04-26T21:13:23.295 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T21:13:23.300 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2024-04-26T21:13:23.470 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2024-04-26T21:13:23.488 INFO:teuthology.orchestra.run.smithi106.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T21:13:23.608 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T21:13:23.632 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T21:13:23.867 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T21:13:23.993 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T21:13:24.045 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T21:13:24.119 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T21:13:24.208 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T21:13:24.446 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T21:13:24.572 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T21:13:24.798 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:24.974 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T21:13:25.008 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:13:25.008 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:13:25.250 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T21:13:25.367 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T21:13:25.610 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T21:13:25.633 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:25.744 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T21:13:25.759 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:26.062 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T21:13:26.300 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:13:26.300 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:13:26.372 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T21:13:26.678 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T21:13:26.892 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T21:13:26.927 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:27.185 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T21:13:27.264 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T21:13:27.445 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T21:13:27.713 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T21:13:27.929 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:28.128 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T21:13:28.129 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T21:13:28.140 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T21:13:28.433 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T21:13:28.756 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:28.794 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T21:13:28.919 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:28.993 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T21:13:28.993 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T21:13:29.046 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:29.188 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T21:13:29.517 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:29.624 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:29.668 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:29.794 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T21:13:30.145 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:30.271 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:30.397 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:30.432 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T21:13:30.432 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T21:13:30.616 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T21:13:30.616 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T21:13:31.048 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:31.182 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:31.190 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:31.316 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:31.350 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:31.442 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:31.561 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T21:13:31.561 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T21:13:31.610 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:31.736 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T21:13:32.352 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:32.502 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:32.628 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:32.780 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:33.048 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:33.149 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T21:13:33.174 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:33.266 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T21:13:33.300 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:33.409 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:33.418 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T21:13:33.530 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:33.636 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:34.214 INFO:teuthology.orchestra.run.smithi112.stdout:Adding group ceph....done 2024-04-26T21:13:34.469 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T21:13:34.641 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user ceph....done 2024-04-26T21:13:34.809 INFO:teuthology.orchestra.run.smithi112.stdout:Setting system user ceph properties....done 2024-04-26T21:13:34.825 INFO:teuthology.orchestra.run.smithi112.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T21:13:34.968 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T21:13:35.145 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T21:13:35.150 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T21:13:35.223 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-26T21:13:35.365 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T21:13:35.398 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-04-26T21:13:35.399 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-04-26T21:13:35.567 INFO:teuthology.orchestra.run.smithi106.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T21:13:35.567 INFO:teuthology.orchestra.run.smithi106.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T21:13:35.567 INFO:teuthology.orchestra.run.smithi106.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T21:13:35.567 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T21:13:35.567 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T21:13:35.567 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T21:13:35.567 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T21:13:35.568 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T21:13:35.568 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T21:13:35.568 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T21:13:35.568 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-04-26T21:13:35.569 INFO:teuthology.orchestra.run.smithi106.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T21:13:35.569 INFO:teuthology.orchestra.run.smithi106.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T21:13:35.569 INFO:teuthology.orchestra.run.smithi106.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T21:13:35.569 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T21:13:35.569 INFO:teuthology.orchestra.run.smithi106.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T21:13:35.570 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-04-26T21:13:35.570 INFO:teuthology.orchestra.run.smithi106.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T21:13:35.570 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T21:13:35.570 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T21:13:35.625 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-04-26T21:13:35.625 INFO:teuthology.orchestra.run.smithi106.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T21:13:35.625 INFO:teuthology.orchestra.run.smithi106.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T21:13:35.626 INFO:teuthology.orchestra.run.smithi106.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T21:13:35.626 INFO:teuthology.orchestra.run.smithi106.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T21:13:35.626 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T21:13:35.626 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T21:13:35.626 INFO:teuthology.orchestra.run.smithi106.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T21:13:35.628 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2024-04-26T21:13:35.628 INFO:teuthology.orchestra.run.smithi106.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T21:13:35.813 INFO:teuthology.orchestra.run.smithi106.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T21:13:35.870 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 55.7 MB of archives. 2024-04-26T21:13:35.870 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T21:13:35.870 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T21:13:36.079 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:36.287 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:13:36.287 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:13:36.455 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T21:13:36.471 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T21:13:36.597 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T21:13:36.597 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T21:13:36.598 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T21:13:36.627 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T21:13:36.628 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T21:13:36.632 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T21:13:36.634 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T21:13:36.635 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T21:13:36.801 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T21:13:36.913 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:37.039 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:37.081 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T21:13:37.091 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T21:13:37.096 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T21:13:37.184 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T21:13:37.577 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:13:37.578 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:13:38.151 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T21:13:38.153 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T21:13:38.153 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T21:13:38.179 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T21:13:38.179 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T21:13:38.183 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T21:13:38.209 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:38.349 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T21:13:38.593 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T21:13:38.964 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T21:13:38.964 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T21:13:39.244 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:39.492 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T21:13:39.492 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T21:13:40.162 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:40.221 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T21:13:40.221 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T21:13:40.374 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T21:13:40.375 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T21:13:41.013 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:41.321 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T21:13:41.321 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T21:13:41.948 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:42.074 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:42.178 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T21:13:42.251 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:42.443 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T21:13:42.443 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T21:13:43.088 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:43.270 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:43.396 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:43.539 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T21:13:43.900 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T21:13:44.000 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T21:13:44.152 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T21:13:45.178 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T21:13:45.354 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 2024-04-26T21:13:45.362 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T21:13:45.519 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T21:13:45.683 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T21:13:45.738 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T21:13:45.779 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T21:13:46.071 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T21:13:46.076 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T21:13:46.149 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-04-26T21:13:46.324 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-04-26T21:13:46.325 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-04-26T21:13:46.494 INFO:teuthology.orchestra.run.smithi112.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T21:13:46.495 INFO:teuthology.orchestra.run.smithi112.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T21:13:46.495 INFO:teuthology.orchestra.run.smithi112.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T21:13:46.495 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T21:13:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T21:13:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T21:13:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T21:13:46.495 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T21:13:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T21:13:46.496 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T21:13:46.496 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-04-26T21:13:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T21:13:46.496 INFO:teuthology.orchestra.run.smithi112.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T21:13:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T21:13:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T21:13:46.497 INFO:teuthology.orchestra.run.smithi112.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T21:13:46.498 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-04-26T21:13:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T21:13:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T21:13:46.498 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T21:13:46.552 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-04-26T21:13:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T21:13:46.552 INFO:teuthology.orchestra.run.smithi112.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T21:13:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T21:13:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T21:13:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T21:13:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T21:13:46.553 INFO:teuthology.orchestra.run.smithi112.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T21:13:46.554 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-04-26T21:13:46.554 INFO:teuthology.orchestra.run.smithi112.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T21:13:46.616 INFO:teuthology.orchestra.run.smithi112.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T21:13:46.617 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 55.7 MB of archives. 2024-04-26T21:13:46.617 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T21:13:46.617 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T21:13:46.782 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T21:13:46.787 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T21:13:46.821 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T21:13:46.821 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T21:13:46.822 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T21:13:46.830 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T21:13:46.831 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T21:13:46.833 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T21:13:46.834 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T21:13:46.834 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T21:13:46.835 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T21:13:46.846 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T21:13:46.846 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T21:13:46.847 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T21:13:46.867 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T21:13:47.097 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T21:13:47.100 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T21:13:47.100 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T21:13:47.103 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T21:13:47.103 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T21:13:47.107 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T21:13:47.109 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T21:13:47.117 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T21:13:47.118 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T21:13:47.141 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T21:13:47.144 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T21:13:47.156 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T21:13:47.178 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T21:13:47.181 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T21:13:47.182 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T21:13:47.183 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T21:13:47.183 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T21:13:47.196 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T21:13:47.198 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T21:13:47.439 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T21:13:47.439 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T21:13:47.440 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T21:13:47.440 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T21:13:47.440 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T21:13:47.441 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T21:13:47.455 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T21:13:47.455 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T21:13:47.830 INFO:teuthology.orchestra.run.smithi112.stdout:Preconfiguring packages ... 2024-04-26T21:13:48.011 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 55.7 MB in 1s (62.4 MB/s) 2024-04-26T21:13:48.282 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T21:13:48.286 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T21:13:48.436 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T21:13:48.750 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T21:13:49.030 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T21:13:49.205 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T21:13:50.150 INFO:teuthology.orchestra.run.smithi112.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T21:13:50.435 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package flex. 2024-04-26T21:13:50.504 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T21:13:50.508 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T21:13:50.551 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T21:13:51.069 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T21:13:51.281 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T21:13:51.663 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T21:13:52.219 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T21:13:52.222 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T21:13:52.356 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T21:13:52.793 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T21:13:53.022 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T21:13:53.387 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T21:13:53.764 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package bison. 2024-04-26T21:13:53.834 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T21:13:53.838 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T21:13:53.883 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T21:13:54.268 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T21:13:54.282 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T21:13:54.318 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T21:13:54.679 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package dump. 2024-04-26T21:13:54.693 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T21:13:54.737 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T21:13:55.016 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package indent. 2024-04-26T21:13:55.030 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:13:55.075 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T21:13:55.352 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T21:13:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T21:13:55.403 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T21:13:55.748 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T21:13:55.762 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T21:13:55.806 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T21:13:56.059 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T21:13:56.074 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T21:13:56.126 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T21:13:56.471 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T21:13:56.485 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T21:13:56.529 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T21:13:56.815 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T21:13:56.830 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T21:13:56.865 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T21:13:57.059 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T21:13:57.074 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T21:13:57.143 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T21:13:57.438 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T21:13:57.452 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T21:13:57.496 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T21:13:58.883 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T21:13:58.898 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T21:13:58.933 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T21:13:59.194 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T21:13:59.209 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T21:13:59.244 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T21:13:59.597 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T21:13:59.613 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T21:13:59.655 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T21:14:00.016 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T21:14:00.040 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T21:14:00.083 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T21:14:00.344 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T21:14:00.359 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T21:14:00.394 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T21:14:00.747 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T21:14:00.762 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:00.805 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:01.175 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T21:14:01.190 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:01.233 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T21:14:01.536 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T21:14:01.551 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:01.594 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T21:14:01.839 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T21:14:01.853 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T21:14:01.897 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T21:14:02.425 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T21:14:02.439 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T21:14:02.500 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T21:14:02.770 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package modemmanager. 2024-04-26T21:14:02.784 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T21:14:02.820 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T21:14:03.595 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package network-manager. 2024-04-26T21:14:03.610 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T21:14:03.660 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T21:14:04.294 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ppp. 2024-04-26T21:14:04.308 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T21:14:04.652 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T21:14:04.974 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T21:14:04.988 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T21:14:05.058 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T21:14:05.277 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T21:14:05.291 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T21:14:05.336 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T21:14:05.697 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T21:14:05.711 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T21:14:05.755 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T21:14:06.075 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T21:14:06.089 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:06.134 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:06.680 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T21:14:06.694 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T21:14:06.839 INFO:teuthology.orchestra.run.smithi112.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T21:14:06.870 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-common (238) ... 2024-04-26T21:14:07.355 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T21:14:07.369 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:07.415 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:08.533 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql. 2024-04-26T21:14:08.547 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T21:14:08.616 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql (14+238) ... 2024-04-26T21:14:08.851 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T21:14:08.865 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T21:14:08.901 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T21:14:09.162 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T21:14:09.176 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T21:14:09.220 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T21:14:09.573 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T21:14:09.587 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T21:14:09.631 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T21:14:09.917 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package tcl. 2024-04-26T21:14:09.934 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T21:14:09.979 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T21:14:10.295 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T21:14:10.309 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T21:14:10.353 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T21:14:10.716 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T21:14:10.730 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T21:14:10.774 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T21:14:11.185 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T21:14:11.200 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T21:14:11.260 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T21:14:11.569 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T21:14:11.775 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T21:14:11.901 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T21:14:12.052 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:12.179 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T21:14:12.288 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T21:14:12.439 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:13.378 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T21:14:13.495 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T21:14:14.321 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T21:14:14.321 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T21:14:15.023 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T21:14:15.174 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T21:14:15.300 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T21:14:15.426 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T21:14:15.569 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T21:14:15.728 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T21:14:15.854 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T21:14:15.980 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T21:14:16.669 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T21:14:16.803 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T21:14:16.898 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T21:14:16.963 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T21:14:17.140 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T21:14:17.248 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T21:14:17.366 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T21:14:17.492 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T21:14:17.615 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T21:14:17.686 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T21:14:17.812 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T21:14:17.988 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T21:14:18.139 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T21:14:18.256 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T21:14:18.408 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T21:14:18.576 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T21:14:19.334 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:14:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T21:14:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:which means they are currently configured by ifupdown: 2024-04-26T21:14:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:- enp3s0f1 2024-04-26T21:14:19.334 INFO:teuthology.orchestra.run.smithi112.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T21:14:19.335 INFO:teuthology.orchestra.run.smithi112.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T21:14:19.335 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:14:19.469 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T21:14:19.868 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T21:14:20.280 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T21:14:20.987 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T21:14:21.122 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T21:14:21.247 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T21:14:21.357 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-common (238) ... 2024-04-26T21:14:22.486 INFO:teuthology.orchestra.run.smithi112.stdout:Adding user postgres to group ssl-cert 2024-04-26T21:14:22.727 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:14:22.727 INFO:teuthology.orchestra.run.smithi112.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T21:14:23.005 INFO:teuthology.orchestra.run.smithi112.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T21:14:23.005 INFO:teuthology.orchestra.run.smithi112.stdout:Removing obsolete dictionary files: 2024-04-26T21:14:23.730 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T21:14:24.200 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:24.544 INFO:teuthology.orchestra.run.smithi112.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T21:14:24.575 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T21:14:24.629 INFO:teuthology.orchestra.run.smithi112.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T21:14:24.629 INFO:teuthology.orchestra.run.smithi112.stdout:This user must also own the server process. 2024-04-26T21:14:24.630 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:14:24.630 INFO:teuthology.orchestra.run.smithi112.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T21:14:24.630 INFO:teuthology.orchestra.run.smithi112.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T21:14:24.630 INFO:teuthology.orchestra.run.smithi112.stdout:The default text search configuration will be set to "english". 2024-04-26T21:14:24.630 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:14:24.630 INFO:teuthology.orchestra.run.smithi112.stdout:Data page checksums are disabled. 2024-04-26T21:14:24.630 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:14:24.630 INFO:teuthology.orchestra.run.smithi112.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T21:14:24.631 INFO:teuthology.orchestra.run.smithi112.stdout:creating subdirectories ... ok 2024-04-26T21:14:24.631 INFO:teuthology.orchestra.run.smithi112.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T21:14:24.654 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default max_connections ... 100 2024-04-26T21:14:24.688 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default shared_buffers ... 128MB 2024-04-26T21:14:24.702 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default time zone ... Etc/UTC 2024-04-26T21:14:24.703 INFO:teuthology.orchestra.run.smithi112.stdout:creating configuration files ... ok 2024-04-26T21:14:24.867 INFO:teuthology.orchestra.run.smithi112.stdout:running bootstrap script ... ok 2024-04-26T21:14:25.474 INFO:teuthology.orchestra.run.smithi112.stdout:performing post-bootstrap initialization ... ok 2024-04-26T21:14:26.021 INFO:teuthology.orchestra.run.smithi112.stdout:syncing data to disk ... ok 2024-04-26T21:14:26.554 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T21:14:29.599 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T21:14:29.758 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T21:14:29.884 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql (14+238) ... 2024-04-26T21:14:30.010 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T21:14:30.136 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T21:14:30.430 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T21:14:30.430 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T21:14:30.938 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T21:14:30.958 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T21:14:30.969 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T21:14:30.970 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T21:14:30.989 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T21:14:31.160 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T21:14:31.222 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T21:14:31.298 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T21:14:31.616 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T21:14:31.793 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T21:14:31.842 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T21:14:31.843 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T21:14:31.845 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T21:14:32.240 INFO:teuthology.orchestra.run.smithi106.stdout:Preconfiguring packages ... 2024-04-26T21:14:32.396 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 55.7 MB in 56s (990 kB/s) 2024-04-26T21:14:32.701 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T21:14:32.704 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T21:14:32.846 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T21:14:33.364 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T21:14:33.448 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T21:14:33.478 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T21:14:34.005 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T21:14:34.012 DEBUG:teuthology.parallel:result is None 2024-04-26T21:14:34.761 INFO:teuthology.orchestra.run.smithi106.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T21:14:35.069 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package flex. 2024-04-26T21:14:35.141 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T21:14:35.145 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T21:14:35.184 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T21:14:35.787 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T21:14:36.033 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T21:14:36.636 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T21:14:37.279 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T21:14:37.282 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T21:14:37.407 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T21:14:37.835 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T21:14:37.972 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T21:14:38.262 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T21:14:38.638 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package bison. 2024-04-26T21:14:38.712 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T21:14:38.716 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T21:14:38.758 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T21:14:39.142 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T21:14:39.156 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T21:14:39.200 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T21:14:39.552 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package dump. 2024-04-26T21:14:39.566 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T21:14:39.611 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T21:14:39.890 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package indent. 2024-04-26T21:14:39.904 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:39.948 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T21:14:40.201 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T21:14:40.217 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T21:14:40.259 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T21:14:40.513 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T21:14:40.527 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T21:14:40.563 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T21:14:40.857 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T21:14:40.871 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T21:14:40.915 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T21:14:41.252 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T21:14:41.266 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T21:14:41.310 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T21:14:41.563 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T21:14:41.577 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T21:14:41.613 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T21:14:41.857 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T21:14:41.872 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T21:14:41.932 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T21:14:42.235 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T21:14:42.250 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T21:14:42.293 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T21:14:43.605 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T21:14:43.620 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T21:14:43.663 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T21:14:43.924 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T21:14:43.939 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T21:14:43.982 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T21:14:44.285 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T21:14:44.300 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T21:14:44.343 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T21:14:44.704 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T21:14:44.720 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T21:14:44.763 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T21:14:45.090 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T21:14:45.106 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T21:14:45.149 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T21:14:45.476 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T21:14:45.491 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:45.535 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:45.913 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T21:14:45.928 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:45.971 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T21:14:46.249 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T21:14:46.264 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:46.298 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T21:14:46.534 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T21:14:46.550 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T21:14:46.592 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T21:14:47.130 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T21:14:47.145 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T21:14:47.188 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T21:14:47.524 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package modemmanager. 2024-04-26T21:14:47.539 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T21:14:47.574 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T21:14:48.206 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package network-manager. 2024-04-26T21:14:48.221 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T21:14:48.272 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T21:14:48.871 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ppp. 2024-04-26T21:14:48.886 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T21:14:49.238 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T21:14:49.525 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T21:14:49.539 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T21:14:49.584 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T21:14:49.836 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T21:14:49.850 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T21:14:49.895 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T21:14:50.148 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T21:14:50.162 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T21:14:50.197 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T21:14:50.526 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T21:14:50.540 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:50.584 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:51.148 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T21:14:51.162 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T21:14:51.223 INFO:teuthology.orchestra.run.smithi106.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T21:14:51.254 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-common (238) ... 2024-04-26T21:14:51.704 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T21:14:51.718 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T21:14:51.764 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:52.940 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql. 2024-04-26T21:14:52.955 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T21:14:52.998 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql (14+238) ... 2024-04-26T21:14:53.242 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T21:14:53.257 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T21:14:53.300 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T21:14:53.502 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T21:14:53.517 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T21:14:53.552 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T21:14:53.913 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T21:14:53.927 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T21:14:53.971 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T21:14:54.257 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package tcl. 2024-04-26T21:14:54.272 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T21:14:54.320 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T21:14:54.660 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T21:14:54.675 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T21:14:54.710 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T21:14:55.089 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T21:14:55.104 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T21:14:55.147 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T21:14:55.534 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T21:14:55.549 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T21:14:55.600 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T21:14:55.877 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T21:14:56.123 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T21:14:56.249 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T21:14:56.375 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:56.492 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T21:14:56.601 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T21:14:56.703 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:14:57.648 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T21:14:57.750 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T21:14:58.110 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T21:14:58.110 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T21:14:58.802 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T21:14:58.920 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T21:14:59.046 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T21:14:59.172 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T21:14:59.298 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T21:14:59.424 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T21:14:59.550 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T21:14:59.701 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T21:15:00.414 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T21:15:00.540 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T21:15:00.635 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T21:15:00.700 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T21:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T21:15:00.952 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T21:15:01.070 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T21:15:01.196 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T21:15:01.285 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T21:15:01.356 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T21:15:01.465 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T21:15:01.616 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T21:15:01.742 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T21:15:01.868 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T21:15:02.061 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T21:15:02.187 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T21:15:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T21:15:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:which means they are currently configured by ifupdown: 2024-04-26T21:15:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:- enp3s0f1 2024-04-26T21:15:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T21:15:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T21:15:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:02.902 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T21:15:03.307 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T21:15:03.715 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T21:15:04.590 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T21:15:04.724 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T21:15:04.850 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T21:15:04.985 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-common (238) ... 2024-04-26T21:15:05.954 INFO:teuthology.orchestra.run.smithi106.stdout:Adding user postgres to group ssl-cert 2024-04-26T21:15:06.197 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:06.197 INFO:teuthology.orchestra.run.smithi106.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T21:15:06.445 INFO:teuthology.orchestra.run.smithi106.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T21:15:06.445 INFO:teuthology.orchestra.run.smithi106.stdout:Removing obsolete dictionary files: 2024-04-26T21:15:07.159 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T21:15:07.995 INFO:teuthology.orchestra.run.smithi106.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T21:15:08.012 INFO:teuthology.orchestra.run.smithi106.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T21:15:08.068 INFO:teuthology.orchestra.run.smithi106.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T21:15:08.068 INFO:teuthology.orchestra.run.smithi106.stdout:This user must also own the server process. 2024-04-26T21:15:08.068 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:08.068 INFO:teuthology.orchestra.run.smithi106.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T21:15:08.068 INFO:teuthology.orchestra.run.smithi106.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T21:15:08.068 INFO:teuthology.orchestra.run.smithi106.stdout:The default text search configuration will be set to "english". 2024-04-26T21:15:08.069 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:08.069 INFO:teuthology.orchestra.run.smithi106.stdout:Data page checksums are disabled. 2024-04-26T21:15:08.069 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:08.069 INFO:teuthology.orchestra.run.smithi106.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T21:15:08.070 INFO:teuthology.orchestra.run.smithi106.stdout:creating subdirectories ... ok 2024-04-26T21:15:08.070 INFO:teuthology.orchestra.run.smithi106.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T21:15:08.093 INFO:teuthology.orchestra.run.smithi106.stdout:selecting default max_connections ... 100 2024-04-26T21:15:08.126 INFO:teuthology.orchestra.run.smithi106.stdout:selecting default shared_buffers ... 128MB 2024-04-26T21:15:08.140 INFO:teuthology.orchestra.run.smithi106.stdout:selecting default time zone ... Etc/UTC 2024-04-26T21:15:08.141 INFO:teuthology.orchestra.run.smithi106.stdout:creating configuration files ... ok 2024-04-26T21:15:08.306 INFO:teuthology.orchestra.run.smithi106.stdout:running bootstrap script ... ok 2024-04-26T21:15:08.910 INFO:teuthology.orchestra.run.smithi106.stdout:performing post-bootstrap initialization ... ok 2024-04-26T21:15:09.424 INFO:teuthology.orchestra.run.smithi106.stdout:syncing data to disk ... ok 2024-04-26T21:15:09.939 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T21:15:12.901 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T21:15:13.027 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T21:15:13.145 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql (14+238) ... 2024-04-26T21:15:13.246 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T21:15:13.372 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T21:15:13.663 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T21:15:13.663 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T21:15:14.349 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T21:15:14.442 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T21:15:14.794 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T21:15:14.945 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T21:15:16.331 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T21:15:16.423 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T21:15:16.948 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T21:15:16.955 DEBUG:teuthology.parallel:result is None 2024-04-26T21:15:16.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:15:17.178 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2024-04-26T21:15:17.201 INFO:teuthology.orchestra.run.smithi106.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T21:15:17.201 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T21:15:17.201 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T21:15:17.203 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:15:17.347 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-query -W -f '${Version}' ceph 2024-04-26T21:15:17.372 INFO:teuthology.orchestra.run.smithi112.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T21:15:17.372 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T21:15:17.372 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T21:15:17.374 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T21:15:17.374 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:17.374 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T21:15:17.393 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:17.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T21:15:17.435 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T21:15:17.436 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:17.436 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T21:15:17.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T21:15:17.519 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:17.519 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T21:15:17.541 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T21:15:17.601 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T21:15:17.601 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:17.602 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T21:15:17.620 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T21:15:17.685 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:17.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T21:15:17.705 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T21:15:17.765 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T21:15:17.766 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:17.766 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T21:15:17.785 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T21:15:17.845 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:17.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T21:15:17.866 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T21:15:17.929 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T21:15:18.025 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T21:15:18.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2024-04-26T21:15:18.028 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-04-26T21:15:18.049 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T21:15:18.049 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T21:15:18.093 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T21:15:18.113 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T21:15:18.114 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T21:15:18.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T21:15:18.184 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T21:15:18.185 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T21:15:18.185 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T21:15:18.185 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:18.185 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T21:15:18.218 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T21:15:18.303 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:18.303 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T21:15:18.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T21:15:18.409 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T21:15:18.409 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Replacing daemon mds.a'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T21:15:18.409 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/cap-flush}', 'email': None, 'first_in_suite': False, 'job_id': '7675201', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Replacing daemon mds.a'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcpSpnpXqcqA8+TYrlLQ9S56vKafZgtdbXj/DB/9ZSXn7D3s131WDCFvRDqQwYPethApYXp+E361o7/Y+d6ty0=', 'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN0/hyRZtYMfUwFnVNyrIkRCGja8UbbYbi0s8rYw9HwYeunrzm/bZx/FQZkxmiypzzedw9hUH3jn91gMfWQmVx8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Replacing daemon mds.a'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_cap_flush']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T21:15:18.410 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T21:15:18.413 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T21:15:18.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T21:15:18.465 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T21:15:18.486 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:18.486 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T21:15:18.530 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T21:15:18.530 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-04-26T21:15:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T21:15:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:18.579 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 872 Links: 1 2024-04-26T21:15:18.579 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:18.579 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-26 21:08:02.525059526 +0000 2024-04-26T21:15:18.581 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-26 21:08:02.269061812 +0000 2024-04-26T21:15:18.581 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-26 21:08:02.269061812 +0000 2024-04-26T21:15:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-26 21:08:02.269061812 +0000 2024-04-26T21:15:18.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T21:15:18.640 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-26T21:15:18.640 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-26T21:15:18.640 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000369277 s, 1.4 MB/s 2024-04-26T21:15:18.642 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T21:15:18.692 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-04-26T21:15:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T21:15:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:18.743 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 888 Links: 1 2024-04-26T21:15:18.743 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:18.743 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-26 21:08:03.125054166 +0000 2024-04-26T21:15:18.743 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-26 21:08:02.845056667 +0000 2024-04-26T21:15:18.743 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-26 21:08:02.845056667 +0000 2024-04-26T21:15:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-26 21:08:02.845056667 +0000 2024-04-26T21:15:18.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T21:15:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-26T21:15:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-26T21:15:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000354669 s, 1.4 MB/s 2024-04-26T21:15:18.805 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T21:15:18.858 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-04-26T21:15:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T21:15:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:18.911 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 903 Links: 1 2024-04-26T21:15:18.911 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:18.911 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-26 21:08:03.721048843 +0000 2024-04-26T21:15:18.911 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-26 21:08:03.461051165 +0000 2024-04-26T21:15:18.911 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-26 21:08:03.461051165 +0000 2024-04-26T21:15:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-26 21:08:03.461051165 +0000 2024-04-26T21:15:18.911 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T21:15:18.971 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-26T21:15:18.972 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-26T21:15:18.972 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000366515 s, 1.4 MB/s 2024-04-26T21:15:18.974 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T21:15:19.024 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-04-26T21:15:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T21:15:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:19.075 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 922 Links: 1 2024-04-26T21:15:19.075 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:19.075 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-26 21:08:04.301043662 +0000 2024-04-26T21:15:19.075 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-26 21:08:04.029046091 +0000 2024-04-26T21:15:19.075 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-26 21:08:04.029046091 +0000 2024-04-26T21:15:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-26 21:08:04.029046091 +0000 2024-04-26T21:15:19.075 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T21:15:19.132 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-26T21:15:19.132 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-26T21:15:19.132 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000362341 s, 1.4 MB/s 2024-04-26T21:15:19.133 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T21:15:19.184 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:19.184 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:19.185 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T21:15:19.193 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T21:15:19.193 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-04-26T21:15:19.242 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T21:15:19.243 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:19.243 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 886 Links: 1 2024-04-26T21:15:19.243 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:19.243 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 21:08:02.448497649 +0000 2024-04-26T21:15:19.243 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 21:08:02.172500114 +0000 2024-04-26T21:15:19.243 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 21:08:02.172500114 +0000 2024-04-26T21:15:19.243 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-26 21:08:02.172500114 +0000 2024-04-26T21:15:19.244 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T21:15:19.304 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T21:15:19.304 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T21:15:19.305 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000391659 s, 1.3 MB/s 2024-04-26T21:15:19.306 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T21:15:19.362 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-04-26T21:15:19.415 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T21:15:19.415 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-04-26T21:15:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 21:08:02.756494898 +0000 2024-04-26T21:15:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 21:08:02.752494933 +0000 2024-04-26T21:15:19.415 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 21:08:02.752494933 +0000 2024-04-26T21:15:19.415 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-26 21:08:02.752494933 +0000 2024-04-26T21:15:19.415 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T21:15:19.477 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T21:15:19.477 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T21:15:19.477 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000379056 s, 1.4 MB/s 2024-04-26T21:15:19.479 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T21:15:19.532 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-04-26T21:15:19.586 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T21:15:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:19.587 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 918 Links: 1 2024-04-26T21:15:19.587 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:19.587 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 21:08:03.620487180 +0000 2024-04-26T21:15:19.587 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 21:08:03.320489860 +0000 2024-04-26T21:15:19.587 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 21:08:03.320489860 +0000 2024-04-26T21:15:19.587 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-26 21:08:03.320489860 +0000 2024-04-26T21:15:19.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T21:15:19.648 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T21:15:19.648 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T21:15:19.648 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000378997 s, 1.4 MB/s 2024-04-26T21:15:19.650 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T21:15:19.704 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-04-26T21:15:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T21:15:19.758 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:15:19.758 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 936 Links: 1 2024-04-26T21:15:19.758 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:15:19.759 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 21:08:04.204481964 +0000 2024-04-26T21:15:19.759 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 21:08:03.904484644 +0000 2024-04-26T21:15:19.759 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 21:08:03.904484644 +0000 2024-04-26T21:15:19.759 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-26 21:08:03.904484644 +0000 2024-04-26T21:15:19.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T21:15:19.820 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T21:15:19.821 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T21:15:19.821 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000388374 s, 1.3 MB/s 2024-04-26T21:15:19.823 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T21:15:19.880 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:19.880 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T21:15:19.880 INFO:tasks.ceph:Generating config... 2024-04-26T21:15:19.881 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T21:15:19.881 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T21:15:19.881 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T21:15:19.881 INFO:tasks.ceph:[client] pid file = 2024-04-26T21:15:19.882 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T21:15:19.882 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T21:15:19.882 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T21:15:19.883 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T21:15:19.883 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T21:15:19.883 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T21:15:19.883 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T21:15:19.883 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T21:15:19.883 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T21:15:19.884 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T21:15:19.884 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T21:15:19.884 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T21:15:19.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T21:15:19.928 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T21:15:19.949 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T21:15:20.038 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T21:15:20.102 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.106'), ('mon.b', '172.21.15.112'), ('mon.c', '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]')] 2024-04-26T21:15:20.103 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.106,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T21:15:20.104 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:20.104 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T21:15:20.155 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.106 --add b 172.21.15.112 --addv c '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:20.246 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:20.246 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: generated fsid f2bfe958-5421-4d89-8d8f-237a3ca1f771 2024-04-26T21:15:20.246 INFO:teuthology.orchestra.run.smithi106.stdout:setting min_mon_release = quincy 2024-04-26T21:15:20.246 INFO:teuthology.orchestra.run.smithi106.stdout:epoch 0 2024-04-26T21:15:20.246 INFO:teuthology.orchestra.run.smithi106.stdout:fsid f2bfe958-5421-4d89-8d8f-237a3ca1f771 2024-04-26T21:15:20.246 INFO:teuthology.orchestra.run.smithi106.stdout:last_changed 2024-04-26T21:15:20.248077+0000 2024-04-26T21:15:20.246 INFO:teuthology.orchestra.run.smithi106.stdout:created 2024-04-26T21:15:20.248077+0000 2024-04-26T21:15:20.246 INFO:teuthology.orchestra.run.smithi106.stdout:min_mon_release 17 (quincy) 2024-04-26T21:15:20.247 INFO:teuthology.orchestra.run.smithi106.stdout:election_strategy: 1 2024-04-26T21:15:20.247 INFO:teuthology.orchestra.run.smithi106.stdout:0: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.a 2024-04-26T21:15:20.247 INFO:teuthology.orchestra.run.smithi106.stdout:1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-04-26T21:15:20.247 INFO:teuthology.orchestra.run.smithi106.stdout:2: [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon.c 2024-04-26T21:15:20.247 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T21:15:20.249 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T21:15:20.257 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f2bfe958-5421-4d89-8d8f-237a3ca1f771... 2024-04-26T21:15:20.258 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T21:15:20.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T21:15:20.340 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-04-26T21:15:20.340 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-04-26T21:15:20.341 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-04-26T21:15:20.342 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-04-26T21:15:20.343 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.106,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = f2bfe958-5421-4d89-8d8f-237a3ca1f771 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.344 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug trim objects = true 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-04-26T21:15:20.345 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-04-26T21:15:20.346 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.347 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T21:15:20.348 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: mon down mkfs grace = 300 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-04-26T21:15:20.349 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-04-26T21:15:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-26T21:15:20.351 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-04-26T21:15:20.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-04-26T21:15:20.353 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-04-26T21:15:20.354 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.106,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = f2bfe958-5421-4d89-8d8f-237a3ca1f771 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-04-26T21:15:20.355 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-04-26T21:15:20.356 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-04-26T21:15:20.356 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-04-26T21:15:20.357 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.357 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-04-26T21:15:20.357 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-04-26T21:15:20.357 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.357 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-04-26T21:15:20.357 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.357 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-04-26T21:15:20.357 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.357 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-04-26T21:15:20.358 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-04-26T21:15:20.359 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.360 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T21:15:20.361 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-04-26T21:15:20.362 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-04-26T21:15:20.363 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-04-26T21:15:20.365 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T21:15:20.365 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T21:15:20.463 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T21:15:20.463 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:20.463 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T21:15:20.471 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:20.471 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T21:15:20.526 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:15:20.526 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:20.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T21:15:20.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T21:15:20.597 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:20.597 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:20.647 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:15:20.647 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:20.647 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T21:15:20.647 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T21:15:20.682 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:20.683 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:20.738 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T21:15:20.738 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T21:15:20.738 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T21:15:20.792 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T21:15:20.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T21:15:20.857 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T21:15:20.872 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T21:15:20.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T21:15:20.926 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T21:15:20.931 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T21:15:20.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T21:15:21.044 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T21:15:21.049 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T21:15:21.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T21:15:21.129 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T21:15:21.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T21:15:21.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T21:15:21.256 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T21:15:21.261 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T21:15:21.281 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T21:15:21.281 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T21:15:21.323 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T21:15:21.339 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-26T21:15:21.427 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-26T21:15:21.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T21:15:21.486 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T21:15:21.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-26T21:15:21.586 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-26T21:15:21.603 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T21:15:21.603 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T21:15:21.603 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T21:15:21.623 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:21.623 INFO:tasks.ceph:role: osd.0 2024-04-26T21:15:21.623 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:15:21.623 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:15:21.693 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:15:22.111 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-26T21:15:22.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-26T21:15:22.114 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T21:15:22.223 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T21:15:22.238 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T21:15:22.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:15:22.240 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T21:15:22.301 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:22.301 INFO:tasks.ceph:role: osd.1 2024-04-26T21:15:22.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:15:22.302 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T21:15:22.369 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:15:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:15:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:15:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T21:15:22.369 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:15:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:15:22.370 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:15:22.370 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T21:15:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:15:22.370 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:15:22.738 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-26T21:15:22.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-26T21:15:22.741 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T21:15:22.812 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T21:15:22.870 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T21:15:22.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:15:22.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T21:15:22.934 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:22.934 INFO:tasks.ceph:role: osd.2 2024-04-26T21:15:22.934 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:15:22.934 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T21:15:23.001 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:15:23.001 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:15:23.002 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:15:23.002 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T21:15:23.002 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:15:23.002 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:15:23.002 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:15:23.002 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T21:15:23.002 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:15:23.002 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:15:23.395 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-26T21:15:23.398 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-26T21:15:23.398 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T21:15:23.489 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T21:15:23.551 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T21:15:23.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:15:23.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T21:15:23.614 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:23.614 INFO:tasks.ceph:role: osd.3 2024-04-26T21:15:23.614 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:15:23.615 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T21:15:23.682 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:15:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:15:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:15:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T21:15:23.683 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:15:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:15:23.683 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:15:23.683 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T21:15:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:15:23.683 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:15:24.079 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-26T21:15:24.082 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-26T21:15:24.082 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T21:15:24.193 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T21:15:24.210 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T21:15:24.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:15:24.211 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:24.334+0000 7f903cf6e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T21:15:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:24.334+0000 7f903cf6e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T21:15:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:24.334+0000 7f903cf6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T21:15:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:24.334+0000 7f903cf6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T21:15:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:24.334+0000 7f903cf6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T21:15:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:24.342+0000 7f903cf6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T21:15:27.386 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:15:27.406 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:27.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:27.498+0000 7f17dbae47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T21:15:27.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:27.498+0000 7f17dbae47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T21:15:27.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:27.498+0000 7f17dbae47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T21:15:27.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:27.498+0000 7f17dbae47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T21:15:27.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:27.498+0000 7f17dbae47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T21:15:27.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:27.502+0000 7f17dbae47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T21:15:30.542 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:15:30.563 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:30.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:30.662+0000 7efd2448a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T21:15:30.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:30.662+0000 7efd2448a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T21:15:30.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:30.662+0000 7efd2448a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T21:15:30.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:30.662+0000 7efd2448a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T21:15:30.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:30.662+0000 7efd2448a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T21:15:30.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:30.666+0000 7efd2448a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T21:15:33.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:15:33.747 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:33.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:33.842+0000 7f33bfc2c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T21:15:33.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:33.842+0000 7f33bfc2c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T21:15:33.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:33.842+0000 7f33bfc2c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T21:15:33.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:33.842+0000 7f33bfc2c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T21:15:33.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:33.842+0000 7f33bfc2c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T21:15:33.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:33.842+0000 7f33bfc2c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T21:15:36.866 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:15:36.886 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T21:15:36.909 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:36.909 INFO:tasks.ceph:role: osd.4 2024-04-26T21:15:36.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:15:36.909 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T21:15:36.982 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:15:36.982 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:15:36.982 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:15:36.982 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T21:15:36.982 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:15:36.982 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:15:36.982 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:15:36.982 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T21:15:36.983 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:15:36.983 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:15:37.398 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-26T21:15:37.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-26T21:15:37.402 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T21:15:37.548 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T21:15:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T21:15:37.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:15:37.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T21:15:37.630 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:37.630 INFO:tasks.ceph:role: osd.5 2024-04-26T21:15:37.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:15:37.630 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T21:15:37.700 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:15:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:15:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:15:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T21:15:37.700 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:15:37.700 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:15:37.701 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:15:37.701 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T21:15:37.701 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:15:37.701 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:15:38.060 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-26T21:15:38.063 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-26T21:15:38.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T21:15:38.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T21:15:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T21:15:38.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:15:38.203 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T21:15:38.265 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:38.265 INFO:tasks.ceph:role: osd.6 2024-04-26T21:15:38.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:15:38.265 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T21:15:38.341 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:15:38.341 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:15:38.341 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:15:38.341 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T21:15:38.341 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:15:38.341 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:15:38.342 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:15:38.342 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T21:15:38.342 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:15:38.342 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:15:38.738 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-26T21:15:38.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-26T21:15:38.742 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T21:15:38.850 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T21:15:38.867 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T21:15:38.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:15:38.868 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T21:15:38.930 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:15:38.931 INFO:tasks.ceph:role: osd.7 2024-04-26T21:15:38.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:15:38.931 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T21:15:39.001 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:15:39.002 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:15:39.002 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:15:39.002 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T21:15:39.002 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:15:39.002 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:15:39.002 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:15:39.002 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T21:15:39.002 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:15:39.002 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:15:39.432 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-26T21:15:39.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-26T21:15:39.436 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T21:15:39.585 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T21:15:39.602 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T21:15:39.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:15:39.603 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:39.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:39.729+0000 7f7f072c97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T21:15:39.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:39.733+0000 7f7f072c97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T21:15:39.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:39.733+0000 7f7f072c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T21:15:39.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:39.733+0000 7f7f072c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T21:15:39.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:39.733+0000 7f7f072c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T21:15:39.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:39.745+0000 7f7f072c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T21:15:42.787 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:15:42.808 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:42.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:42.897+0000 7fa68d8517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T21:15:42.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:42.897+0000 7fa68d8517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T21:15:42.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:42.897+0000 7fa68d8517c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T21:15:42.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:42.897+0000 7fa68d8517c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T21:15:42.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:42.897+0000 7fa68d8517c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T21:15:42.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:42.901+0000 7fa68d8517c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T21:15:45.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:15:45.963 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:46.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:46.061+0000 7efe3f2af7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T21:15:46.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:46.061+0000 7efe3f2af7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T21:15:46.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:46.061+0000 7efe3f2af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T21:15:46.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:46.061+0000 7efe3f2af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T21:15:46.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:46.061+0000 7efe3f2af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T21:15:46.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:46.061+0000 7efe3f2af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T21:15:48.412 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:15:48.416 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:15:49.123 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T21:15:49.144 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:49.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:49.241+0000 7f894b72d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T21:15:49.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:49.241+0000 7f894b72d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T21:15:49.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:49.241+0000 7f894b72d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T21:15:49.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:49.241+0000 7f894b72d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T21:15:49.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:49.241+0000 7f894b72d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T21:15:49.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:49.241+0000 7f894b72d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T21:15:52.280 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T21:15:52.301 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T21:15:52.301 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:52.302 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T21:15:52.324 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:52.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T21:15:52.388 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:52.388 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T21:15:52.452 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:52.452 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T21:15:52.515 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:52.515 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T21:15:52.579 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:52.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T21:15:52.643 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:52.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T21:15:52.703 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:52.703 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T21:15:52.724 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:52.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T21:15:52.785 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:52.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T21:15:52.849 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:52.849 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T21:15:52.913 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:52.914 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T21:15:52.977 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:52.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T21:15:53.042 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:53.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T21:15:53.109 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:53.109 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T21:15:53.118 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:53.118 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-26T21:15:53.168 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:53.168 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T21:15:53.177 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:53.177 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-26T21:15:53.226 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T21:15:53.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T21:15:53.229 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T21:15:53.273 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2024-04-26T21:15:53.273 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBoGSxmAJ1bLxAAyeY9mTV5xOUJ3pD75ezI1Q== 2024-04-26T21:15:53.273 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-26T21:15:53.273 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBoGSxmnbpbNxAA6IhzZVttczJ4W9ZegusRwQ== 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBpGSxms2DKAhAAaYPDF5kr0yMcSmaaxTenZA== 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBsGSxmhIAzFBAAA1H5RPuRhAa9unrw5v6JCA== 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBvGSxmMev4HRAAYhzGkK4NntrR6yYuI2Lcmg== 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQByGSxmnBTBJxAA8tHpRJt1Uhf3zaURRbj3Iw== 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB1GSxmSyZpMhAAqZiGb8nu+njwjeOs8WXgBQ== 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBoGSxm0GE8MxAAbIj4gFsieRfEpHtaP1m8pw== 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-26T21:15:53.274 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBpGSxmqlzZBxAASIBcd9DmmH4bKcVx9oJQnA== 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBpGSxmZkBsDxAA8RNfO768W8MptEyf0cNfig== 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB7GSxmB1LiKxAASugvjg0sVjd9vbVdVai3OA== 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB+GSxmSK/GNRAAxAHGFJYYoK1p/y4I80OCuQ== 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCCGSxmC1nkAxAA3TobMviF29A7UhoApCQhrA== 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCFGSxmWLqfDhAAKO37vykZrkZfsGhqx0q1RA== 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-04-26T21:15:53.275 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBpGSxm3sFdExAA7AIaf9qeEkhvJ9xnUUughQ== 2024-04-26T21:15:53.276 INFO:teuthology.orchestra.run.smithi106.stdout:[client.2] 2024-04-26T21:15:53.276 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBpGSxmNVKaGRAAbKbqflqQLfM3C8nCrieanQ== 2024-04-26T21:15:53.276 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2024-04-26T21:15:53.276 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBpGSxmR1kkHRAAHoaB8Q0JDmCjiHbkvqaPJQ== 2024-04-26T21:15:53.276 INFO:teuthology.orchestra.run.smithi106.stdout:[client.3] 2024-04-26T21:15:53.276 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBpGSxmtwYUIxAAfda0bVIXrlLN2eszizMxjg== 2024-04-26T21:15:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2024-04-26T21:15:53.287 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBoGSxmAJ1bLxAAyeY9mTV5xOUJ3pD75ezI1Q== 2024-04-26T21:15:53.287 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-04-26T21:15:53.287 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBoGSxmnbpbNxAA6IhzZVttczJ4W9ZegusRwQ== 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpGSxms2DKAhAAaYPDF5kr0yMcSmaaxTenZA== 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBsGSxmhIAzFBAAA1H5RPuRhAa9unrw5v6JCA== 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBvGSxmMev4HRAAYhzGkK4NntrR6yYuI2Lcmg== 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQByGSxmnBTBJxAA8tHpRJt1Uhf3zaURRbj3Iw== 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB1GSxmSyZpMhAAqZiGb8nu+njwjeOs8WXgBQ== 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBoGSxm0GE8MxAAbIj4gFsieRfEpHtaP1m8pw== 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpGSxmqlzZBxAASIBcd9DmmH4bKcVx9oJQnA== 2024-04-26T21:15:53.288 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpGSxmZkBsDxAA8RNfO768W8MptEyf0cNfig== 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB7GSxmB1LiKxAASugvjg0sVjd9vbVdVai3OA== 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQB+GSxmSK/GNRAAxAHGFJYYoK1p/y4I80OCuQ== 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCCGSxmC1nkAxAA3TobMviF29A7UhoApCQhrA== 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCFGSxmWLqfDhAAKO37vykZrkZfsGhqx0q1RA== 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpGSxm3sFdExAA7AIaf9qeEkhvJ9xnUUughQ== 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:[client.2] 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpGSxmNVKaGRAAbKbqflqQLfM3C8nCrieanQ== 2024-04-26T21:15:53.289 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2024-04-26T21:15:53.290 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpGSxmR1kkHRAAHoaB8Q0JDmCjiHbkvqaPJQ== 2024-04-26T21:15:53.290 INFO:teuthology.orchestra.run.smithi112.stdout:[client.3] 2024-04-26T21:15:53.290 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBpGSxmtwYUIxAAfda0bVIXrlLN2eszizMxjg== 2024-04-26T21:15:53.291 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:15:53.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:15:53.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:15:53.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:15:53.454 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:15:53.458 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:15:53.515 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.570 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.625 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.681 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:15:53.740 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:15:53.793 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:15:53.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:15:53.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:15:53.854 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:15:53.910 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.966 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:53.970 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:54.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:54.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:54.079 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:54.088 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:15:54.145 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:15:54.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:15:54.205 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:15:54.209 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:15:54.265 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:15:54.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:15:54.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:15:54.327 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:15:54.383 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T21:15:54.383 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T21:15:54.402 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T21:15:54.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T21:15:54.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T21:15:54.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T21:15:54.660 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T21:15:54.679 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T21:15:54.740 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T21:15:54.846 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T21:15:54.865 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:54.869 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:15:54.917 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T21:15:54.917 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T21:15:54.917 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T21:15:54.920 INFO:tasks.ceph.mon.a:Started 2024-04-26T21:15:54.920 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T21:15:54.921 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T21:15:54.960 INFO:tasks.ceph.mon.b:Started 2024-04-26T21:15:54.960 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T21:15:54.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T21:15:54.963 INFO:tasks.ceph.mon.c:Started 2024-04-26T21:15:54.963 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T21:15:54.963 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T21:15:54.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T21:15:54.966 INFO:tasks.ceph.mgr.y:Started 2024-04-26T21:15:54.966 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T21:15:54.966 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T21:15:54.969 INFO:tasks.ceph.mgr.x:Started 2024-04-26T21:15:54.969 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T21:15:54.970 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T21:15:55.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.105+0000 7f4886200640 1 Processor -- start 2024-04-26T21:15:55.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.105+0000 7f4886200640 1 -- start start 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f4886200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f488006de80 0x7f48800af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f4886200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48800cd610 con 0x7f488014cbc0 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f4886200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48800cd8f0 con 0x7f48800c6330 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f4886200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f48800cdbd0 con 0x7f488006de80 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f487fe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f48800c6330 0x7f48800ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:54626/0 (socket says 172.21.15.106:54626) 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f487fe00640 1 -- 172.21.15.106:0/730404961 learned_addr learned my addr 172.21.15.106:0/730404961 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f487f400640 1 --2- 172.21.15.106:0/730404961 >> v2:172.21.15.106:3300/0 conn(0x7f488006de80 0x7f48800af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f487f400640 1 -- 172.21.15.106:0/730404961 >> v2:172.21.15.106:3300/0 conn(0x7f488006de80 msgr2=0x7f48800af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f487f400640 1 -- 172.21.15.106:0/730404961 >> v2:172.21.15.106:3300/0 conn(0x7f488006de80 msgr2=0x7f48800af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f487f400640 1 --2- 172.21.15.106:0/730404961 >> v2:172.21.15.106:3300/0 conn(0x7f488006de80 0x7f48800af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:15:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.109+0000 7f487f400640 1 --2- 172.21.15.106:0/730404961 >> v2:172.21.15.106:3300/0 conn(0x7f488006de80 0x7f48800af860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:15:55.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924380616 0 0) 0x7f48800cd610 con 0x7f488014cbc0 2024-04-26T21:15:55.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4864003530 con 0x7f488014cbc0 2024-04-26T21:15:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2929707037 0 0) 0x7f4864003530 con 0x7f488014cbc0 2024-04-26T21:15:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 >> v2:172.21.15.106:3300/0 conn(0x7f488006de80 msgr2=0x7f48800af860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T21:15:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 --2- 172.21.15.106:0/730404961 >> v2:172.21.15.106:3300/0 conn(0x7f488006de80 0x7f48800af860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 >> v1:172.21.15.112:6789/0 conn(0x7f48800c6330 legacy=0x7f48800ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48800cdeb0 con 0x7f488014cbc0 2024-04-26T21:15:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f486c001680 con 0x7f488014cbc0 2024-04-26T21:15:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 >> v1:172.21.15.106:6789/0 conn(0x7f488014cbc0 legacy=0x7f48800c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f4864003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4864004810 0x7f4864004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48640051d0 0x7f486400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f48800cdbd0 con 0x7f48640039c0 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f486400c100 con 0x7f4864004810 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f486400c300 con 0x7f48640051d0 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487f400640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f4864003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487ea00640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4864004810 0x7f4864004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487fe00640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48640051d0 0x7f486400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487f400640 1 -- 172.21.15.106:0/730404961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48640051d0 msgr2=0x7f486400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487f400640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48640051d0 0x7f486400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487f400640 1 -- 172.21.15.106:0/730404961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4864004810 msgr2=0x7f4864004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:15:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487f400640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4864004810 0x7f4864004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487f400640 1 -- 172.21.15.106:0/730404961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4864003530 con 0x7f48640039c0 2024-04-26T21:15:55.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487fe00640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48640051d0 0x7f486400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:15:55.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.265+0000 7f487fe00640 1 -- 172.21.15.106:0/730404961 reap_dead start 2024-04-26T21:15:55.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.269+0000 7f487f400640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f4864003de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f487000c820 tx=0x7f487001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d997067d2e0788c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:55.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.269+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487000f040 con 0x7f48640039c0 2024-04-26T21:15:55.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.269+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48700b0070 con 0x7f48640039c0 2024-04-26T21:15:55.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.269+0000 7f487e000640 1 -- 172.21.15.106:0/730404961 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700ab890 con 0x7f48640039c0 2024-04-26T21:15:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.269+0000 7f4886200640 1 -- 172.21.15.106:0/730404961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 msgr2=0x7f4864003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.269+0000 7f4886200640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f4864003de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f487000c820 tx=0x7f487001c510 comp rx=0 tx=0).stop 2024-04-26T21:15:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 -- 172.21.15.106:0/730404961 shutdown_connections 2024-04-26T21:15:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 --2- 172.21.15.106:0/730404961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f4864003de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 -- 172.21.15.106:0/730404961 >> 172.21.15.106:0/730404961 conn(0x7f48800d2c50 msgr2=0x7f48800d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 -- 172.21.15.106:0/730404961 shutdown_connections 2024-04-26T21:15:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 -- 172.21.15.106:0/730404961 wait complete. 2024-04-26T21:15:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 Processor -- start 2024-04-26T21:15:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 -- start start 2024-04-26T21:15:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f48800b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48800c8d40 0x7f488014b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48800c80c0 0x7f48800c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f488014d110 con 0x7f48640039c0 2024-04-26T21:15:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f48800cd2a0 con 0x7f48800c80c0 2024-04-26T21:15:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f4886200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f488014d290 con 0x7f48800c8d40 2024-04-26T21:15:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f48800b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f48800b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59608/0 (socket says 172.21.15.106:59608) 2024-04-26T21:15:55.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487f400640 1 -- 172.21.15.106:0/3484162754 learned_addr learned my addr 172.21.15.106:0/3484162754 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:15:55.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487ea00640 1 --2- 172.21.15.106:0/3484162754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48800c8d40 0x7f488014b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487fe00640 1 --2- 172.21.15.106:0/3484162754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48800c80c0 0x7f48800c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487f400640 1 -- 172.21.15.106:0/3484162754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48800c8d40 msgr2=0x7f488014b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487f400640 1 --2- 172.21.15.106:0/3484162754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48800c8d40 0x7f488014b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487f400640 1 -- 172.21.15.106:0/3484162754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48800c80c0 msgr2=0x7f48800c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487f400640 1 --2- 172.21.15.106:0/3484162754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48800c80c0 0x7f48800c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.273+0000 7f487f400640 1 -- 172.21.15.106:0/3484162754 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48800b2f90 con 0x7f48640039c0 2024-04-26T21:15:55.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.277+0000 7f487f400640 1 --2- 172.21.15.106:0/3484162754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f48800b5870 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f487001c340 tx=0x7f4864005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:55.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.277+0000 7f4877400640 1 -- 172.21.15.106:0/3484162754 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700c2070 con 0x7f48640039c0 2024-04-26T21:15:55.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.277+0000 7f4877400640 1 -- 172.21.15.106:0/3484162754 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48700aba10 con 0x7f48640039c0 2024-04-26T21:15:55.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.277+0000 7f4877400640 1 -- 172.21.15.106:0/3484162754 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700abde0 con 0x7f48640039c0 2024-04-26T21:15:55.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.277+0000 7f4886200640 1 -- 172.21.15.106:0/3484162754 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4880166950 con 0x7f48640039c0 2024-04-26T21:15:55.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.277+0000 7f4886200640 1 -- 172.21.15.106:0/3484162754 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48800c7c10 con 0x7f48640039c0 2024-04-26T21:15:55.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.277+0000 7f4877400640 1 -- 172.21.15.106:0/3484162754 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f48700bd410 con 0x7f48640039c0 2024-04-26T21:15:55.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.277+0000 7f4877400640 1 -- 172.21.15.106:0/3484162754 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f48700c66c0 con 0x7f48640039c0 2024-04-26T21:15:55.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.277+0000 7f4886200640 1 -- 172.21.15.106:0/3484162754 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4880069400 con 0x7f48640039c0 2024-04-26T21:15:55.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.285+0000 7f4877400640 1 -- 172.21.15.106:0/3484162754 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f48700cb080 con 0x7f48640039c0 2024-04-26T21:15:55.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.349+0000 7f4886200640 1 -- 172.21.15.106:0/3484162754 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4880163250 con 0x7f48640039c0 2024-04-26T21:15:55.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4877400640 1 -- 172.21.15.106:0/3484162754 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f4870016220 con 0x7f48640039c0 2024-04-26T21:15:55.354 INFO:teuthology.orchestra.run.smithi106.stderr:adjusted tunables profile to default 2024-04-26T21:15:55.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4886200640 1 -- 172.21.15.106:0/3484162754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 msgr2=0x7f48800b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4886200640 1 --2- 172.21.15.106:0/3484162754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f48800b5870 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f487001c340 tx=0x7f4864005840 comp rx=0 tx=0).stop 2024-04-26T21:15:55.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4886200640 1 -- 172.21.15.106:0/3484162754 shutdown_connections 2024-04-26T21:15:55.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4886200640 1 --2- 172.21.15.106:0/3484162754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48800c80c0 0x7f48800c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4886200640 1 --2- 172.21.15.106:0/3484162754 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48800c8d40 0x7f488014b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4886200640 1 --2- 172.21.15.106:0/3484162754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48640039c0 0x7f48800b5870 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4886200640 1 -- 172.21.15.106:0/3484162754 >> 172.21.15.106:0/3484162754 conn(0x7f48800d2c50 msgr2=0x7f48800d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:55.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4886200640 1 -- 172.21.15.106:0/3484162754 shutdown_connections 2024-04-26T21:15:55.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:55.353+0000 7f4886200640 1 -- 172.21.15.106:0/3484162754 wait complete. 2024-04-26T21:15:55.374 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T21:15:55.374 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T21:15:55.374 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:55.375 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T21:15:55.395 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:55.395 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T21:15:55.459 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:55.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T21:15:55.482 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:55.481+0000 7ff5a3632180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T21:15:55.501 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:15:55.501 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T21:15:55.510 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:55.508+0000 7fcb3150b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T21:15:55.563 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:55.563 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T21:15:55.583 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:55.583 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T21:15:55.644 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:55.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T21:15:55.705 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:15:55.705 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T21:15:55.768 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new b1272518-db2d-43bd-bb42-452c2492611a 0 2024-04-26T21:15:55.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.944+0000 7fab56800640 1 Processor -- start 2024-04-26T21:15:55.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.944+0000 7fab56800640 1 -- start start 2024-04-26T21:15:55.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.944+0000 7fab56800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fab5006ed70 0x7fab5006c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.944+0000 7fab56800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006c940 0x7fab500d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.944+0000 7fab56800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5006f1d0 con 0x7fab5006fa90 2024-04-26T21:15:55.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.944+0000 7fab56800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fab500b0750 con 0x7fab5006ed70 2024-04-26T21:15:55.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.944+0000 7fab56800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fab500b6ec0 con 0x7fab5006c940 2024-04-26T21:15:55.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.944+0000 7fab55e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006c940 0x7fab500d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.944+0000 7fab54a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fab5006ed70 0x7fab5006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab54a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fab5006ed70 0x7fab5006c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43156/0 (socket says 172.21.15.112:43156) 2024-04-26T21:15:55.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab54a00640 1 -- 172.21.15.112:0/1114827617 learned_addr learned my addr 172.21.15.112:0/1114827617 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:55.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab55400640 1 --1- 172.21.15.112:0/1114827617 >> v1:172.21.15.106:6789/0 conn(0x7fab5006fa90 0x7fab500b67b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.112:52082/0 (socket says 172.21.15.112:52082) 2024-04-26T21:15:55.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab55e00640 1 -- 172.21.15.112:0/1114827617 >> v2:172.21.15.112:3300/0 conn(0x7fab5006ed70 msgr2=0x7fab5006c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:15:55.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab55e00640 1 --2- 172.21.15.112:0/1114827617 >> v2:172.21.15.112:3300/0 conn(0x7fab5006ed70 0x7fab5006c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab55e00640 1 -- 172.21.15.112:0/1114827617 >> v1:172.21.15.106:6789/0 conn(0x7fab5006fa90 legacy=0x7fab500b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab55e00640 1 -- 172.21.15.112:0/1114827617 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab500b09a0 con 0x7fab5006c940 2024-04-26T21:15:55.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab55e00640 1 --2- 172.21.15.112:0/1114827617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006c940 0x7fab500d1c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fab48009d90 tx=0x7fab4801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ecb00f3a82d3ee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:55.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab4fe00640 1 -- 172.21.15.112:0/1114827617 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab480b2070 con 0x7fab5006c940 2024-04-26T21:15:55.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab4fe00640 1 -- 172.21.15.112:0/1114827617 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab480a58b0 con 0x7fab5006c940 2024-04-26T21:15:55.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.948+0000 7fab4fe00640 1 -- 172.21.15.112:0/1114827617 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab480a5c80 con 0x7fab5006c940 2024-04-26T21:15:55.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 -- 172.21.15.112:0/1114827617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006c940 msgr2=0x7fab500d1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 --2- 172.21.15.112:0/1114827617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006c940 0x7fab500d1c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fab48009d90 tx=0x7fab4801c8e0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 -- 172.21.15.112:0/1114827617 shutdown_connections 2024-04-26T21:15:55.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 --2- 172.21.15.112:0/1114827617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006c940 0x7fab500d1c00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 --2- 172.21.15.112:0/1114827617 >> v2:172.21.15.112:3300/0 conn(0x7fab5006ed70 0x7fab5006c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 -- 172.21.15.112:0/1114827617 >> 172.21.15.112:0/1114827617 conn(0x7fab50068140 msgr2=0x7fab50068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:55.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 -- 172.21.15.112:0/1114827617 shutdown_connections 2024-04-26T21:15:55.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 -- 172.21.15.112:0/1114827617 wait complete. 2024-04-26T21:15:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 Processor -- start 2024-04-26T21:15:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 -- start start 2024-04-26T21:15:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab5006c940 0x7fab501382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab5006ed70 0x7fab500b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006fa90 0x7fab500b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fab5006fe70 con 0x7fab5006c940 2024-04-26T21:15:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fab500d16e0 con 0x7fab5006ed70 2024-04-26T21:15:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab56800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fab50070880 con 0x7fab5006fa90 2024-04-26T21:15:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab55e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006fa90 0x7fab500b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab54a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab5006ed70 0x7fab500b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab55e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006fa90 0x7fab500b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:40114/0 (socket says 172.21.15.112:40114) 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab55e00640 1 -- 172.21.15.112:0/2224891141 learned_addr learned my addr 172.21.15.112:0/2224891141 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.952+0000 7fab54a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab5006ed70 0x7fab500b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43170/0 (socket says 172.21.15.112:43170) 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab55400640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab5006c940 0x7fab501382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab55e00640 1 -- 172.21.15.112:0/2224891141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab5006ed70 msgr2=0x7fab500b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab55e00640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab5006ed70 0x7fab500b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab55e00640 1 -- 172.21.15.112:0/2224891141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab5006c940 msgr2=0x7fab501382a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab55e00640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab5006c940 0x7fab501382a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab55e00640 1 -- 172.21.15.112:0/2224891141 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab50157110 con 0x7fab5006fa90 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab54a00640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab5006ed70 0x7fab500b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab55400640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab5006c940 0x7fab501382a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:15:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab55e00640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006fa90 0x7fab500b27c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab480b0040 tx=0x7fab48019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:55.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab4d600640 1 -- 172.21.15.112:0/2224891141 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab480b2050 con 0x7fab5006fa90 2024-04-26T21:15:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab4d600640 1 -- 172.21.15.112:0/2224891141 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab480be070 con 0x7fab5006fa90 2024-04-26T21:15:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab56800640 1 -- 172.21.15.112:0/2224891141 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab501573f0 con 0x7fab5006fa90 2024-04-26T21:15:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab4d600640 1 -- 172.21.15.112:0/2224891141 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab480ad850 con 0x7fab5006fa90 2024-04-26T21:15:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab56800640 1 -- 172.21.15.112:0/2224891141 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fab501579b0 con 0x7fab5006fa90 2024-04-26T21:15:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab4d600640 1 -- 172.21.15.112:0/2224891141 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fab480ad9f0 con 0x7fab5006fa90 2024-04-26T21:15:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab4d600640 1 -- 172.21.15.112:0/2224891141 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fab480c3c10 con 0x7fab5006fa90 2024-04-26T21:15:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.956+0000 7fab56800640 1 -- 172.21.15.112:0/2224891141 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab500506d0 con 0x7fab5006fa90 2024-04-26T21:15:55.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:55.968+0000 7fab4d600640 1 -- 172.21.15.112:0/2224891141 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fab48016560 con 0x7fab5006fa90 2024-04-26T21:15:55.992 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:55.989+0000 7ff5a3632180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T21:15:56.027 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:56.024+0000 7fcb3150b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T21:15:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.036+0000 7fab56800640 1 -- 172.21.15.112:0/2224891141 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b1272518-db2d-43bd-bb42-452c2492611a", "id": 0} v 0) -- 0x7fab5006d2f0 con 0x7fab5006fa90 2024-04-26T21:15:56.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.040+0000 7fab4d600640 1 -- 172.21.15.112:0/2224891141 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b1272518-db2d-43bd-bb42-452c2492611a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fab480addd0 con 0x7fab5006fa90 2024-04-26T21:15:56.045 INFO:teuthology.orchestra.run.smithi112.stdout:0 2024-04-26T21:15:56.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.044+0000 7fab56800640 1 -- 172.21.15.112:0/2224891141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006fa90 msgr2=0x7fab500b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.044+0000 7fab56800640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006fa90 0x7fab500b27c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab480b0040 tx=0x7fab48019680 comp rx=0 tx=0).stop 2024-04-26T21:15:56.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.044+0000 7fab56800640 1 -- 172.21.15.112:0/2224891141 shutdown_connections 2024-04-26T21:15:56.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.044+0000 7fab56800640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab5006ed70 0x7fab500b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.044+0000 7fab56800640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fab5006fa90 0x7fab500b27c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.044+0000 7fab56800640 1 --2- 172.21.15.112:0/2224891141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab5006c940 0x7fab501382a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.044+0000 7fab56800640 1 -- 172.21.15.112:0/2224891141 >> 172.21.15.112:0/2224891141 conn(0x7fab50068140 msgr2=0x7fab50068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.044+0000 7fab56800640 1 -- 172.21.15.112:0/2224891141 shutdown_connections 2024-04-26T21:15:56.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.044+0000 7fab56800640 1 -- 172.21.15.112:0/2224891141 wait complete. 2024-04-26T21:15:56.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new d5376c79-a72d-4e12-86c4-643ce6ae38e3 1 2024-04-26T21:15:56.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f6c00640 1 Processor -- start 2024-04-26T21:15:56.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f6c00640 1 -- start start 2024-04-26T21:15:56.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f6c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa1f00b04a0 0x7fa1f00b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f6c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f00afe10 con 0x7fa1f00d08c0 2024-04-26T21:15:56.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f6c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f0075f20 con 0x7fa1f00ce1a0 2024-04-26T21:15:56.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f6c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f00d0f30 con 0x7fa1f00b04a0 2024-04-26T21:15:56.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f5800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa1f00ce1a0 0x7fa1f00d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44104/0 (socket says 172.21.15.112:44104) 2024-04-26T21:15:56.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f5800640 1 -- 172.21.15.112:0/1316835678 learned_addr learned my addr 172.21.15.112:0/1316835678 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-26T21:15:56.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f4e00640 1 --2- 172.21.15.112:0/1316835678 >> v2:172.21.15.112:3300/0 conn(0x7fa1f00b04a0 0x7fa1f00b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1efe00640 1 -- 172.21.15.112:0/1316835678 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632090802 0 0) 0x7fa1f0075f20 con 0x7fa1f00ce1a0 2024-04-26T21:15:56.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1efe00640 1 -- 172.21.15.112:0/1316835678 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d8003530 con 0x7fa1f00ce1a0 2024-04-26T21:15:56.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f4e00640 1 -- 172.21.15.112:0/1316835678 >> v1:172.21.15.112:6789/0 conn(0x7fa1f00ce1a0 legacy=0x7fa1f00d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1efe00640 1 -- 172.21.15.112:0/1316835678 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634456905 0 0) 0x7fa1f00afe10 con 0x7fa1f00d08c0 2024-04-26T21:15:56.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f4e00640 1 -- 172.21.15.112:0/1316835678 >> v1:172.21.15.106:6789/0 conn(0x7fa1f00d08c0 legacy=0x7fa1f00b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.196+0000 7fa1f4e00640 1 -- 172.21.15.112:0/1316835678 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f0075910 con 0x7fa1f00b04a0 2024-04-26T21:15:56.203 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:56.201+0000 7ff5a3632180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T21:15:56.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1f4e00640 1 --2- 172.21.15.112:0/1316835678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f00b04a0 0x7fa1f00b0e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0097f0 tx=0x7fa1dc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e98af2599e51c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1efe00640 1 -- 172.21.15.112:0/1316835678 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc0b0070 con 0x7fa1f00b04a0 2024-04-26T21:15:56.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1efe00640 1 -- 172.21.15.112:0/1316835678 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1dc0ab600 con 0x7fa1f00b04a0 2024-04-26T21:15:56.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1efe00640 1 -- 172.21.15.112:0/1316835678 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc0ab9d0 con 0x7fa1f00b04a0 2024-04-26T21:15:56.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1f6c00640 1 -- 172.21.15.112:0/1316835678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f00b04a0 msgr2=0x7fa1f00b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1f6c00640 1 --2- 172.21.15.112:0/1316835678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f00b04a0 0x7fa1f00b0e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0097f0 tx=0x7fa1dc01c410 comp rx=0 tx=0).stop 2024-04-26T21:15:56.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1f6c00640 1 -- 172.21.15.112:0/1316835678 shutdown_connections 2024-04-26T21:15:56.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1f6c00640 1 --2- 172.21.15.112:0/1316835678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f00b04a0 0x7fa1f00b0e10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1f6c00640 1 -- 172.21.15.112:0/1316835678 >> 172.21.15.112:0/1316835678 conn(0x7fa1f00b2d00 msgr2=0x7fa1f00b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1f6c00640 1 -- 172.21.15.112:0/1316835678 shutdown_connections 2024-04-26T21:15:56.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.200+0000 7fa1f6c00640 1 -- 172.21.15.112:0/1316835678 wait complete. 2024-04-26T21:15:56.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 Processor -- start 2024-04-26T21:15:56.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 -- start start 2024-04-26T21:15:56.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1f00b04a0 0x7fa1f0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f00ce1a0 0x7fa1f0156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f00d08c0 0x7fa1f006f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f006d270 con 0x7fa1f00ce1a0 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f006d0f0 con 0x7fa1f00d08c0 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f016cd20 con 0x7fa1f00b04a0 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f5800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1f00b04a0 0x7fa1f0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f5800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1f00b04a0 0x7fa1f0159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:40120/0 (socket says 172.21.15.112:40120) 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f5800640 1 -- 172.21.15.112:0/3143632110 learned_addr learned my addr 172.21.15.112:0/3143632110 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f00d08c0 0x7fa1f006f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f4e00640 1 --2- 172.21.15.112:0/3143632110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f00ce1a0 0x7fa1f0156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f5800640 1 -- 172.21.15.112:0/3143632110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f00d08c0 msgr2=0x7fa1f006f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f5800640 1 --2- 172.21.15.112:0/3143632110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f00d08c0 0x7fa1f006f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f5800640 1 -- 172.21.15.112:0/3143632110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f00ce1a0 msgr2=0x7fa1f0156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f5800640 1 --2- 172.21.15.112:0/3143632110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f00ce1a0 0x7fa1f0156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f5800640 1 -- 172.21.15.112:0/3143632110 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f009b370 con 0x7fa1f00b04a0 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f4e00640 1 --2- 172.21.15.112:0/3143632110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f00ce1a0 0x7fa1f0156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f5800640 1 --2- 172.21.15.112:0/3143632110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1f00b04a0 0x7fa1f0159d20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400c480 tx=0x7fa1e400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1ed600640 1 -- 172.21.15.112:0/3143632110 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4017070 con 0x7fa1f00b04a0 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1ed600640 1 -- 172.21.15.112:0/3143632110 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4005cf0 con 0x7fa1f00b04a0 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1ed600640 1 -- 172.21.15.112:0/3143632110 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4007290 con 0x7fa1f00b04a0 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 -- 172.21.15.112:0/3143632110 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f009b650 con 0x7fa1f00b04a0 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.204+0000 7fa1f6c00640 1 -- 172.21.15.112:0/3143632110 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f01574c0 con 0x7fa1f00b04a0 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.208+0000 7fa1ed600640 1 -- 172.21.15.112:0/3143632110 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa1e401a070 con 0x7fa1f00b04a0 2024-04-26T21:15:56.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.208+0000 7fa1ed600640 1 -- 172.21.15.112:0/3143632110 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fa1e40127b0 con 0x7fa1f00b04a0 2024-04-26T21:15:56.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.208+0000 7fa1f6c00640 1 -- 172.21.15.112:0/3143632110 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f00506d0 con 0x7fa1f00b04a0 2024-04-26T21:15:56.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.208+0000 7fa1ed600640 1 -- 172.21.15.112:0/3143632110 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa1e4021070 con 0x7fa1f00b04a0 2024-04-26T21:15:56.253 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:56.248+0000 7fcb3150b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T21:15:56.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.276+0000 7fa1f6c00640 1 -- 172.21.15.112:0/3143632110 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d5376c79-a72d-4e12-86c4-643ce6ae38e3", "id": 1} v 0) -- 0x7fa1f00afd70 con 0x7fa1f00b04a0 2024-04-26T21:15:56.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1ed600640 1 -- 172.21.15.112:0/3143632110 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5376c79-a72d-4e12-86c4-643ce6ae38e3", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fa1e40076b0 con 0x7fa1f00b04a0 2024-04-26T21:15:56.286 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-04-26T21:15:56.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1f6c00640 1 -- 172.21.15.112:0/3143632110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1f00b04a0 msgr2=0x7fa1f0159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1f6c00640 1 --2- 172.21.15.112:0/3143632110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1f00b04a0 0x7fa1f0159d20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400c480 tx=0x7fa1e400c940 comp rx=0 tx=0).stop 2024-04-26T21:15:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1f6c00640 1 -- 172.21.15.112:0/3143632110 shutdown_connections 2024-04-26T21:15:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1f6c00640 1 --2- 172.21.15.112:0/3143632110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1f00d08c0 0x7fa1f006f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1f6c00640 1 --2- 172.21.15.112:0/3143632110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f00ce1a0 0x7fa1f0156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1f6c00640 1 --2- 172.21.15.112:0/3143632110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1f00b04a0 0x7fa1f0159d20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1f6c00640 1 -- 172.21.15.112:0/3143632110 >> 172.21.15.112:0/3143632110 conn(0x7fa1f00b2d00 msgr2=0x7fa1f00af220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1f6c00640 1 -- 172.21.15.112:0/3143632110 shutdown_connections 2024-04-26T21:15:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.284+0000 7fa1f6c00640 1 -- 172.21.15.112:0/3143632110 wait complete. 2024-04-26T21:15:56.306 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 68db141c-79ad-4bc7-a259-803774f3197d 2 2024-04-26T21:15:56.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.436+0000 7fdf11c00640 1 Processor -- start 2024-04-26T21:15:56.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.436+0000 7fdf11c00640 1 -- start start 2024-04-26T21:15:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf11c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf0c162bf0 0x7fdf0c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf11c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf11c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0c06dc60 con 0x7fdf0c15e8c0 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf11c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0c06eaf0 con 0x7fdf0c162bf0 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf11c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c163510 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf0aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf0c162bf0 0x7fdf0c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf03e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf0aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf0c162bf0 0x7fdf0c06d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43200/0 (socket says 172.21.15.112:43200) 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf03e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c162fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:40136/0 (socket says 172.21.15.112:40136) 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf0aa00640 1 -- 172.21.15.112:0/3448092860 learned_addr learned my addr 172.21.15.112:0/3448092860 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf0aa00640 1 -- 172.21.15.112:0/3448092860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 msgr2=0x7fdf0c162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf0aa00640 1 --2- 172.21.15.112:0/3448092860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf0aa00640 1 -- 172.21.15.112:0/3448092860 >> v1:172.21.15.106:6789/0 conn(0x7fdf0c15e8c0 legacy=0x7fdf0c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf0aa00640 1 -- 172.21.15.112:0/3448092860 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c06dee0 con 0x7fdf0c162bf0 2024-04-26T21:15:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.440+0000 7fdf03e00640 1 --2- 172.21.15.112:0/3448092860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:15:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf0aa00640 1 --2- 172.21.15.112:0/3448092860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c162bf0 0x7fdf0c06d720 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009870 tx=0x7fdefc01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f80c9cfa27fd607c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf0a000640 1 -- 172.21.15.112:0/3448092860 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0a95f0 con 0x7fdf0c162bf0 2024-04-26T21:15:56.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf0a000640 1 -- 172.21.15.112:0/3448092860 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdefc0a9790 con 0x7fdf0c162bf0 2024-04-26T21:15:56.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf0a000640 1 -- 172.21.15.112:0/3448092860 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0a9b60 con 0x7fdf0c162bf0 2024-04-26T21:15:56.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 -- 172.21.15.112:0/3448092860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c162bf0 msgr2=0x7fdf0c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 --2- 172.21.15.112:0/3448092860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c162bf0 0x7fdf0c06d720 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009870 tx=0x7fdefc01c530 comp rx=0 tx=0).stop 2024-04-26T21:15:56.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 -- 172.21.15.112:0/3448092860 shutdown_connections 2024-04-26T21:15:56.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 --2- 172.21.15.112:0/3448092860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 --2- 172.21.15.112:0/3448092860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c162bf0 0x7fdf0c06d720 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 -- 172.21.15.112:0/3448092860 >> 172.21.15.112:0/3448092860 conn(0x7fdf0c0d2c50 msgr2=0x7fdf0c0d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 -- 172.21.15.112:0/3448092860 shutdown_connections 2024-04-26T21:15:56.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 -- 172.21.15.112:0/3448092860 wait complete. 2024-04-26T21:15:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 Processor -- start 2024-04-26T21:15:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.444+0000 7fdf11c00640 1 -- start start 2024-04-26T21:15:56.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf11c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c15f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf11c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c15e8c0 0x7fdf0c14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf11c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf0c162bf0 0x7fdf0c0cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf11c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c0d2230 con 0x7fdf0c162bf0 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf11c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c15f420 con 0x7fdf0c15e8c0 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf11c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c0d23b0 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf0aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf03e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c15e8c0 0x7fdf0c14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf03e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c15e8c0 0x7fdf0c14aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43204/0 (socket says 172.21.15.112:43204) 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf0aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c15f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:40142/0 (socket says 172.21.15.112:40142) 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf03e00640 1 -- 172.21.15.112:0/2516588061 learned_addr learned my addr 172.21.15.112:0/2516588061 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf0b400640 1 --2- 172.21.15.112:0/2516588061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf0c162bf0 0x7fdf0c0cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf0aa00640 1 -- 172.21.15.112:0/2516588061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c15e8c0 msgr2=0x7fdf0c14aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf0aa00640 1 --2- 172.21.15.112:0/2516588061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c15e8c0 0x7fdf0c14aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf0aa00640 1 -- 172.21.15.112:0/2516588061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf0c162bf0 msgr2=0x7fdf0c0cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf0aa00640 1 --2- 172.21.15.112:0/2516588061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf0c162bf0 0x7fdf0c0cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf0aa00640 1 -- 172.21.15.112:0/2516588061 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c15fc10 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf03e00640 1 --2- 172.21.15.112:0/2516588061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c15e8c0 0x7fdf0c14aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf0aa00640 1 --2- 172.21.15.112:0/2516588061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c15f630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0aa000 tx=0x7fdefc01ad70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf02a00640 1 -- 172.21.15.112:0/2516588061 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0b1800 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf02a00640 1 -- 172.21.15.112:0/2516588061 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdefc0b19c0 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf11c00640 1 -- 172.21.15.112:0/2516588061 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0c15fef0 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf02a00640 1 -- 172.21.15.112:0/2516588061 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0b1db0 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf11c00640 1 -- 172.21.15.112:0/2516588061 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0c1604b0 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf02a00640 1 -- 172.21.15.112:0/2516588061 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdefc0bc7e0 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf02a00640 1 -- 172.21.15.112:0/2516588061 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fdefc0a9630 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.448+0000 7fdf11c00640 1 -- 172.21.15.112:0/2516588061 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf0c069400 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.452+0000 7fdf02a00640 1 -- 172.21.15.112:0/2516588061 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fdefc0ad020 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.516+0000 7fdf11c00640 1 -- 172.21.15.112:0/2516588061 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "68db141c-79ad-4bc7-a259-803774f3197d", "id": 2} v 0) -- 0x7fdf0c15b960 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf02a00640 1 -- 172.21.15.112:0/2516588061 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "68db141c-79ad-4bc7-a259-803774f3197d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fdefc016150 con 0x7fdf0c0d1e50 2024-04-26T21:15:56.526 INFO:teuthology.orchestra.run.smithi112.stdout:2 2024-04-26T21:15:56.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf11c00640 1 -- 172.21.15.112:0/2516588061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 msgr2=0x7fdf0c15f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf11c00640 1 --2- 172.21.15.112:0/2516588061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c15f630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0aa000 tx=0x7fdefc01ad70 comp rx=0 tx=0).stop 2024-04-26T21:15:56.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf11c00640 1 -- 172.21.15.112:0/2516588061 shutdown_connections 2024-04-26T21:15:56.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf11c00640 1 --2- 172.21.15.112:0/2516588061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0c15e8c0 0x7fdf0c14aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf11c00640 1 --2- 172.21.15.112:0/2516588061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf0c162bf0 0x7fdf0c0cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf11c00640 1 --2- 172.21.15.112:0/2516588061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdf0c0d1e50 0x7fdf0c15f630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf11c00640 1 -- 172.21.15.112:0/2516588061 >> 172.21.15.112:0/2516588061 conn(0x7fdf0c0d2c50 msgr2=0x7fdf0c15ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf11c00640 1 -- 172.21.15.112:0/2516588061 shutdown_connections 2024-04-26T21:15:56.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.524+0000 7fdf11c00640 1 -- 172.21.15.112:0/2516588061 wait complete. 2024-04-26T21:15:56.545 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new d6259c38-3360-46fe-9ce2-150a5547d7b6 3 2024-04-26T21:15:56.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6613200640 1 Processor -- start 2024-04-26T21:15:56.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6613200640 1 -- start start 2024-04-26T21:15:56.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6613200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f660c162bf0 0x7f660c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6613200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f660c0d1e50 0x7f660c162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6613200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f660c06dc60 con 0x7f660c15e8c0 2024-04-26T21:15:56.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6613200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f660c06eaf0 con 0x7f660c0d1e50 2024-04-26T21:15:56.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6613200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f660c163510 con 0x7f660c162bf0 2024-04-26T21:15:56.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f660be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f660c162bf0 0x7f660c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6611200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f660c15e8c0 0x7f660c15ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44112/0 (socket says 172.21.15.112:44112) 2024-04-26T21:15:56.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6611200640 1 -- 172.21.15.112:0/1437762127 learned_addr learned my addr 172.21.15.112:0/1437762127 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-26T21:15:56.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f6603e00640 1 --2- 172.21.15.112:0/1437762127 >> v2:172.21.15.106:3300/0 conn(0x7f660c0d1e50 0x7f660c162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f660be00640 1 -- 172.21.15.112:0/1437762127 >> v2:172.21.15.106:3300/0 conn(0x7f660c0d1e50 msgr2=0x7f660c162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:15:56.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f660be00640 1 --2- 172.21.15.112:0/1437762127 >> v2:172.21.15.106:3300/0 conn(0x7f660c0d1e50 0x7f660c162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f660be00640 1 -- 172.21.15.112:0/1437762127 >> v1:172.21.15.112:6789/0 conn(0x7f660c15e8c0 legacy=0x7f660c15ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f660be00640 1 -- 172.21.15.112:0/1437762127 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c06dee0 con 0x7f660c162bf0 2024-04-26T21:15:56.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.676+0000 7f660b400640 1 -- 172.21.15.112:0/1437762127 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 613202859 0 0) 0x7f66040014a0 con 0x7f660c15e8c0 2024-04-26T21:15:56.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f660be00640 1 --2- 172.21.15.112:0/1437762127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c162bf0 0x7f660c06d720 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f660c073310 tx=0x7f65fc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8279dbcf12b6c837 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f660b400640 1 -- 172.21.15.112:0/1437762127 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0ab650 con 0x7f660c162bf0 2024-04-26T21:15:56.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f660b400640 1 -- 172.21.15.112:0/1437762127 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65fc0b0070 con 0x7f660c162bf0 2024-04-26T21:15:56.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f660b400640 1 -- 172.21.15.112:0/1437762127 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0aba10 con 0x7f660c162bf0 2024-04-26T21:15:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f6613200640 1 -- 172.21.15.112:0/1437762127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c162bf0 msgr2=0x7f660c06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f6613200640 1 --2- 172.21.15.112:0/1437762127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c162bf0 0x7f660c06d720 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f660c073310 tx=0x7f65fc01c450 comp rx=0 tx=0).stop 2024-04-26T21:15:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f6613200640 1 -- 172.21.15.112:0/1437762127 shutdown_connections 2024-04-26T21:15:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f6613200640 1 --2- 172.21.15.112:0/1437762127 >> v2:172.21.15.106:3300/0 conn(0x7f660c0d1e50 0x7f660c162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f6613200640 1 --2- 172.21.15.112:0/1437762127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c162bf0 0x7f660c06d720 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f6613200640 1 -- 172.21.15.112:0/1437762127 >> 172.21.15.112:0/1437762127 conn(0x7f660c0d2c50 msgr2=0x7f660c0d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f6613200640 1 -- 172.21.15.112:0/1437762127 shutdown_connections 2024-04-26T21:15:56.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.680+0000 7f6613200640 1 -- 172.21.15.112:0/1437762127 wait complete. 2024-04-26T21:15:56.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 Processor -- start 2024-04-26T21:15:56.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 -- start start 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c0d1e50 0x7f660c15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f660c15e8c0 0x7f660c0c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f660c162bf0 0x7f660c0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f660c0d2260 con 0x7f660c162bf0 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f660c15f3e0 con 0x7f660c0d1e50 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f660c0d23e0 con 0x7f660c15e8c0 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f660be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c0d1e50 0x7f660c15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6603e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f660c15e8c0 0x7f660c0c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f660be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c0d1e50 0x7f660c15aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43218/0 (socket says 172.21.15.112:43218) 2024-04-26T21:15:56.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f660be00640 1 -- 172.21.15.112:0/4032053993 learned_addr learned my addr 172.21.15.112:0/4032053993 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6611200640 1 --2- 172.21.15.112:0/4032053993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f660c162bf0 0x7f660c0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f660be00640 1 -- 172.21.15.112:0/4032053993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f660c15e8c0 msgr2=0x7f660c0c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f660be00640 1 --2- 172.21.15.112:0/4032053993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f660c15e8c0 0x7f660c0c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f660be00640 1 -- 172.21.15.112:0/4032053993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f660c162bf0 msgr2=0x7f660c0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f660be00640 1 --2- 172.21.15.112:0/4032053993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f660c162bf0 0x7f660c0cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f660be00640 1 -- 172.21.15.112:0/4032053993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c15b3e0 con 0x7f660c0d1e50 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f660be00640 1 --2- 172.21.15.112:0/4032053993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c0d1e50 0x7f660c15aea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f65fc019060 tx=0x7f65fc01ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6608c00640 1 -- 172.21.15.112:0/4032053993 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0bf610 con 0x7f660c0d1e50 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6608c00640 1 -- 172.21.15.112:0/4032053993 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65fc0bf7d0 con 0x7f660c0d1e50 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6608c00640 1 -- 172.21.15.112:0/4032053993 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0bfbc0 con 0x7f660c0d1e50 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 -- 172.21.15.112:0/4032053993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660c0c7c40 con 0x7f660c0d1e50 2024-04-26T21:15:56.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6613200640 1 -- 172.21.15.112:0/4032053993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660c0c8200 con 0x7f660c0d1e50 2024-04-26T21:15:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6608c00640 1 -- 172.21.15.112:0/4032053993 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f65fc0bd020 con 0x7f660c0d1e50 2024-04-26T21:15:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.684+0000 7f6608c00640 1 -- 172.21.15.112:0/4032053993 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f65fc0b5c20 con 0x7f660c0d1e50 2024-04-26T21:15:56.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.688+0000 7f6613200640 1 -- 172.21.15.112:0/4032053993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660c069400 con 0x7f660c0d1e50 2024-04-26T21:15:56.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.688+0000 7f6608c00640 1 -- 172.21.15.112:0/4032053993 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f65fc016070 con 0x7f660c0d1e50 2024-04-26T21:15:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.756+0000 7f6613200640 1 -- 172.21.15.112:0/4032053993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6259c38-3360-46fe-9ce2-150a5547d7b6", "id": 3} v 0) -- 0x7f660c0b44b0 con 0x7f660c0d1e50 2024-04-26T21:15:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6608c00640 1 -- 172.21.15.112:0/4032053993 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6259c38-3360-46fe-9ce2-150a5547d7b6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f65fc0b5790 con 0x7f660c0d1e50 2024-04-26T21:15:56.763 INFO:teuthology.orchestra.run.smithi112.stdout:3 2024-04-26T21:15:56.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6613200640 1 -- 172.21.15.112:0/4032053993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c0d1e50 msgr2=0x7f660c15aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6613200640 1 --2- 172.21.15.112:0/4032053993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c0d1e50 0x7f660c15aea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f65fc019060 tx=0x7f65fc01ac90 comp rx=0 tx=0).stop 2024-04-26T21:15:56.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6613200640 1 -- 172.21.15.112:0/4032053993 shutdown_connections 2024-04-26T21:15:56.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6613200640 1 --2- 172.21.15.112:0/4032053993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f660c162bf0 0x7f660c0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6613200640 1 --2- 172.21.15.112:0/4032053993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f660c15e8c0 0x7f660c0c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6613200640 1 --2- 172.21.15.112:0/4032053993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f660c0d1e50 0x7f660c15aea0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6613200640 1 -- 172.21.15.112:0/4032053993 >> 172.21.15.112:0/4032053993 conn(0x7f660c0d2c50 msgr2=0x7f660c0716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6613200640 1 -- 172.21.15.112:0/4032053993 shutdown_connections 2024-04-26T21:15:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.760+0000 7f6613200640 1 -- 172.21.15.112:0/4032053993 wait complete. 2024-04-26T21:15:56.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new e70f89d8-c8c2-4138-bd5b-104118bedc18 4 2024-04-26T21:15:56.822 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:56.821+0000 7ff5a3632180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T21:15:56.884 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:56.885+0000 7ff5a3632180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T21:15:56.894 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:56.892+0000 7fcb3150b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T21:15:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.912+0000 7efff0200640 1 Processor -- start 2024-04-26T21:15:56.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.912+0000 7efff0200640 1 -- start start 2024-04-26T21:15:56.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7efff0200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7efff0200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe806dee0 con 0x7effe80d1e50 2024-04-26T21:15:56.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7efff0200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe806e1c0 con 0x7effe8162bf0 2024-04-26T21:15:56.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7efff0200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7effe806eaf0 con 0x7effe80ce590 2024-04-26T21:15:56.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effed800640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7effe8162bf0 0x7effe806d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44116/0 (socket says 172.21.15.112:44116) 2024-04-26T21:15:56.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effed800640 1 -- 172.21.15.112:0/2248059017 learned_addr learned my addr 172.21.15.112:0/2248059017 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-26T21:15:56.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effee200640 1 --2- 172.21.15.112:0/2248059017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effe7e00640 1 -- 172.21.15.112:0/2248059017 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616816003 0 0) 0x7effe806e1c0 con 0x7effe8162bf0 2024-04-26T21:15:56.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effe7e00640 1 -- 172.21.15.112:0/2248059017 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd0003530 con 0x7effe8162bf0 2024-04-26T21:15:56.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effe7e00640 1 -- 172.21.15.112:0/2248059017 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65225153 0 0) 0x7effe806dee0 con 0x7effe80d1e50 2024-04-26T21:15:56.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effe7e00640 1 -- 172.21.15.112:0/2248059017 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effe806e1c0 con 0x7effe80d1e50 2024-04-26T21:15:56.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effee200640 1 -- 172.21.15.112:0/2248059017 >> v1:172.21.15.112:6789/0 conn(0x7effe8162bf0 legacy=0x7effe806d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effee200640 1 -- 172.21.15.112:0/2248059017 >> v1:172.21.15.106:6789/0 conn(0x7effe80d1e50 legacy=0x7effe8162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.916+0000 7effee200640 1 -- 172.21.15.112:0/2248059017 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe806e4a0 con 0x7effe80ce590 2024-04-26T21:15:56.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7effee200640 1 --2- 172.21.15.112:0/2248059017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815e8c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7effe0009dc0 tx=0x7effe001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1326d711e948b680 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7effe7e00640 1 -- 172.21.15.112:0/2248059017 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe00b2070 con 0x7effe80ce590 2024-04-26T21:15:56.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7effe7e00640 1 -- 172.21.15.112:0/2248059017 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe00a59c0 con 0x7effe80ce590 2024-04-26T21:15:56.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7effe7e00640 1 -- 172.21.15.112:0/2248059017 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe00a5d90 con 0x7effe80ce590 2024-04-26T21:15:56.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 -- 172.21.15.112:0/2248059017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 msgr2=0x7effe815e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 --2- 172.21.15.112:0/2248059017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815e8c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7effe0009dc0 tx=0x7effe001c960 comp rx=0 tx=0).stop 2024-04-26T21:15:56.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 -- 172.21.15.112:0/2248059017 shutdown_connections 2024-04-26T21:15:56.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 --2- 172.21.15.112:0/2248059017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815e8c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 -- 172.21.15.112:0/2248059017 >> 172.21.15.112:0/2248059017 conn(0x7effe80d2c50 msgr2=0x7effe80d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:56.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 -- 172.21.15.112:0/2248059017 shutdown_connections 2024-04-26T21:15:56.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 -- 172.21.15.112:0/2248059017 wait complete. 2024-04-26T21:15:56.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 Processor -- start 2024-04-26T21:15:56.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 -- start start 2024-04-26T21:15:56.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effe80d1e50 0x7effe80b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effe8162bf0 0x7effe8156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7effe816cb00 con 0x7effe80d1e50 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7effe816c980 con 0x7effe8162bf0 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.920+0000 7efff0200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7effe816cc80 con 0x7effe80ce590 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effed800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effee200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effe8162bf0 0x7effe8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effed800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:40182/0 (socket says 172.21.15.112:40182) 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effee200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effe8162bf0 0x7effe8156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43234/0 (socket says 172.21.15.112:43234) 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effece00640 1 --2- 172.21.15.112:0/639266076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effe80d1e50 0x7effe80b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effed800640 1 -- 172.21.15.112:0/639266076 learned_addr learned my addr 172.21.15.112:0/639266076 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effed800640 1 -- 172.21.15.112:0/639266076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effe8162bf0 msgr2=0x7effe8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effed800640 1 --2- 172.21.15.112:0/639266076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effe8162bf0 0x7effe8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effed800640 1 -- 172.21.15.112:0/639266076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effe80d1e50 msgr2=0x7effe80b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:56.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effed800640 1 --2- 172.21.15.112:0/639266076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effe80d1e50 0x7effe80b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:56.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effed800640 1 -- 172.21.15.112:0/639266076 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe8157e00 con 0x7effe80ce590 2024-04-26T21:15:56.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effece00640 1 --2- 172.21.15.112:0/639266076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effe80d1e50 0x7effe80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:15:56.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effed800640 1 --2- 172.21.15.112:0/639266076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815f690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c420 tx=0x7effdc00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:56.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effe5600640 1 -- 172.21.15.112:0/639266076 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc017070 con 0x7effe80ce590 2024-04-26T21:15:56.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effe5600640 1 -- 172.21.15.112:0/639266076 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effdc005cf0 con 0x7effe80ce590 2024-04-26T21:15:56.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effe5600640 1 -- 172.21.15.112:0/639266076 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc0072d0 con 0x7effe80ce590 2024-04-26T21:15:56.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7efff0200640 1 -- 172.21.15.112:0/639266076 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe8155d40 con 0x7effe80ce590 2024-04-26T21:15:56.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7efff0200640 1 -- 172.21.15.112:0/639266076 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7effe8157b20 con 0x7effe80ce590 2024-04-26T21:15:56.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effe5600640 1 -- 172.21.15.112:0/639266076 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7effdc01a070 con 0x7effe80ce590 2024-04-26T21:15:56.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7effe5600640 1 -- 172.21.15.112:0/639266076 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7effdc01cc60 con 0x7effe80ce590 2024-04-26T21:15:56.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.924+0000 7efff0200640 1 -- 172.21.15.112:0/639266076 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe8069400 con 0x7effe80ce590 2024-04-26T21:15:56.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.928+0000 7effe5600640 1 -- 172.21.15.112:0/639266076 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7effdc007470 con 0x7effe80ce590 2024-04-26T21:15:56.946 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:56.945+0000 7ff5a3632180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T21:15:56.960 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:56.956+0000 7fcb3150b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T21:15:56.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:56.996+0000 7efff0200640 1 -- 172.21.15.112:0/639266076 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e70f89d8-c8c2-4138-bd5b-104118bedc18", "id": 4} v 0) -- 0x7effe806cc70 con 0x7effe80ce590 2024-04-26T21:15:57.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7effe5600640 1 -- 172.21.15.112:0/639266076 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e70f89d8-c8c2-4138-bd5b-104118bedc18", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7effdc007650 con 0x7effe80ce590 2024-04-26T21:15:57.002 INFO:teuthology.orchestra.run.smithi112.stdout:4 2024-04-26T21:15:57.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7efff0200640 1 -- 172.21.15.112:0/639266076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 msgr2=0x7effe815f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7efff0200640 1 --2- 172.21.15.112:0/639266076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815f690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c420 tx=0x7effdc00c8e0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7efff0200640 1 -- 172.21.15.112:0/639266076 shutdown_connections 2024-04-26T21:15:57.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7efff0200640 1 --2- 172.21.15.112:0/639266076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effe8162bf0 0x7effe8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7efff0200640 1 --2- 172.21.15.112:0/639266076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effe80d1e50 0x7effe80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7efff0200640 1 --2- 172.21.15.112:0/639266076 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effe80ce590 0x7effe815f690 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7efff0200640 1 -- 172.21.15.112:0/639266076 >> 172.21.15.112:0/639266076 conn(0x7effe80d2c50 msgr2=0x7effe80714a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:57.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7efff0200640 1 -- 172.21.15.112:0/639266076 shutdown_connections 2024-04-26T21:15:57.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.000+0000 7efff0200640 1 -- 172.21.15.112:0/639266076 wait complete. 2024-04-26T21:15:57.021 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 89ea2c27-08e1-4f52-acd4-72d25a625acb 5 2024-04-26T21:15:57.025 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:57.020+0000 7fcb3150b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T21:15:57.035 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:57.033+0000 7ff5a3632180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T21:15:57.094 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:57.093+0000 7ff5a3632180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T21:15:57.114 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:57.112+0000 7fcb3150b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T21:15:57.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0affe00640 1 Processor -- start 2024-04-26T21:15:57.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0affe00640 1 -- start start 2024-04-26T21:15:57.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0affe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af8162bf0 0x7f0af806d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0affe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0af815e8c0 0x7f0af815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0affe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af806dc60 con 0x7f0af80d1e50 2024-04-26T21:15:57.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0affe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f0af806eaf0 con 0x7f0af815e8c0 2024-04-26T21:15:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0affe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0af806dee0 con 0x7f0af8162bf0 2024-04-26T21:15:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0afca00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0af80d1e50 0x7f0af8162fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44120/0 (socket says 172.21.15.112:44120) 2024-04-26T21:15:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0afca00640 1 -- 172.21.15.112:0/3060566580 learned_addr learned my addr 172.21.15.112:0/3060566580 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-26T21:15:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.152+0000 7f0afd400640 1 --2- 172.21.15.112:0/3060566580 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af8162bf0 0x7f0af806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0afde00640 1 --2- 172.21.15.112:0/3060566580 >> v2:172.21.15.106:3300/0 conn(0x7f0af815e8c0 0x7f0af815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0af7e00640 1 -- 172.21.15.112:0/3060566580 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646748022 0 0) 0x7f0ae4001120 con 0x7f0af80d1e50 2024-04-26T21:15:57.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0af7e00640 1 -- 172.21.15.112:0/3060566580 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae0003530 con 0x7f0af80d1e50 2024-04-26T21:15:57.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0afd400640 1 -- 172.21.15.112:0/3060566580 >> v2:172.21.15.106:3300/0 conn(0x7f0af815e8c0 msgr2=0x7f0af815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:15:57.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0afd400640 1 --2- 172.21.15.112:0/3060566580 >> v2:172.21.15.106:3300/0 conn(0x7f0af815e8c0 0x7f0af815ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0afd400640 1 -- 172.21.15.112:0/3060566580 >> v1:172.21.15.112:6789/0 conn(0x7f0af80d1e50 legacy=0x7f0af8162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0afd400640 1 -- 172.21.15.112:0/3060566580 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af806e1c0 con 0x7f0af8162bf0 2024-04-26T21:15:57.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0afd400640 1 --2- 172.21.15.112:0/3060566580 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af8162bf0 0x7f0af806d720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf40db80f91547a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:57.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0af7e00640 1 -- 172.21.15.112:0/3060566580 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0a7070 con 0x7f0af8162bf0 2024-04-26T21:15:57.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0af7e00640 1 -- 172.21.15.112:0/3060566580 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aec0b0070 con 0x7f0af8162bf0 2024-04-26T21:15:57.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.156+0000 7f0af7e00640 1 -- 172.21.15.112:0/3060566580 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0ab870 con 0x7f0af8162bf0 2024-04-26T21:15:57.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 -- 172.21.15.112:0/3060566580 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af8162bf0 msgr2=0x7f0af806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 --2- 172.21.15.112:0/3060566580 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af8162bf0 0x7f0af806d720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01c470 comp rx=0 tx=0).stop 2024-04-26T21:15:57.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 -- 172.21.15.112:0/3060566580 shutdown_connections 2024-04-26T21:15:57.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 --2- 172.21.15.112:0/3060566580 >> v2:172.21.15.106:3300/0 conn(0x7f0af815e8c0 0x7f0af815ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 --2- 172.21.15.112:0/3060566580 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af8162bf0 0x7f0af806d720 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 -- 172.21.15.112:0/3060566580 >> 172.21.15.112:0/3060566580 conn(0x7f0af80d2c50 msgr2=0x7f0af80d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:57.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 -- 172.21.15.112:0/3060566580 shutdown_connections 2024-04-26T21:15:57.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 -- 172.21.15.112:0/3060566580 wait complete. 2024-04-26T21:15:57.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 Processor -- start 2024-04-26T21:15:57.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 -- start start 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af80d1e50 0x7f0af81514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0af815e8c0 0x7f0af8152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0af8162bf0 0x7f0af81586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0af815f3f0 con 0x7f0af815e8c0 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0af815f270 con 0x7f0af8162bf0 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0affe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0af80cdd90 con 0x7f0af80d1e50 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afde00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0af8162bf0 0x7f0af81586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afd400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af80d1e50 0x7f0af81514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afde00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0af8162bf0 0x7f0af81586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43242/0 (socket says 172.21.15.112:43242) 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afde00640 1 -- 172.21.15.112:0/3250076864 learned_addr learned my addr 172.21.15.112:0/3250076864 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:57.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afca00640 1 --2- 172.21.15.112:0/3250076864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0af815e8c0 0x7f0af8152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afde00640 1 -- 172.21.15.112:0/3250076864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af80d1e50 msgr2=0x7f0af81514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afde00640 1 --2- 172.21.15.112:0/3250076864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af80d1e50 0x7f0af81514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afde00640 1 -- 172.21.15.112:0/3250076864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0af815e8c0 msgr2=0x7f0af8152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afde00640 1 --2- 172.21.15.112:0/3250076864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0af815e8c0 0x7f0af8152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afde00640 1 -- 172.21.15.112:0/3250076864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af80afcf0 con 0x7f0af8162bf0 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.160+0000 7f0afd400640 1 --2- 172.21.15.112:0/3250076864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af80d1e50 0x7f0af81514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0afde00640 1 --2- 172.21.15.112:0/3250076864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0af8162bf0 0x7f0af81586d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009dd0 tx=0x7f0af000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0af5600640 1 -- 172.21.15.112:0/3250076864 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0018020 con 0x7f0af8162bf0 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0af5600640 1 -- 172.21.15.112:0/3250076864 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af0014480 con 0x7f0af8162bf0 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0af5600640 1 -- 172.21.15.112:0/3250076864 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0014870 con 0x7f0af8162bf0 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0affe00640 1 -- 172.21.15.112:0/3250076864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af80affd0 con 0x7f0af8162bf0 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0affe00640 1 -- 172.21.15.112:0/3250076864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af80b0590 con 0x7f0af8162bf0 2024-04-26T21:15:57.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0af5600640 1 -- 172.21.15.112:0/3250076864 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0af001b020 con 0x7f0af8162bf0 2024-04-26T21:15:57.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0af5600640 1 -- 172.21.15.112:0/3250076864 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0af0014da0 con 0x7f0af8162bf0 2024-04-26T21:15:57.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0affe00640 1 -- 172.21.15.112:0/3250076864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af8069400 con 0x7f0af8162bf0 2024-04-26T21:15:57.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.164+0000 7f0af5600640 1 -- 172.21.15.112:0/3250076864 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0af0022070 con 0x7f0af8162bf0 2024-04-26T21:15:57.178 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:57.176+0000 7fcb3150b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T21:15:57.182 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:57.181+0000 7ff5a3632180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T21:15:57.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.232+0000 7f0affe00640 1 -- 172.21.15.112:0/3250076864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "89ea2c27-08e1-4f52-acd4-72d25a625acb", "id": 5} v 0) -- 0x7f0af80cf9b0 con 0x7f0af8162bf0 2024-04-26T21:15:57.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0af5600640 1 -- 172.21.15.112:0/3250076864 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89ea2c27-08e1-4f52-acd4-72d25a625acb", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0af0010040 con 0x7f0af8162bf0 2024-04-26T21:15:57.240 INFO:teuthology.orchestra.run.smithi112.stdout:5 2024-04-26T21:15:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0affe00640 1 -- 172.21.15.112:0/3250076864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0af8162bf0 msgr2=0x7f0af81586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0affe00640 1 --2- 172.21.15.112:0/3250076864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0af8162bf0 0x7f0af81586d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009dd0 tx=0x7f0af000c490 comp rx=0 tx=0).stop 2024-04-26T21:15:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0affe00640 1 -- 172.21.15.112:0/3250076864 shutdown_connections 2024-04-26T21:15:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0affe00640 1 --2- 172.21.15.112:0/3250076864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0af8162bf0 0x7f0af81586d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0affe00640 1 --2- 172.21.15.112:0/3250076864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0af815e8c0 0x7f0af8152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0affe00640 1 --2- 172.21.15.112:0/3250076864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0af80d1e50 0x7f0af81514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0affe00640 1 -- 172.21.15.112:0/3250076864 >> 172.21.15.112:0/3250076864 conn(0x7f0af80d2c50 msgr2=0x7f0af80b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0affe00640 1 -- 172.21.15.112:0/3250076864 shutdown_connections 2024-04-26T21:15:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.236+0000 7f0affe00640 1 -- 172.21.15.112:0/3250076864 wait complete. 2024-04-26T21:15:57.245 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:57.245+0000 7ff5a3632180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T21:15:57.258 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new c13e8b3d-a247-43b7-b6cc-14bff507589a 6 2024-04-26T21:15:57.271 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:57.268+0000 7fcb3150b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T21:15:57.336 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:57.332+0000 7fcb3150b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T21:15:57.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f381a000640 1 Processor -- start 2024-04-26T21:15:57.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f381a000640 1 -- start start 2024-04-26T21:15:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f381a000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3814073a90 0x7f38140ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f381a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f381415f440 0x7f3814073e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f381a000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3814075ae0 con 0x7f38140cd980 2024-04-26T21:15:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f381a000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f38140d1ee0 con 0x7f3814073a90 2024-04-26T21:15:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f381a000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3814075e10 con 0x7f381415f440 2024-04-26T21:15:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f380be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f381415f440 0x7f3814073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f3813e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f38140cd980 0x7f38140cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44122/0 (socket says 172.21.15.112:44122) 2024-04-26T21:15:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f3813e00640 1 -- 172.21.15.112:0/1092118064 learned_addr learned my addr 172.21.15.112:0/1092118064 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-04-26T21:15:57.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f3813400640 1 --2- 172.21.15.112:0/1092118064 >> v2:172.21.15.112:3300/0 conn(0x7f3814073a90 0x7f38140ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f380be00640 1 -- 172.21.15.112:0/1092118064 >> v2:172.21.15.112:3300/0 conn(0x7f3814073a90 msgr2=0x7f38140ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:15:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f380be00640 1 --2- 172.21.15.112:0/1092118064 >> v2:172.21.15.112:3300/0 conn(0x7f3814073a90 0x7f38140ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f380be00640 1 -- 172.21.15.112:0/1092118064 >> v1:172.21.15.112:6789/0 conn(0x7f38140cd980 legacy=0x7f38140cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.392+0000 7f380be00640 1 -- 172.21.15.112:0/1092118064 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38140743b0 con 0x7f381415f440 2024-04-26T21:15:57.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f380be00640 1 --2- 172.21.15.112:0/1092118064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f381415f440 0x7f3814073e70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38140d2060 tx=0x7f37fc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e6c417130dd676 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:57.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f3812a00640 1 -- 172.21.15.112:0/1092118064 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc0b1070 con 0x7f381415f440 2024-04-26T21:15:57.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f3812a00640 1 -- 172.21.15.112:0/1092118064 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37fc0a8050 con 0x7f381415f440 2024-04-26T21:15:57.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f3812a00640 1 -- 172.21.15.112:0/1092118064 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc0ac860 con 0x7f381415f440 2024-04-26T21:15:57.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f381a000640 1 -- 172.21.15.112:0/1092118064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f381415f440 msgr2=0x7f3814073e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f381a000640 1 --2- 172.21.15.112:0/1092118064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f381415f440 0x7f3814073e70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38140d2060 tx=0x7f37fc01c3c0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f381a000640 1 -- 172.21.15.112:0/1092118064 shutdown_connections 2024-04-26T21:15:57.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f381a000640 1 --2- 172.21.15.112:0/1092118064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f381415f440 0x7f3814073e70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f381a000640 1 --2- 172.21.15.112:0/1092118064 >> v2:172.21.15.112:3300/0 conn(0x7f3814073a90 0x7f38140ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f381a000640 1 -- 172.21.15.112:0/1092118064 >> 172.21.15.112:0/1092118064 conn(0x7f38140d13c0 msgr2=0x7f38140d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f381a000640 1 -- 172.21.15.112:0/1092118064 shutdown_connections 2024-04-26T21:15:57.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.396+0000 7f381a000640 1 -- 172.21.15.112:0/1092118064 wait complete. 2024-04-26T21:15:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 Processor -- start 2024-04-26T21:15:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 -- start start 2024-04-26T21:15:57.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3814073a90 0x7f3814158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38140cd980 0x7f38140b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f381415f440 0x7f38140b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f38140d1080 con 0x7f381415f440 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38140748f0 con 0x7f3814073a90 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f38140b5290 con 0x7f38140cd980 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3814073a90 0x7f3814158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f380be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38140cd980 0x7f38140b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3814073a90 0x7f3814158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43260/0 (socket says 172.21.15.112:43260) 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813400640 1 -- 172.21.15.112:0/97198138 learned_addr learned my addr 172.21.15.112:0/97198138 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813e00640 1 --2- 172.21.15.112:0/97198138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f381415f440 0x7f38140b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813400640 1 -- 172.21.15.112:0/97198138 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38140cd980 msgr2=0x7f38140b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813400640 1 --2- 172.21.15.112:0/97198138 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38140cd980 0x7f38140b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813400640 1 -- 172.21.15.112:0/97198138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f381415f440 msgr2=0x7f38140b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813400640 1 --2- 172.21.15.112:0/97198138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f381415f440 0x7f38140b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813400640 1 -- 172.21.15.112:0/97198138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38140b4cd0 con 0x7f3814073a90 2024-04-26T21:15:57.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f3813400640 1 --2- 172.21.15.112:0/97198138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3814073a90 0x7f3814158f90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f380400e8a0 tx=0x7f380400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:57.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f380b400640 1 -- 172.21.15.112:0/97198138 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804017070 con 0x7f3814073a90 2024-04-26T21:15:57.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f380b400640 1 -- 172.21.15.112:0/97198138 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380400c940 con 0x7f3814073a90 2024-04-26T21:15:57.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f380b400640 1 -- 172.21.15.112:0/97198138 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380400ccf0 con 0x7f3814073a90 2024-04-26T21:15:57.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 -- 172.21.15.112:0/97198138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38140b4fb0 con 0x7f3814073a90 2024-04-26T21:15:57.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 -- 172.21.15.112:0/97198138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3814156520 con 0x7f3814073a90 2024-04-26T21:15:57.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f380b400640 1 -- 172.21.15.112:0/97198138 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f380401a070 con 0x7f3814073a90 2024-04-26T21:15:57.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f380b400640 1 -- 172.21.15.112:0/97198138 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f38040059a0 con 0x7f3814073a90 2024-04-26T21:15:57.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.400+0000 7f381a000640 1 -- 172.21.15.112:0/97198138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3814069b10 con 0x7f3814073a90 2024-04-26T21:15:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.404+0000 7f380b400640 1 -- 172.21.15.112:0/97198138 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3804005c70 con 0x7f3814073a90 2024-04-26T21:15:57.410 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:57.409+0000 7ff5a3632180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T21:15:57.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.472+0000 7f381a000640 1 -- 172.21.15.112:0/97198138 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c13e8b3d-a247-43b7-b6cc-14bff507589a", "id": 6} v 0) -- 0x7f38140af280 con 0x7f3814073a90 2024-04-26T21:15:57.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.476+0000 7f380b400640 1 -- 172.21.15.112:0/97198138 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c13e8b3d-a247-43b7-b6cc-14bff507589a", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3804005e50 con 0x7f3814073a90 2024-04-26T21:15:57.481 INFO:teuthology.orchestra.run.smithi112.stdout:6 2024-04-26T21:15:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.480+0000 7f381a000640 1 -- 172.21.15.112:0/97198138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3814073a90 msgr2=0x7f3814158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.480+0000 7f381a000640 1 --2- 172.21.15.112:0/97198138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3814073a90 0x7f3814158f90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f380400e8a0 tx=0x7f380400eca0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.480+0000 7f381a000640 1 -- 172.21.15.112:0/97198138 shutdown_connections 2024-04-26T21:15:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.480+0000 7f381a000640 1 --2- 172.21.15.112:0/97198138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f381415f440 0x7f38140b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.480+0000 7f381a000640 1 --2- 172.21.15.112:0/97198138 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38140cd980 0x7f38140b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.480+0000 7f381a000640 1 --2- 172.21.15.112:0/97198138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3814073a90 0x7f3814158f90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.480+0000 7f381a000640 1 -- 172.21.15.112:0/97198138 >> 172.21.15.112:0/97198138 conn(0x7f38140d13c0 msgr2=0x7f38140aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:57.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.480+0000 7f381a000640 1 -- 172.21.15.112:0/97198138 shutdown_connections 2024-04-26T21:15:57.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.480+0000 7f381a000640 1 -- 172.21.15.112:0/97198138 wait complete. 2024-04-26T21:15:57.483 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:57.481+0000 7ff5a3632180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T21:15:57.499 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new e5167609-1c53-43f5-95c7-ffbcb284ce9c 7 2024-04-26T21:15:57.509 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:57.504+0000 7fcb3150b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T21:15:57.581 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:57.576+0000 7fcb3150b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T21:15:57.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2e09400640 1 Processor -- start 2024-04-26T21:15:57.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2e09400640 1 -- start start 2024-04-26T21:15:57.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2e09400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406d790 0x7f2e0406df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2e09400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e0406e460 0x7f2e040ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2e09400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e040d22e0 con 0x7f2e040b8880 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2e09400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2e040cdcb0 con 0x7f2e0406e460 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2e09400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2e040cd380 con 0x7f2e0406d790 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2dfbe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406d790 0x7f2e0406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2e03200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e0406e460 0x7f2e040ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2dfbe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406d790 0x7f2e0406df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:40234/0 (socket says 172.21.15.112:40234) 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2dfbe00640 1 -- 172.21.15.112:0/243446907 learned_addr learned my addr 172.21.15.112:0/243446907 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2dfbe00640 1 -- 172.21.15.112:0/243446907 >> v2:172.21.15.112:3300/0 conn(0x7f2e0406e460 msgr2=0x7f2e040ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2dfbe00640 1 --2- 172.21.15.112:0/243446907 >> v2:172.21.15.112:3300/0 conn(0x7f2e0406e460 0x7f2e040ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.640+0000 7f2dfbe00640 1 -- 172.21.15.112:0/243446907 >> v1:172.21.15.106:6789/0 conn(0x7f2e040b8880 legacy=0x7f2e040d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:15:57.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.644+0000 7f2dfbe00640 1 -- 172.21.15.112:0/243446907 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e040cd660 con 0x7f2e0406d790 2024-04-26T21:15:57.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.644+0000 7f2dfbe00640 1 --2- 172.21.15.112:0/243446907 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406d790 0x7f2e0406df20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009870 tx=0x7f2dec01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9daf9b95f16328a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:57.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.644+0000 7f2e01e00640 1 -- 172.21.15.112:0/243446907 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0b5070 con 0x7f2e0406d790 2024-04-26T21:15:57.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.644+0000 7f2e01e00640 1 -- 172.21.15.112:0/243446907 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec0a89d0 con 0x7f2e0406d790 2024-04-26T21:15:57.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.644+0000 7f2e01e00640 1 -- 172.21.15.112:0/243446907 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0a8da0 con 0x7f2e0406d790 2024-04-26T21:15:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.644+0000 7f2e09400640 1 -- 172.21.15.112:0/243446907 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406d790 msgr2=0x7f2e0406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.644+0000 7f2e09400640 1 --2- 172.21.15.112:0/243446907 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406d790 0x7f2e0406df20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009870 tx=0x7f2dec01ed10 comp rx=0 tx=0).stop 2024-04-26T21:15:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.644+0000 7f2e09400640 1 -- 172.21.15.112:0/243446907 shutdown_connections 2024-04-26T21:15:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.644+0000 7f2e09400640 1 --2- 172.21.15.112:0/243446907 >> v2:172.21.15.112:3300/0 conn(0x7f2e0406e460 0x7f2e040ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 --2- 172.21.15.112:0/243446907 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406d790 0x7f2e0406df20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 -- 172.21.15.112:0/243446907 >> 172.21.15.112:0/243446907 conn(0x7f2e040d2c90 msgr2=0x7f2e040d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 -- 172.21.15.112:0/243446907 shutdown_connections 2024-04-26T21:15:57.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 -- 172.21.15.112:0/243446907 wait complete. 2024-04-26T21:15:57.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 Processor -- start 2024-04-26T21:15:57.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 -- start start 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e0406d790 0x7f2e040cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406e460 0x7f2e040cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e040b8880 0x7f2e0409eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2e040b5ae0 con 0x7f2e0406d790 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2e040ce680 con 0x7f2e040b8880 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e09400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2e040c9d60 con 0x7f2e0406e460 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2dfbe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406e460 0x7f2e040cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e03200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e040b8880 0x7f2e0409eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2dfbe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406e460 0x7f2e040cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:40250/0 (socket says 172.21.15.112:40250) 2024-04-26T21:15:57.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2dfbe00640 1 -- 172.21.15.112:0/1671279368 learned_addr learned my addr 172.21.15.112:0/1671279368 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e02800640 1 --2- 172.21.15.112:0/1671279368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e0406d790 0x7f2e040cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e03200640 1 -- 172.21.15.112:0/1671279368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406e460 msgr2=0x7f2e040cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e03200640 1 --2- 172.21.15.112:0/1671279368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406e460 0x7f2e040cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e03200640 1 -- 172.21.15.112:0/1671279368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e0406d790 msgr2=0x7f2e040cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e03200640 1 --2- 172.21.15.112:0/1671279368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e0406d790 0x7f2e040cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e03200640 1 -- 172.21.15.112:0/1671279368 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e040c9fb0 con 0x7f2e040b8880 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2dfbe00640 1 --2- 172.21.15.112:0/1671279368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406e460 0x7f2e040cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2e03200640 1 --2- 172.21.15.112:0/1671279368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e040b8880 0x7f2e0409eeb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00efc0 tx=0x7f2dfc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.648+0000 7f2dfaa00640 1 -- 172.21.15.112:0/1671279368 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc018020 con 0x7f2e040b8880 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.652+0000 7f2dfaa00640 1 -- 172.21.15.112:0/1671279368 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dfc014480 con 0x7f2e040b8880 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.652+0000 7f2dfaa00640 1 -- 172.21.15.112:0/1671279368 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc014870 con 0x7f2e040b8880 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.652+0000 7f2e09400640 1 -- 172.21.15.112:0/1671279368 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e040ca290 con 0x7f2e040b8880 2024-04-26T21:15:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.652+0000 7f2e09400640 1 -- 172.21.15.112:0/1671279368 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e040ca850 con 0x7f2e040b8880 2024-04-26T21:15:57.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.652+0000 7f2dfaa00640 1 -- 172.21.15.112:0/1671279368 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2dfc01b020 con 0x7f2e040b8880 2024-04-26T21:15:57.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.652+0000 7f2dfaa00640 1 -- 172.21.15.112:0/1671279368 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f2dfc01da60 con 0x7f2e040b8880 2024-04-26T21:15:57.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.652+0000 7f2e09400640 1 -- 172.21.15.112:0/1671279368 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e04069b10 con 0x7f2e040b8880 2024-04-26T21:15:57.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.652+0000 7f2dfaa00640 1 -- 172.21.15.112:0/1671279368 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2dfc022030 con 0x7f2e040b8880 2024-04-26T21:15:57.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.720+0000 7f2e09400640 1 -- 172.21.15.112:0/1671279368 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e5167609-1c53-43f5-95c7-ffbcb284ce9c", "id": 7} v 0) -- 0x7f2e040b4130 con 0x7f2e040b8880 2024-04-26T21:15:57.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.728+0000 7f2dfaa00640 1 -- 172.21.15.112:0/1671279368 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5167609-1c53-43f5-95c7-ffbcb284ce9c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f2dfc010040 con 0x7f2e040b8880 2024-04-26T21:15:57.733 INFO:teuthology.orchestra.run.smithi112.stdout:7 2024-04-26T21:15:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.732+0000 7f2e09400640 1 -- 172.21.15.112:0/1671279368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e040b8880 msgr2=0x7f2e0409eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.732+0000 7f2e09400640 1 --2- 172.21.15.112:0/1671279368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e040b8880 0x7f2e0409eeb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00efc0 tx=0x7f2dfc00c490 comp rx=0 tx=0).stop 2024-04-26T21:15:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.732+0000 7f2e09400640 1 -- 172.21.15.112:0/1671279368 shutdown_connections 2024-04-26T21:15:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.732+0000 7f2e09400640 1 --2- 172.21.15.112:0/1671279368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e040b8880 0x7f2e0409eeb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.732+0000 7f2e09400640 1 --2- 172.21.15.112:0/1671279368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2e0406e460 0x7f2e040cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.732+0000 7f2e09400640 1 --2- 172.21.15.112:0/1671279368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e0406d790 0x7f2e040cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.732+0000 7f2e09400640 1 -- 172.21.15.112:0/1671279368 >> 172.21.15.112:0/1671279368 conn(0x7f2e040d2c90 msgr2=0x7f2e040d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.732+0000 7f2e09400640 1 -- 172.21.15.112:0/1671279368 shutdown_connections 2024-04-26T21:15:57.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:15:57.732+0000 7f2e09400640 1 -- 172.21.15.112:0/1671279368 wait complete. 2024-04-26T21:15:57.751 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T21:15:57.752 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T21:15:57.755 INFO:tasks.ceph.osd.0:Started 2024-04-26T21:15:57.755 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T21:15:57.755 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T21:15:57.760 INFO:tasks.ceph.osd.1:Started 2024-04-26T21:15:57.760 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T21:15:57.760 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T21:15:57.763 INFO:tasks.ceph.osd.2:Started 2024-04-26T21:15:57.763 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T21:15:57.763 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T21:15:57.766 INFO:tasks.ceph.osd.3:Started 2024-04-26T21:15:57.766 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T21:15:57.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T21:15:57.769 INFO:tasks.ceph.osd.4:Started 2024-04-26T21:15:57.770 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T21:15:57.770 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T21:15:57.773 INFO:tasks.ceph.osd.5:Started 2024-04-26T21:15:57.773 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T21:15:57.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T21:15:57.776 INFO:tasks.ceph.osd.6:Started 2024-04-26T21:15:57.776 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T21:15:57.776 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T21:15:57.780 INFO:tasks.ceph.osd.7:Started 2024-04-26T21:15:57.780 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:15:57.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.989+0000 7f1f90a00640 1 Processor -- start 2024-04-26T21:15:57.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.989+0000 7f1f90a00640 1 -- start start 2024-04-26T21:15:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f90a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f8c0d01c0 0x7f1f8c0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f90a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f8c0d1840 con 0x7f1f8c15d060 2024-04-26T21:15:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f90a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f8c0b2250 con 0x7f1f8c0cfd40 2024-04-26T21:15:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f90a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1f8c0b25a0 con 0x7f1f8c0d01c0 2024-04-26T21:15:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f89e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1f8c15d060 0x7f1f8c0cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55888/0 (socket says 172.21.15.106:55888) 2024-04-26T21:15:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f89e00640 1 -- 172.21.15.106:0/3542253598 learned_addr learned my addr 172.21.15.106:0/3542253598 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:15:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f8a800640 1 --2- 172.21.15.106:0/3542253598 >> v2:172.21.15.112:3300/0 conn(0x7f1f8c0d01c0 0x7f1f8c0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f88a00640 1 -- 172.21.15.106:0/3542253598 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880691983 0 0) 0x7f1f7c001120 con 0x7f1f8c15d060 2024-04-26T21:15:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f88a00640 1 -- 172.21.15.106:0/3542253598 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f70003530 con 0x7f1f8c15d060 2024-04-26T21:15:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f8a800640 1 -- 172.21.15.106:0/3542253598 >> v1:172.21.15.112:6789/0 conn(0x7f1f8c0cfd40 legacy=0x7f1f8c0b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f88a00640 1 -- 172.21.15.106:0/3542253598 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768966563 0 0) 0x7f1f8c0b2250 con 0x7f1f8c0cfd40 2024-04-26T21:15:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f8a800640 1 -- 172.21.15.106:0/3542253598 >> v1:172.21.15.106:6789/0 conn(0x7f1f8c15d060 legacy=0x7f1f8c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.993+0000 7f1f8a800640 1 -- 172.21.15.106:0/3542253598 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c0ce660 con 0x7f1f8c0d01c0 2024-04-26T21:15:57.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f8a800640 1 --2- 172.21.15.106:0/3542253598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0d01c0 0x7f1f8c0b3140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d90 tx=0x7f1f8401c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f1f4ee0047f173 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:57.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f88a00640 1 -- 172.21.15.106:0/3542253598 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840b2070 con 0x7f1f8c0d01c0 2024-04-26T21:15:57.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f88a00640 1 -- 172.21.15.106:0/3542253598 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f840a55f0 con 0x7f1f8c0d01c0 2024-04-26T21:15:57.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f88a00640 1 -- 172.21.15.106:0/3542253598 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c001850 con 0x7f1f8c0d01c0 2024-04-26T21:15:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f90a00640 1 -- 172.21.15.106:0/3542253598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0d01c0 msgr2=0x7f1f8c0b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f90a00640 1 --2- 172.21.15.106:0/3542253598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0d01c0 0x7f1f8c0b3140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d90 tx=0x7f1f8401c7b0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f90a00640 1 -- 172.21.15.106:0/3542253598 shutdown_connections 2024-04-26T21:15:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f90a00640 1 --2- 172.21.15.106:0/3542253598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0d01c0 0x7f1f8c0b3140 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f90a00640 1 -- 172.21.15.106:0/3542253598 >> 172.21.15.106:0/3542253598 conn(0x7f1f8c0d2c60 msgr2=0x7f1f8c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f90a00640 1 -- 172.21.15.106:0/3542253598 shutdown_connections 2024-04-26T21:15:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f90a00640 1 -- 172.21.15.106:0/3542253598 wait complete. 2024-04-26T21:15:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f90a00640 1 Processor -- start 2024-04-26T21:15:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:57.997+0000 7f1f90a00640 1 -- start start 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f90a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0cfd40 0x7f1f8c0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f90a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0d01c0 0x7f1f8c157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f90a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c15d060 0x7f1f8c15eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f90a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c0ce400 con 0x7f1f8c0d01c0 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f90a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c0ce280 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f90a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8c16ac10 con 0x7f1f8c15d060 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0d01c0 0x7f1f8c157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0cfd40 0x7f1f8c0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0d01c0 0x7f1f8c157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53950/0 (socket says 172.21.15.106:53950) 2024-04-26T21:15:58.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89400640 1 -- 172.21.15.106:0/2032571241 learned_addr learned my addr 172.21.15.106:0/2032571241 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f8a800640 1 --2- 172.21.15.106:0/2032571241 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c15d060 0x7f1f8c15eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89e00640 1 -- 172.21.15.106:0/2032571241 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c15d060 msgr2=0x7f1f8c15eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89e00640 1 --2- 172.21.15.106:0/2032571241 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c15d060 0x7f1f8c15eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89e00640 1 -- 172.21.15.106:0/2032571241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0d01c0 msgr2=0x7f1f8c157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89e00640 1 --2- 172.21.15.106:0/2032571241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0d01c0 0x7f1f8c157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89e00640 1 -- 172.21.15.106:0/2032571241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c160240 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f89e00640 1 --2- 172.21.15.106:0/2032571241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0cfd40 0x7f1f8c0c7d20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00ca40 tx=0x7f1f7c00cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f82000640 1 -- 172.21.15.106:0/2032571241 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c018070 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f82000640 1 -- 172.21.15.106:0/2032571241 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c0072f0 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f90a00640 1 -- 172.21.15.106:0/2032571241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8c1604e0 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f82000640 1 -- 172.21.15.106:0/2032571241 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0047f0 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f90a00640 1 -- 172.21.15.106:0/2032571241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8c0c7520 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f82000640 1 -- 172.21.15.106:0/2032571241 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f7c01b070 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f82000640 1 -- 172.21.15.106:0/2032571241 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1f7c00a640 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.001+0000 7f1f90a00640 1 -- 172.21.15.106:0/2032571241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8c069400 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.005+0000 7f1f82000640 1 -- 172.21.15.106:0/2032571241 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1f8c0d1840 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 -- 172.21.15.106:0/2032571241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f8c06e7d0 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f82000640 1 -- 172.21.15.106:0/2032571241 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1f7c00abe0 con 0x7f1f8c0cfd40 2024-04-26T21:15:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:15:58.063 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":10,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:15:57.726501+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:15:58.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 -- 172.21.15.106:0/2032571241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0cfd40 msgr2=0x7f1f8c0c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:58.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 --2- 172.21.15.106:0/2032571241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0cfd40 0x7f1f8c0c7d20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00ca40 tx=0x7f1f7c00cf00 comp rx=0 tx=0).stop 2024-04-26T21:15:58.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 -- 172.21.15.106:0/2032571241 shutdown_connections 2024-04-26T21:15:58.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 --2- 172.21.15.106:0/2032571241 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f8c15d060 0x7f1f8c15eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:58.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 --2- 172.21.15.106:0/2032571241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0d01c0 0x7f1f8c157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:58.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 --2- 172.21.15.106:0/2032571241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f8c0cfd40 0x7f1f8c0c7d20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:58.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 -- 172.21.15.106:0/2032571241 >> 172.21.15.106:0/2032571241 conn(0x7f1f8c0d2c60 msgr2=0x7f1f8c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:58.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 -- 172.21.15.106:0/2032571241 shutdown_connections 2024-04-26T21:15:58.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:15:58.061+0000 7f1f90a00640 1 -- 172.21.15.106:0/2032571241 wait complete. 2024-04-26T21:15:58.082 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T21:15:58.082 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T21:15:58.164 INFO:tasks.ceph.mgr.y.smithi106.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T21:15:58.164 INFO:tasks.ceph.mgr.y.smithi106.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T21:15:58.164 INFO:tasks.ceph.mgr.y.smithi106.stderr: from numpy import show_config as show_numpy_config 2024-04-26T21:15:58.203 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:58.201+0000 7ff5a3632180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T21:15:58.220 INFO:tasks.ceph.mgr.x.smithi112.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T21:15:58.220 INFO:tasks.ceph.mgr.x.smithi112.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T21:15:58.220 INFO:tasks.ceph.mgr.x.smithi112.stderr: from numpy import show_config as show_numpy_config 2024-04-26T21:15:58.267 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:58.264+0000 7fcb3150b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T21:15:58.352 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:58.349+0000 7ff5a3632180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:15:58.415 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:58.412+0000 7fcb3150b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:15:58.426 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-26T21:15:58.424+0000 7fabb2db67c0 -1 Falling back to public interface 2024-04-26T21:15:58.438 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-26T21:15:58.436+0000 7fe0783677c0 -1 Falling back to public interface 2024-04-26T21:15:58.439 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-26T21:15:58.436+0000 7f5d753fb7c0 -1 Falling back to public interface 2024-04-26T21:15:58.445 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-26T21:15:58.445+0000 7f2db67827c0 -1 Falling back to public interface 2024-04-26T21:15:58.469 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-26T21:15:58.469+0000 7f3bac0697c0 -1 Falling back to public interface 2024-04-26T21:15:58.471 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-26T21:15:58.468+0000 7f9fdd7a47c0 -1 Falling back to public interface 2024-04-26T21:15:58.477 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-04-26T21:15:58.477+0000 7f63bc8f37c0 -1 Falling back to public interface 2024-04-26T21:15:58.485 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-26T21:15:58.485+0000 7f5a23ad47c0 -1 Falling back to public interface 2024-04-26T21:15:58.553 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:58.553+0000 7ff5a3632180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T21:15:58.613 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:58.608+0000 7fcb3150b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T21:15:58.626 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:58.625+0000 7ff5a3632180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T21:15:58.685 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:58.680+0000 7fcb3150b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T21:15:58.780 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:58.777+0000 7ff5a3632180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:15:58.836 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:58.832+0000 7fcb3150b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:15:58.887 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T21:15:59.013 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c19400640 1 Processor -- start 2024-04-26T21:15:59.013 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c19400640 1 -- start start 2024-04-26T21:15:59.014 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c19400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c1415f050 0x7f0c140af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:59.014 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c19400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c14162dc0 con 0x7f0c14076020 2024-04-26T21:15:59.015 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c19400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c141630a0 con 0x7f0c14072ec0 2024-04-26T21:15:59.015 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c19400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0c141636f0 con 0x7f0c1415f050 2024-04-26T21:15:59.015 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c0be00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0c14076020 0x7f0c140727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55902/0 (socket says 172.21.15.106:55902) 2024-04-26T21:15:59.015 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c0be00640 1 -- 172.21.15.106:0/2485188590 learned_addr learned my addr 172.21.15.106:0/2485188590 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:15:59.016 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c12800640 1 --2- 172.21.15.106:0/2485188590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c1415f050 0x7f0c140af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:59.016 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c11e00640 1 -- 172.21.15.106:0/2485188590 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676150012 0 0) 0x7f0c14162dc0 con 0x7f0c14076020 2024-04-26T21:15:59.016 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c11e00640 1 -- 172.21.15.106:0/2485188590 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bf8003530 con 0x7f0c14076020 2024-04-26T21:15:59.016 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c11e00640 1 -- 172.21.15.106:0/2485188590 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746278565 0 0) 0x7f0c141630a0 con 0x7f0c14072ec0 2024-04-26T21:15:59.016 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c11e00640 1 -- 172.21.15.106:0/2485188590 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c14162dc0 con 0x7f0c14072ec0 2024-04-26T21:15:59.016 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c12800640 1 -- 172.21.15.106:0/2485188590 >> v1:172.21.15.112:6789/0 conn(0x7f0c14072ec0 legacy=0x7f0c140b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:59.016 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c12800640 1 -- 172.21.15.106:0/2485188590 >> v1:172.21.15.106:6789/0 conn(0x7f0c14076020 legacy=0x7f0c140727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:59.016 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.013+0000 7f0c12800640 1 -- 172.21.15.106:0/2485188590 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c14163380 con 0x7f0c1415f050 2024-04-26T21:15:59.018 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c12800640 1 --2- 172.21.15.106:0/2485188590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c1415f050 0x7f0c140af6d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0c040097f0 tx=0x7f0c0401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6228bed3b96f1091 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:59.019 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c11e00640 1 -- 172.21.15.106:0/2485188590 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c040b0070 con 0x7f0c1415f050 2024-04-26T21:15:59.019 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c11e00640 1 -- 172.21.15.106:0/2485188590 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c040ab600 con 0x7f0c1415f050 2024-04-26T21:15:59.019 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c11e00640 1 -- 172.21.15.106:0/2485188590 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c040ab9d0 con 0x7f0c1415f050 2024-04-26T21:15:59.019 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c19400640 1 -- 172.21.15.106:0/2485188590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c1415f050 msgr2=0x7f0c140af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:59.019 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c19400640 1 --2- 172.21.15.106:0/2485188590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c1415f050 0x7f0c140af6d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0c040097f0 tx=0x7f0c0401c4e0 comp rx=0 tx=0).stop 2024-04-26T21:15:59.020 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c19400640 1 -- 172.21.15.106:0/2485188590 shutdown_connections 2024-04-26T21:15:59.020 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c19400640 1 --2- 172.21.15.106:0/2485188590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c1415f050 0x7f0c140af6d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:59.020 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c19400640 1 -- 172.21.15.106:0/2485188590 >> 172.21.15.106:0/2485188590 conn(0x7f0c1406c3d0 msgr2=0x7f0c1406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:59.020 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c19400640 1 -- 172.21.15.106:0/2485188590 shutdown_connections 2024-04-26T21:15:59.020 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.017+0000 7f0c19400640 1 -- 172.21.15.106:0/2485188590 wait complete. 2024-04-26T21:15:59.021 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 Processor -- start 2024-04-26T21:15:59.021 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 -- start start 2024-04-26T21:15:59.023 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c14072ec0 0x7f0c140cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:59.023 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14076020 0x7f0c140d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:59.023 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1415f050 0x7f0c1414a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:59.023 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1416cda0 con 0x7f0c14076020 2024-04-26T21:15:59.023 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0c140b5580 con 0x7f0c1415f050 2024-04-26T21:15:59.023 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1416cf20 con 0x7f0c14072ec0 2024-04-26T21:15:59.023 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c0be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14076020 0x7f0c140d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c12800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c14072ec0 0x7f0c140cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c12800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c14072ec0 0x7f0c140cead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:55254/0 (socket says 172.21.15.106:55254) 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c0be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14076020 0x7f0c140d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53962/0 (socket says 172.21.15.106:53962) 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c12800640 1 -- 172.21.15.106:0/736760165 learned_addr learned my addr 172.21.15.106:0/736760165 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c13200640 1 --2- 172.21.15.106:0/736760165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1415f050 0x7f0c1414a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c12800640 1 -- 172.21.15.106:0/736760165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1415f050 msgr2=0x7f0c1414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c12800640 1 --2- 172.21.15.106:0/736760165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1415f050 0x7f0c1414a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c12800640 1 -- 172.21.15.106:0/736760165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14076020 msgr2=0x7f0c140d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c12800640 1 --2- 172.21.15.106:0/736760165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14076020 0x7f0c140d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c12800640 1 -- 172.21.15.106:0/736760165 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c140d1140 con 0x7f0c14072ec0 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c12800640 1 --2- 172.21.15.106:0/736760165 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c14072ec0 0x7f0c140cead0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0c040190f0 tx=0x7f0c0401ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c0aa00640 1 -- 172.21.15.106:0/736760165 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c040b0050 con 0x7f0c14072ec0 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c0aa00640 1 -- 172.21.15.106:0/736760165 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c040bc070 con 0x7f0c14072ec0 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c0aa00640 1 -- 172.21.15.106:0/736760165 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04006e20 con 0x7f0c14072ec0 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 -- 172.21.15.106:0/736760165 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1414a560 con 0x7f0c14072ec0 2024-04-26T21:15:59.024 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c19400640 1 -- 172.21.15.106:0/736760165 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c140cf390 con 0x7f0c14072ec0 2024-04-26T21:15:59.025 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c0aa00640 1 -- 172.21.15.106:0/736760165 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0c040b5870 con 0x7f0c14072ec0 2024-04-26T21:15:59.025 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.021+0000 7f0c0aa00640 1 -- 172.21.15.106:0/736760165 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0c040b5b60 con 0x7f0c14072ec0 2024-04-26T21:15:59.025 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.025+0000 7f0c19400640 1 -- 172.21.15.106:0/736760165 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c14069d30 con 0x7f0c14072ec0 2024-04-26T21:15:59.027 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.025+0000 7f0c0aa00640 1 -- 172.21.15.106:0/736760165 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0c040160d0 con 0x7f0c14072ec0 2024-04-26T21:15:59.085 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 -- 172.21.15.106:0/736760165 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c14162b80 con 0x7f0c14072ec0 2024-04-26T21:15:59.085 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c0aa00640 1 -- 172.21.15.106:0/736760165 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0c040c1460 con 0x7f0c14072ec0 2024-04-26T21:15:59.086 INFO:teuthology.misc.health.smithi106.stdout: 2024-04-26T21:15:59.086 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":10,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:15:57.726501+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:15:59.087 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 -- 172.21.15.106:0/736760165 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c14072ec0 msgr2=0x7f0c140cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:59.087 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 --2- 172.21.15.106:0/736760165 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c14072ec0 0x7f0c140cead0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0c040190f0 tx=0x7f0c0401ad20 comp rx=0 tx=0).stop 2024-04-26T21:15:59.087 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 -- 172.21.15.106:0/736760165 shutdown_connections 2024-04-26T21:15:59.087 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 --2- 172.21.15.106:0/736760165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1415f050 0x7f0c1414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:59.087 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 --2- 172.21.15.106:0/736760165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14076020 0x7f0c140d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:59.087 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 --2- 172.21.15.106:0/736760165 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c14072ec0 0x7f0c140cead0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:59.087 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 -- 172.21.15.106:0/736760165 >> 172.21.15.106:0/736760165 conn(0x7f0c1406c3d0 msgr2=0x7f0c14161cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:59.087 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 -- 172.21.15.106:0/736760165 shutdown_connections 2024-04-26T21:15:59.087 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:15:59.085+0000 7f0c19400640 1 -- 172.21.15.106:0/736760165 wait complete. 2024-04-26T21:15:59.104 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T21:15:59.500 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:59.501+0000 7ff5a3632180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T21:15:59.546 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:59.544+0000 7fcb3150b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T21:15:59.586 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:59.585+0000 7ff5a3632180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T21:15:59.632 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:59.628+0000 7fcb3150b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T21:15:59.788 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:59.789+0000 7ff5a3632180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T21:15:59.834 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:59.832+0000 7fcb3150b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T21:15:59.872 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:15:59.873+0000 7ff5a3632180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T21:15:59.918 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:15:59.916+0000 7fcb3150b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T21:16:00.201 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:16:00.201+0000 7ff5a3632180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T21:16:00.248 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:16:00.244+0000 7fcb3150b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T21:16:00.271 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:16:00.269+0000 7ff5a3632180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T21:16:00.323 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-04-26T21:16:00.320+0000 7fcb3150b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T21:16:01.294 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:16:01.293+0000 7ff547c00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T21:16:01.298 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-04-26T21:16:01.297+0000 7ff547c00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T21:16:02.307 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-26T21:16:02.305+0000 7f2db67827c0 -1 osd.2 0 log_to_monitors true 2024-04-26T21:16:02.474 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-26T21:16:02.472+0000 7fe0783677c0 -1 osd.4 0 log_to_monitors true 2024-04-26T21:16:02.475 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-04-26T21:16:02.473+0000 7f63bc8f37c0 -1 osd.3 0 log_to_monitors true 2024-04-26T21:16:02.476 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-26T21:16:02.472+0000 7f5d753fb7c0 -1 osd.6 0 log_to_monitors true 2024-04-26T21:16:02.478 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-26T21:16:02.476+0000 7fabb2db67c0 -1 osd.5 0 log_to_monitors true 2024-04-26T21:16:02.490 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-26T21:16:02.489+0000 7f3bac0697c0 -1 osd.1 0 log_to_monitors true 2024-04-26T21:16:02.504 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-26T21:16:02.500+0000 7f9fdd7a47c0 -1 osd.7 0 log_to_monitors true 2024-04-26T21:16:02.506 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-26T21:16:02.505+0000 7f5a23ad47c0 -1 osd.0 0 log_to_monitors true 2024-04-26T21:16:04.261 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-26T21:16:04.261+0000 7f2db2000640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T21:16:04.277 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-26T21:16:04.277+0000 7f2da7600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:05.911 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:06.112 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e71800640 1 Processor -- start 2024-04-26T21:16:06.114 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e71800640 1 -- start start 2024-04-26T21:16:06.114 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e71800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4e6c0687d0 0x7f4e6c0b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:06.114 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e71800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4e6c0b5bc0 0x7f4e6c0b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:06.114 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e71800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6c1649d0 con 0x7f4e6c14cda0 2024-04-26T21:16:06.114 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e71800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4e6c0b4e00 con 0x7f4e6c0687d0 2024-04-26T21:16:06.115 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e71800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4e6c0b50e0 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.115 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e6a000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4e6c0687d0 0x7f4e6c0b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:06.115 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e6aa00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4e6c14cda0 0x7f4e6c0680c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55916/0 (socket says 172.21.15.106:55916) 2024-04-26T21:16:06.115 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e6aa00640 1 -- 172.21.15.106:0/516295550 learned_addr learned my addr 172.21.15.106:0/516295550 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:06.115 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f3ba7a00640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T21:16:06.116 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e6b400640 1 --2- 172.21.15.106:0/516295550 >> v2:172.21.15.112:3300/0 conn(0x7f4e6c0b5bc0 0x7f4e6c0b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:06.116 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e6a000640 1 -- 172.21.15.106:0/516295550 >> v2:172.21.15.112:3300/0 conn(0x7f4e6c0b5bc0 msgr2=0x7f4e6c0b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:06.116 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e6a000640 1 --2- 172.21.15.106:0/516295550 >> v2:172.21.15.112:3300/0 conn(0x7f4e6c0b5bc0 0x7f4e6c0b6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.116 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e6a000640 1 -- 172.21.15.106:0/516295550 >> v1:172.21.15.106:6789/0 conn(0x7f4e6c14cda0 legacy=0x7f4e6c0680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:06.116 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.112+0000 7f4e6a000640 1 -- 172.21.15.106:0/516295550 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c0b53c0 con 0x7f4e6c0687d0 2024-04-26T21:16:06.120 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.120+0000 7f4e6a000640 1 --2- 172.21.15.106:0/516295550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0687d0 0x7f4e6c0b68a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0ce990 tx=0x7f4e5801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6841470d8a78aaa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:06.125 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e69600640 1 -- 172.21.15.106:0/516295550 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580b0070 con 0x7f4e6c0687d0 2024-04-26T21:16:06.125 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e69600640 1 -- 172.21.15.106:0/516295550 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e58004230 con 0x7f4e6c0687d0 2024-04-26T21:16:06.125 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e69600640 1 -- 172.21.15.106:0/516295550 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58003620 con 0x7f4e6c0687d0 2024-04-26T21:16:06.126 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e71800640 1 -- 172.21.15.106:0/516295550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0687d0 msgr2=0x7f4e6c0b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:06.126 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e71800640 1 --2- 172.21.15.106:0/516295550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0687d0 0x7f4e6c0b68a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0ce990 tx=0x7f4e5801c3e0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.126 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e71800640 1 -- 172.21.15.106:0/516295550 shutdown_connections 2024-04-26T21:16:06.126 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e71800640 1 --2- 172.21.15.106:0/516295550 >> v2:172.21.15.112:3300/0 conn(0x7f4e6c0b5bc0 0x7f4e6c0b6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.126 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e71800640 1 --2- 172.21.15.106:0/516295550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0687d0 0x7f4e6c0b68a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.126 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e71800640 1 -- 172.21.15.106:0/516295550 >> 172.21.15.106:0/516295550 conn(0x7f4e6c072fb0 msgr2=0x7f4e6c0733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:06.127 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e71800640 1 -- 172.21.15.106:0/516295550 shutdown_connections 2024-04-26T21:16:06.128 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e71800640 1 -- 172.21.15.106:0/516295550 wait complete. 2024-04-26T21:16:06.128 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.124+0000 7f4e71800640 1 Processor -- start 2024-04-26T21:16:06.128 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e71800640 1 -- start start 2024-04-26T21:16:06.130 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e71800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6c0687d0 0x7f4e6c13b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:06.130 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e71800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0b5bc0 0x7f4e6c162f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:06.130 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e71800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c14cda0 0x7f4e6c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:06.130 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e71800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c070a00 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.130 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e71800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c070880 con 0x7f4e6c14cda0 2024-04-26T21:16:06.130 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e71800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6c070b80 con 0x7f4e6c0687d0 2024-04-26T21:16:06.130 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0b5bc0 0x7f4e6c162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:06.131 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0b5bc0 0x7f4e6c162f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:54114/0 (socket says 172.21.15.106:54114) 2024-04-26T21:16:06.131 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6a000640 1 -- 172.21.15.106:0/3294291697 learned_addr learned my addr 172.21.15.106:0/3294291697 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:06.131 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6aa00640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6c0687d0 0x7f4e6c13b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:06.131 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6b400640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c14cda0 0x7f4e6c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:06.131 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6a000640 1 -- 172.21.15.106:0/3294291697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6c0687d0 msgr2=0x7f4e6c13b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:06.131 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6a000640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6c0687d0 0x7f4e6c13b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.131 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6a000640 1 -- 172.21.15.106:0/3294291697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c14cda0 msgr2=0x7f4e6c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:06.131 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6a000640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c14cda0 0x7f4e6c0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.131 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6a000640 1 -- 172.21.15.106:0/3294291697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c13b7e0 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.132 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e6a000640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0b5bc0 0x7f4e6c162f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e58018ff0 tx=0x7f4e58019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:06.132 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e62a00640 1 -- 172.21.15.106:0/3294291697 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580b9070 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.132 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e62a00640 1 -- 172.21.15.106:0/3294291697 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e58003d30 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.132 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c13e400 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.132 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e62a00640 1 -- 172.21.15.106:0/3294291697 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580b0040 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.132 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.128+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c13e9c0 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.133 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.132+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e440052a0 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.138 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.136+0000 7f4e62a00640 1 -- 172.21.15.106:0/3294291697 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f4e580bc070 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.140 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.136+0000 7f4e62a00640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4e4c0682f0 0x7f4e4c06a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:06.140 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.136+0000 7f4e62a00640 1 -- 172.21.15.106:0/3294291697 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f4e58120220 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.141 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.140+0000 7f4e6aa00640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4e4c0682f0 0x7f4e4c06a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:06.141 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.140+0000 7f4e6aa00640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4e4c0682f0 0x7f4e4c06a7b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c1401d0 tx=0x7f4e5c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:06.147 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.144+0000 7f4e62a00640 1 -- 172.21.15.106:0/3294291697 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4e580c3030 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.158 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-26T21:16:06.156+0000 7f3b9d000640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:06.208 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-04-26T21:16:06.204+0000 7f63b7800640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T21:16:06.232 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-26T21:16:06.232+0000 7f5a1ea00640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T21:16:06.234 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-04-26T21:16:06.232+0000 7f63ad800640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:06.265 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-26T21:16:06.264+0000 7f5a14a00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:06.355 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.352+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e44005860 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.356 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e62a00640 1 -- 172.21.15.106:0/3294291697 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7578 (secure 0 0 0) 0x7f4e58016090 con 0x7f4e6c0b5bc0 2024-04-26T21:16:06.356 INFO:teuthology.misc.health.smithi106.stdout: 2024-04-26T21:16:06.356 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":14,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:05.484562+0000","last_up_change":"2024-04-26T21:16:04.339151+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:06.359 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4e4c0682f0 msgr2=0x7f4e4c06a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:06.359 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4e4c0682f0 0x7f4e4c06a7b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c1401d0 tx=0x7f4e5c009040 comp rx=0 tx=0).stop 2024-04-26T21:16:06.359 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0b5bc0 msgr2=0x7f4e6c162f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:06.359 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0b5bc0 0x7f4e6c162f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e58018ff0 tx=0x7f4e58019180 comp rx=0 tx=0).stop 2024-04-26T21:16:06.359 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 shutdown_connections 2024-04-26T21:16:06.359 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e6c14cda0 0x7f4e6c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.360 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4e4c0682f0 0x7f4e4c06a7b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.360 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6c0b5bc0 0x7f4e6c162f50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.360 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 --2- 172.21.15.106:0/3294291697 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4e6c0687d0 0x7f4e6c13b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:06.360 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 >> 172.21.15.106:0/3294291697 conn(0x7f4e6c072fb0 msgr2=0x7f4e6c073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:06.360 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 shutdown_connections 2024-04-26T21:16:06.360 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:06.356+0000 7f4e71800640 1 -- 172.21.15.106:0/3294291697 wait complete. 2024-04-26T21:16:06.376 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-04-26T21:16:06.494 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-26T21:16:06.496+0000 7fe073c00640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T21:16:06.531 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-04-26T21:16:06.532+0000 7fe069200640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:06.643 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-26T21:16:06.644+0000 7fabadc00640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T21:16:06.663 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-26T21:16:06.664+0000 7f5d70200640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T21:16:06.667 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-04-26T21:16:06.668+0000 7faba3c00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:06.691 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-04-26T21:16:06.692+0000 7f5d66200640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:06.696 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-26T21:16:06.696+0000 7f9fd8600640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T21:16:06.720 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-04-26T21:16:06.720+0000 7f9fce600640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:13.183 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:13.318 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3eca200640 1 Processor -- start 2024-04-26T21:16:13.318 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3eca200640 1 -- start start 2024-04-26T21:16:13.320 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3eca200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3ec4161200 0x7f3ec40728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.320 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3eca200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec40741c0 con 0x7f3ec4143770 2024-04-26T21:16:13.320 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3eca200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec4072f90 con 0x7f3ec4073d30 2024-04-26T21:16:13.320 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3eca200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f3ec406e290 con 0x7f3ec4161200 2024-04-26T21:16:13.320 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3ec2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3ec4161200 0x7f3ec40728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.320 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3ec2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3ec4161200 0x7f3ec40728d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38392/0 (socket says 172.21.15.106:38392) 2024-04-26T21:16:13.320 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3ec2a00640 1 -- 172.21.15.106:0/1356402 learned_addr learned my addr 172.21.15.106:0/1356402 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:13.321 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.316+0000 7f3ec3400640 1 --1- 172.21.15.106:0/1356402 >> v1:172.21.15.106:6789/0 conn(0x7f3ec4143770 0x7f3ec4160af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44292/0 (socket says 172.21.15.106:44292) 2024-04-26T21:16:13.321 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3ec2a00640 1 -- 172.21.15.106:0/1356402 >> v1:172.21.15.112:6789/0 conn(0x7f3ec4073d30 legacy=0x7f3ec406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:13.321 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3ec2a00640 1 -- 172.21.15.106:0/1356402 >> v1:172.21.15.106:6789/0 conn(0x7f3ec4143770 legacy=0x7f3ec4160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.321 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3ec2a00640 1 -- 172.21.15.106:0/1356402 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec4073270 con 0x7f3ec4161200 2024-04-26T21:16:13.323 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3ec2a00640 1 --2- 172.21.15.106:0/1356402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4161200 0x7f3ec40728d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009870 tx=0x7f3eb001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5904f1a84318761e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.323 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3ec2000640 1 -- 172.21.15.106:0/1356402 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00ab660 con 0x7f3ec4161200 2024-04-26T21:16:13.323 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3ec2000640 1 -- 172.21.15.106:0/1356402 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb00b0070 con 0x7f3ec4161200 2024-04-26T21:16:13.324 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3ec2000640 1 -- 172.21.15.106:0/1356402 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00aba20 con 0x7f3ec4161200 2024-04-26T21:16:13.325 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3eca200640 1 -- 172.21.15.106:0/1356402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4161200 msgr2=0x7f3ec40728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.325 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3eca200640 1 --2- 172.21.15.106:0/1356402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4161200 0x7f3ec40728d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009870 tx=0x7f3eb001c460 comp rx=0 tx=0).stop 2024-04-26T21:16:13.325 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3eca200640 1 -- 172.21.15.106:0/1356402 shutdown_connections 2024-04-26T21:16:13.325 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3eca200640 1 --2- 172.21.15.106:0/1356402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4161200 0x7f3ec40728d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.325 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3eca200640 1 -- 172.21.15.106:0/1356402 >> 172.21.15.106:0/1356402 conn(0x7f3ec40b27d0 msgr2=0x7f3ec40b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:13.325 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3eca200640 1 -- 172.21.15.106:0/1356402 shutdown_connections 2024-04-26T21:16:13.325 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.320+0000 7f3eca200640 1 -- 172.21.15.106:0/1356402 wait complete. 2024-04-26T21:16:13.326 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 Processor -- start 2024-04-26T21:16:13.326 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 -- start start 2024-04-26T21:16:13.328 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ec4073d30 0x7f3ec4156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.328 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4143770 0x7f3ec41591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.328 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec4161200 0x7f3ec4144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.328 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec406fa10 con 0x7f3ec4143770 2024-04-26T21:16:13.328 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec406f890 con 0x7f3ec4161200 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec416ae40 con 0x7f3ec4073d30 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4143770 0x7f3ec41591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4143770 0x7f3ec41591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38396/0 (socket says 172.21.15.106:38396) 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec2a00640 1 -- 172.21.15.106:0/1604957986 learned_addr learned my addr 172.21.15.106:0/1604957986 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec3e00640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec4161200 0x7f3ec4144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec3400640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ec4073d30 0x7f3ec4156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec2a00640 1 -- 172.21.15.106:0/1604957986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ec4073d30 msgr2=0x7f3ec4156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec2a00640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ec4073d30 0x7f3ec4156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec2a00640 1 -- 172.21.15.106:0/1604957986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec4161200 msgr2=0x7f3ec4144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec2a00640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec4161200 0x7f3ec4144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec2a00640 1 -- 172.21.15.106:0/1604957986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec4156da0 con 0x7f3ec4143770 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ec2a00640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4143770 0x7f3ec41591f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00ad040 tx=0x7f3eb001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.329 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ebb400640 1 -- 172.21.15.106:0/1604957986 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00b4800 con 0x7f3ec4143770 2024-04-26T21:16:13.330 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ebb400640 1 -- 172.21.15.106:0/1604957986 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb00b49c0 con 0x7f3ec4143770 2024-04-26T21:16:13.330 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec4159bd0 con 0x7f3ec4143770 2024-04-26T21:16:13.330 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3ebb400640 1 -- 172.21.15.106:0/1604957986 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00b4db0 con 0x7f3ec4143770 2024-04-26T21:16:13.330 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.324+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec415a190 con 0x7f3ec4143770 2024-04-26T21:16:13.330 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.328+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec4069d30 con 0x7f3ec4143770 2024-04-26T21:16:13.330 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.328+0000 7f3ebb400640 1 -- 172.21.15.106:0/1604957986 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3eb00c7390 con 0x7f3ec4143770 2024-04-26T21:16:13.331 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.328+0000 7f3ebb400640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ea4068380 0x7f3ea406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.331 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.328+0000 7f3ebb400640 1 -- 172.21.15.106:0/1604957986 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f3eb0120fe0 con 0x7f3ec4143770 2024-04-26T21:16:13.331 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.328+0000 7f3ec3400640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ea4068380 0x7f3ea406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.332 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.328+0000 7f3ec3400640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ea4068380 0x7f3ea406a840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3ec413df80 tx=0x7f3eb4007cf0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.336 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.336+0000 7f3ebb400640 1 -- 172.21.15.106:0/1604957986 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3eb00c4060 con 0x7f3ec4143770 2024-04-26T21:16:13.494 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.492+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ec40b0ed0 con 0x7f3ec4143770 2024-04-26T21:16:13.495 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.492+0000 7f3ebb400640 1 -- 172.21.15.106:0/1604957986 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12932 (secure 0 0 0) 0x7f3eb0016110 con 0x7f3ec4143770 2024-04-26T21:16:13.496 INFO:teuthology.misc.health.smithi106.stdout: 2024-04-26T21:16:13.496 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":19,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:11.254056+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ea4068380 msgr2=0x7f3ea406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ea4068380 0x7f3ea406a840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3ec413df80 tx=0x7f3eb4007cf0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4143770 msgr2=0x7f3ec41591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4143770 0x7f3ec41591f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00ad040 tx=0x7f3eb001aca0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 shutdown_connections 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec4161200 0x7f3ec4144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ea4068380 0x7f3ea406a840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ec4143770 0x7f3ec41591f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 --2- 172.21.15.106:0/1604957986 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ec4073d30 0x7f3ec4156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.498 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 >> 172.21.15.106:0/1604957986 conn(0x7f3ec40b27d0 msgr2=0x7f3ec415b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:13.499 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 shutdown_connections 2024-04-26T21:16:13.499 INFO:teuthology.misc.health.smithi106.stderr:2024-04-26T21:16:13.496+0000 7f3eca200640 1 -- 172.21.15.106:0/1604957986 wait complete. 2024-04-26T21:16:13.514 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T21:16:13.514 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T21:16:13.515 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T21:16:13.515 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T21:16:13.518 INFO:tasks.ceph.mds.a:Started 2024-04-26T21:16:13.518 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T21:16:13.518 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T21:16:13.521 INFO:tasks.ceph.mds.c:Started 2024-04-26T21:16:13.521 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T21:16:13.521 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T21:16:13.525 INFO:tasks.ceph.mds.b:Started 2024-04-26T21:16:13.525 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T21:16:13.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T21:16:13.528 INFO:tasks.ceph.mds.d:Started 2024-04-26T21:16:13.529 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T21:16:13.529 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:13.614 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2024-04-26T21:16:13.616 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2024-04-26T21:16:13.636 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-04-26T21:16:13.637 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2024-04-26T21:16:13.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26c000640 1 Processor -- start 2024-04-26T21:16:13.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26c000640 1 -- start start 2024-04-26T21:16:13.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26c000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd26415f1c0 0x7fd2640d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26c000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2640d3310 0x7fd2640d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26c000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2640d1ca0 0x7fd2640cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26c000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fd2640d2100 con 0x7fd2640d1ca0 2024-04-26T21:16:13.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26c000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd2640d3a40 con 0x7fd26415f1c0 2024-04-26T21:16:13.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26c000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd2640d3d20 con 0x7fd2640d3310 2024-04-26T21:16:13.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd269600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd26415f1c0 0x7fd2640d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26a000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2640d1ca0 0x7fd2640cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd268c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2640d3310 0x7fd2640d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd269600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd26415f1c0 0x7fd2640d2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44358/0 (socket says 172.21.15.106:44358) 2024-04-26T21:16:13.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd269600640 1 -- 172.21.15.106:0/3220491482 learned_addr learned my addr 172.21.15.106:0/3220491482 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:13.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd269600640 1 -- 172.21.15.106:0/3220491482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2640d3310 msgr2=0x7fd2640d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:13.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd269600640 1 --2- 172.21.15.106:0/3220491482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2640d3310 0x7fd2640d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd269600640 1 -- 172.21.15.106:0/3220491482 >> v2:172.21.15.106:3300/0 conn(0x7fd2640d1ca0 msgr2=0x7fd2640cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:13.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd269600640 1 --2- 172.21.15.106:0/3220491482 >> v2:172.21.15.106:3300/0 conn(0x7fd2640d1ca0 0x7fd2640cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd269600640 1 -- 172.21.15.106:0/3220491482 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2640b4560 con 0x7fd26415f1c0 2024-04-26T21:16:13.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.672+0000 7fd26a000640 1 --2- 172.21.15.106:0/3220491482 >> v2:172.21.15.106:3300/0 conn(0x7fd2640d1ca0 0x7fd2640cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:13.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.676+0000 7fd269600640 1 --2- 172.21.15.106:0/3220491482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 0x7fd2640d2ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2640c88c0 tx=0x7fd25801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac0cdea451a946b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.676+0000 7fd263e00640 1 -- 172.21.15.106:0/3220491482 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580ab640 con 0x7fd26415f1c0 2024-04-26T21:16:13.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.676+0000 7fd263e00640 1 -- 172.21.15.106:0/3220491482 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2580b0070 con 0x7fd26415f1c0 2024-04-26T21:16:13.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.676+0000 7fd263e00640 1 -- 172.21.15.106:0/3220491482 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580aba00 con 0x7fd26415f1c0 2024-04-26T21:16:13.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 -- 172.21.15.106:0/3220491482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 msgr2=0x7fd2640d2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 --2- 172.21.15.106:0/3220491482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 0x7fd2640d2ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2640c88c0 tx=0x7fd25801c460 comp rx=0 tx=0).stop 2024-04-26T21:16:13.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 -- 172.21.15.106:0/3220491482 shutdown_connections 2024-04-26T21:16:13.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 --2- 172.21.15.106:0/3220491482 >> v2:172.21.15.106:3300/0 conn(0x7fd2640d1ca0 0x7fd2640cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 --2- 172.21.15.106:0/3220491482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2640d3310 0x7fd2640d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 --2- 172.21.15.106:0/3220491482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 0x7fd2640d2ca0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 -- 172.21.15.106:0/3220491482 >> 172.21.15.106:0/3220491482 conn(0x7fd2640d4dc0 msgr2=0x7fd2640d51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:13.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 -- 172.21.15.106:0/3220491482 shutdown_connections 2024-04-26T21:16:13.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 -- 172.21.15.106:0/3220491482 wait complete. 2024-04-26T21:16:13.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 Processor -- start 2024-04-26T21:16:13.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 -- start start 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2640d1ca0 0x7fd2640cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2640d3310 0x7fd2640cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 0x7fd2640ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd2640b4ee0 con 0x7fd2640d1ca0 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2640b4d60 con 0x7fd26415f1c0 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26c000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd2640b5060 con 0x7fd2640d3310 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd269600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2640d1ca0 0x7fd2640cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd269600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2640d1ca0 0x7fd2640cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38452/0 (socket says 172.21.15.106:38452) 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd269600640 1 -- 172.21.15.106:0/3851049996 learned_addr learned my addr 172.21.15.106:0/3851049996 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26a000640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 0x7fd2640ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd269600640 1 -- 172.21.15.106:0/3851049996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2640d3310 msgr2=0x7fd2640cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd269600640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2640d3310 0x7fd2640cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd269600640 1 -- 172.21.15.106:0/3851049996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 msgr2=0x7fd2640ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd269600640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 0x7fd2640ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd269600640 1 -- 172.21.15.106:0/3851049996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2641566c0 con 0x7fd2640d1ca0 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.680+0000 7fd26a000640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 0x7fd2640ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd269600640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2640d1ca0 0x7fd2640cbe90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd25801ab10 tx=0x7fd25801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd261600640 1 -- 172.21.15.106:0/3851049996 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580abdd0 con 0x7fd2640d1ca0 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd261600640 1 -- 172.21.15.106:0/3851049996 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2580be3f0 con 0x7fd2640d1ca0 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd261600640 1 -- 172.21.15.106:0/3851049996 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580be7e0 con 0x7fd2640d1ca0 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd264156960 con 0x7fd2640d1ca0 2024-04-26T21:16:13.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd264156f20 con 0x7fd2640d1ca0 2024-04-26T21:16:13.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd264069400 con 0x7fd2640d1ca0 2024-04-26T21:16:13.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd261600640 1 -- 172.21.15.106:0/3851049996 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2580b43f0 con 0x7fd2640d1ca0 2024-04-26T21:16:13.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd261600640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd2440683b0 0x7fd24406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd261600640 1 -- 172.21.15.106:0/3851049996 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fd258120780 con 0x7fd2640d1ca0 2024-04-26T21:16:13.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.684+0000 7fd268c00640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd2440683b0 0x7fd24406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.688+0000 7fd268c00640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd2440683b0 0x7fd24406a870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd250006aa0 tx=0x7fd250006a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.688+0000 7fd261600640 1 -- 172.21.15.106:0/3851049996 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd258016110 con 0x7fd2640d1ca0 2024-04-26T21:16:13.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.844+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd264158680 con 0x7fd2640d1ca0 2024-04-26T21:16:13.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd261600640 1 -- 172.21.15.106:0/3851049996 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12932 (secure 0 0 0) 0x7fd2580f0910 con 0x7fd2640d1ca0 2024-04-26T21:16:13.848 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:13.849 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":19,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:11.254056+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd2440683b0 msgr2=0x7fd24406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd2440683b0 0x7fd24406a870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd250006aa0 tx=0x7fd250006a30 comp rx=0 tx=0).stop 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2640d1ca0 msgr2=0x7fd2640cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2640d1ca0 0x7fd2640cbe90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd25801ab10 tx=0x7fd25801aca0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 shutdown_connections 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd26415f1c0 0x7fd2640ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd2440683b0 0x7fd24406a870 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2640d3310 0x7fd2640cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 --2- 172.21.15.106:0/3851049996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2640d1ca0 0x7fd2640cbe90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 >> 172.21.15.106:0/3851049996 conn(0x7fd2640d4dc0 msgr2=0x7fd2640b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 shutdown_connections 2024-04-26T21:16:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:13.848+0000 7fd26c000640 1 -- 172.21.15.106:0/3851049996 wait complete. 2024-04-26T21:16:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:16:13.869 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:16:14.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc47200640 1 Processor -- start 2024-04-26T21:16:14.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc47200640 1 -- start start 2024-04-26T21:16:14.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc47200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdc480cf400 0x7fdc480d3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc47200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480b38e0 0x7fdc480cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc47200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc480b20d0 con 0x7fdc4815cfb0 2024-04-26T21:16:14.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc47200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdc480d1100 con 0x7fdc480cf400 2024-04-26T21:16:14.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc47200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdc480b23f0 con 0x7fdc480b38e0 2024-04-26T21:16:14.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc45e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdc480cf400 0x7fdc480d3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc46800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480b38e0 0x7fdc480cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc45e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdc480cf400 0x7fdc480d3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44378/0 (socket says 172.21.15.106:44378) 2024-04-26T21:16:14.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc45e00640 1 -- 172.21.15.106:0/4197622312 learned_addr learned my addr 172.21.15.106:0/4197622312 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:14.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.004+0000 7fdc3d400640 1 --1- 172.21.15.106:0/4197622312 >> v1:172.21.15.112:6789/0 conn(0x7fdc4815cfb0 0x7fdc480cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:56620/0 (socket says 172.21.15.106:56620) 2024-04-26T21:16:14.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.008+0000 7fdc45e00640 1 -- 172.21.15.106:0/4197622312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480b38e0 msgr2=0x7fdc480cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:14.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.008+0000 7fdc45e00640 1 --2- 172.21.15.106:0/4197622312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480b38e0 0x7fdc480cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.008+0000 7fdc45e00640 1 -- 172.21.15.106:0/4197622312 >> v1:172.21.15.112:6789/0 conn(0x7fdc4815cfb0 legacy=0x7fdc480cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.008+0000 7fdc45e00640 1 -- 172.21.15.106:0/4197622312 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc480d13a0 con 0x7fdc480cf400 2024-04-26T21:16:14.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.008+0000 7fdc45400640 1 -- 172.21.15.106:0/4197622312 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051265327 0 0) 0x7fdc480b20d0 con 0x7fdc4815cfb0 2024-04-26T21:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.008+0000 7fdc45e00640 1 --2- 172.21.15.106:0/4197622312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480cf400 0x7fdc480d3510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009870 tx=0x7fdc3801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8738c76724b0ebd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.008+0000 7fdc45400640 1 -- 172.21.15.106:0/4197622312 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc380b1070 con 0x7fdc480cf400 2024-04-26T21:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.008+0000 7fdc45400640 1 -- 172.21.15.106:0/4197622312 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc380ac630 con 0x7fdc480cf400 2024-04-26T21:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.008+0000 7fdc45400640 1 -- 172.21.15.106:0/4197622312 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc380a8050 con 0x7fdc480cf400 2024-04-26T21:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 -- 172.21.15.106:0/4197622312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480cf400 msgr2=0x7fdc480d3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 --2- 172.21.15.106:0/4197622312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480cf400 0x7fdc480d3510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009870 tx=0x7fdc3801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 -- 172.21.15.106:0/4197622312 shutdown_connections 2024-04-26T21:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 --2- 172.21.15.106:0/4197622312 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480b38e0 0x7fdc480cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 --2- 172.21.15.106:0/4197622312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480cf400 0x7fdc480d3510 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 -- 172.21.15.106:0/4197622312 >> 172.21.15.106:0/4197622312 conn(0x7fdc480d29f0 msgr2=0x7fdc480d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 -- 172.21.15.106:0/4197622312 shutdown_connections 2024-04-26T21:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 -- 172.21.15.106:0/4197622312 wait complete. 2024-04-26T21:16:14.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 Processor -- start 2024-04-26T21:16:14.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 -- start start 2024-04-26T21:16:14.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480b38e0 0x7fdc4814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cf400 0x7fdc4806d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc4815cfb0 0x7fdc4806da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdc480ce720 con 0x7fdc4815cfb0 2024-04-26T21:16:14.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdc480ce5a0 con 0x7fdc480b38e0 2024-04-26T21:16:14.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc47200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdc480ce8a0 con 0x7fdc480cf400 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc46800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc4815cfb0 0x7fdc4806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc46800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc4815cfb0 0x7fdc4806da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38464/0 (socket says 172.21.15.106:38464) 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc3d400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cf400 0x7fdc4806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc46800640 1 -- 172.21.15.106:0/3054011961 learned_addr learned my addr 172.21.15.106:0/3054011961 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc45e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480b38e0 0x7fdc4814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc46800640 1 -- 172.21.15.106:0/3054011961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cf400 msgr2=0x7fdc4806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc46800640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cf400 0x7fdc4806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc46800640 1 -- 172.21.15.106:0/3054011961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480b38e0 msgr2=0x7fdc4814c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc46800640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480b38e0 0x7fdc4814c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc46800640 1 -- 172.21.15.106:0/3054011961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc481540d0 con 0x7fdc4815cfb0 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc45e00640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480b38e0 0x7fdc4814c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.012+0000 7fdc46800640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc4815cfb0 0x7fdc4806da50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009cb0 tx=0x7fdc4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc3ea00640 1 -- 172.21.15.106:0/3054011961 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40018020 con 0x7fdc4815cfb0 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc3ea00640 1 -- 172.21.15.106:0/3054011961 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc40014480 con 0x7fdc4815cfb0 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc3ea00640 1 -- 172.21.15.106:0/3054011961 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40014870 con 0x7fdc4815cfb0 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc481543b0 con 0x7fdc4815cfb0 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc48154970 con 0x7fdc4815cfb0 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc480506d0 con 0x7fdc4815cfb0 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc3ea00640 1 -- 172.21.15.106:0/3054011961 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdc4001b020 con 0x7fdc4815cfb0 2024-04-26T21:16:14.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc3ea00640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc24068380 0x7fdc2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc3ea00640 1 -- 172.21.15.106:0/3054011961 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fdc40087280 con 0x7fdc4815cfb0 2024-04-26T21:16:14.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc45e00640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc24068380 0x7fdc2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.016+0000 7fdc45e00640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc24068380 0x7fdc2406a840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc380ae000 tx=0x7fdc38009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.020+0000 7fdc3ea00640 1 -- 172.21.15.106:0/3054011961 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdc40022020 con 0x7fdc4815cfb0 2024-04-26T21:16:14.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.176+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdc480b8880 con 0x7fdc4815cfb0 2024-04-26T21:16:14.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.176+0000 7fdc3ea00640 1 -- 172.21.15.106:0/3054011961 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7fdc40010040 con 0x7fdc4815cfb0 2024-04-26T21:16:14.180 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:16:14.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc24068380 msgr2=0x7fdc2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc24068380 0x7fdc2406a840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc380ae000 tx=0x7fdc38009040 comp rx=0 tx=0).stop 2024-04-26T21:16:14.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc4815cfb0 msgr2=0x7fdc4806da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc4815cfb0 0x7fdc4806da50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009cb0 tx=0x7fdc4000c490 comp rx=0 tx=0).stop 2024-04-26T21:16:14.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 shutdown_connections 2024-04-26T21:16:14.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc24068380 0x7fdc2406a840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc4815cfb0 0x7fdc4806da50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc480cf400 0x7fdc4806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 --2- 172.21.15.106:0/3054011961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc480b38e0 0x7fdc4814c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 >> 172.21.15.106:0/3054011961 conn(0x7fdc480d29f0 msgr2=0x7fdc480afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:14.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 shutdown_connections 2024-04-26T21:16:14.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.180+0000 7fdc47200640 1 -- 172.21.15.106:0/3054011961 wait complete. 2024-04-26T21:16:14.201 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:16:14.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa37e00640 1 Processor -- start 2024-04-26T21:16:14.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa37e00640 1 -- start start 2024-04-26T21:16:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa37e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa3815f5a0 0x7faa380710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa37e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faa3815f980 0x7faa380d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa37e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa38070030 con 0x7faa380d1e30 2024-04-26T21:16:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa37e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7faa38070310 con 0x7faa3815f980 2024-04-26T21:16:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa37e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faa380705f0 con 0x7faa3815f5a0 2024-04-26T21:16:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa36000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faa3815f980 0x7faa380d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa36000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faa3815f980 0x7faa380d18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38470/0 (socket says 172.21.15.106:38470) 2024-04-26T21:16:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa36000640 1 -- 172.21.15.106:0/1386056441 learned_addr learned my addr 172.21.15.106:0/1386056441 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa36a00640 1 --2- 172.21.15.106:0/1386056441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa3815f5a0 0x7faa380710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa36000640 1 -- 172.21.15.106:0/1386056441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa3815f5a0 msgr2=0x7faa380710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:14.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa36000640 1 --2- 172.21.15.106:0/1386056441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa3815f5a0 0x7faa380710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa36000640 1 -- 172.21.15.106:0/1386056441 >> v1:172.21.15.112:6789/0 conn(0x7faa380d1e30 legacy=0x7faa38162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa36000640 1 -- 172.21.15.106:0/1386056441 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa380708d0 con 0x7faa3815f980 2024-04-26T21:16:14.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.336+0000 7faa35600640 1 -- 172.21.15.106:0/1386056441 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2888215296 0 0) 0x7faa38070030 con 0x7faa380d1e30 2024-04-26T21:16:14.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa36000640 1 --2- 172.21.15.106:0/1386056441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f980 0x7faa380d18f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa24009870 tx=0x7faa2401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481209a610280c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa35600640 1 -- 172.21.15.106:0/1386056441 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa240b0070 con 0x7faa3815f980 2024-04-26T21:16:14.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa35600640 1 -- 172.21.15.106:0/1386056441 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa240ab600 con 0x7faa3815f980 2024-04-26T21:16:14.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa35600640 1 -- 172.21.15.106:0/1386056441 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa240ab9d0 con 0x7faa3815f980 2024-04-26T21:16:14.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa37e00640 1 -- 172.21.15.106:0/1386056441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f980 msgr2=0x7faa380d18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa37e00640 1 --2- 172.21.15.106:0/1386056441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f980 0x7faa380d18f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa24009870 tx=0x7faa2401c4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa37e00640 1 -- 172.21.15.106:0/1386056441 shutdown_connections 2024-04-26T21:16:14.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa37e00640 1 --2- 172.21.15.106:0/1386056441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f980 0x7faa380d18f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa37e00640 1 --2- 172.21.15.106:0/1386056441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa3815f5a0 0x7faa380710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa37e00640 1 -- 172.21.15.106:0/1386056441 >> 172.21.15.106:0/1386056441 conn(0x7faa380b46f0 msgr2=0x7faa380b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:14.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa37e00640 1 -- 172.21.15.106:0/1386056441 shutdown_connections 2024-04-26T21:16:14.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa37e00640 1 -- 172.21.15.106:0/1386056441 wait complete. 2024-04-26T21:16:14.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.340+0000 7faa37e00640 1 Processor -- start 2024-04-26T21:16:14.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 -- start start 2024-04-26T21:16:14.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa380d1e30 0x7faa38158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f5a0 0x7faa38157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa3815f980 0x7faa3815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faa3816c000 con 0x7faa3815f5a0 2024-04-26T21:16:14.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa3816be80 con 0x7faa3815f980 2024-04-26T21:16:14.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faa3816c180 con 0x7faa380d1e30 2024-04-26T21:16:14.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f5a0 0x7faa38157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f5a0 0x7faa38157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38478/0 (socket says 172.21.15.106:38478) 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36000640 1 -- 172.21.15.106:0/1990074701 learned_addr learned my addr 172.21.15.106:0/1990074701 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36a00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa380d1e30 0x7faa38158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37400640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa3815f980 0x7faa3815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36000640 1 -- 172.21.15.106:0/1990074701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa380d1e30 msgr2=0x7faa38158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36000640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa380d1e30 0x7faa38158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36000640 1 -- 172.21.15.106:0/1990074701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa3815f980 msgr2=0x7faa3815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36000640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa3815f980 0x7faa3815c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36000640 1 -- 172.21.15.106:0/1990074701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa38158c70 con 0x7faa3815f5a0 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa36000640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f5a0 0x7faa38157e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa240ae040 tx=0x7faa24019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa2ea00640 1 -- 172.21.15.106:0/1990074701 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa240b0040 con 0x7faa3815f5a0 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa2ea00640 1 -- 172.21.15.106:0/1990074701 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa240b4420 con 0x7faa3815f5a0 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa38158f50 con 0x7faa3815f5a0 2024-04-26T21:16:14.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa2ea00640 1 -- 172.21.15.106:0/1990074701 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa240b4810 con 0x7faa3815f5a0 2024-04-26T21:16:14.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa38159510 con 0x7faa3815f5a0 2024-04-26T21:16:14.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.344+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa38158360 con 0x7faa3815f5a0 2024-04-26T21:16:14.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.348+0000 7faa2ea00640 1 -- 172.21.15.106:0/1990074701 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa240b49b0 con 0x7faa3815f5a0 2024-04-26T21:16:14.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.348+0000 7faa2ea00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa18068380 0x7faa1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.348+0000 7faa2ea00640 1 -- 172.21.15.106:0/1990074701 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7faa2411fff0 con 0x7faa3815f5a0 2024-04-26T21:16:14.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.348+0000 7faa36a00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa18068380 0x7faa1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.348+0000 7faa36a00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa18068380 0x7faa1806a840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa28009b60 tx=0x7faa28009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.352+0000 7faa2ea00640 1 -- 172.21.15.106:0/1990074701 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faa24016150 con 0x7faa3815f5a0 2024-04-26T21:16:14.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.540+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa38071600 con 0x7faa3815f5a0 2024-04-26T21:16:14.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.540+0000 7faa2ea00640 1 -- 172.21.15.106:0/1990074701 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7faa240f0300 con 0x7faa3815f5a0 2024-04-26T21:16:14.544 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:14.544 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T21:16:14.544 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 2 2024-04-26T21:16:14.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa18068380 msgr2=0x7faa1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa18068380 0x7faa1806a840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa28009b60 tx=0x7faa28009190 comp rx=0 tx=0).stop 2024-04-26T21:16:14.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f5a0 msgr2=0x7faa38157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f5a0 0x7faa38157e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa240ae040 tx=0x7faa24019240 comp rx=0 tx=0).stop 2024-04-26T21:16:14.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 shutdown_connections 2024-04-26T21:16:14.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa3815f980 0x7faa3815c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa18068380 0x7faa1806a840 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3815f5a0 0x7faa38157e20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 --2- 172.21.15.106:0/1990074701 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa380d1e30 0x7faa38158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 >> 172.21.15.106:0/1990074701 conn(0x7faa380b46f0 msgr2=0x7faa380b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:14.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 shutdown_connections 2024-04-26T21:16:14.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:14.544+0000 7faa37e00640 1 -- 172.21.15.106:0/1990074701 wait complete. 2024-04-26T21:16:16.565 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:16:16.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f959aa00640 1 Processor -- start 2024-04-26T21:16:16.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f959aa00640 1 -- start start 2024-04-26T21:16:16.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f959aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95940d01c0 0x7f95940b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:16.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f959aa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95940d1840 con 0x7f95940cfd40 2024-04-26T21:16:16.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f959aa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95940b2250 con 0x7f959415d060 2024-04-26T21:16:16.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f959aa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f95940b25a0 con 0x7f95940d01c0 2024-04-26T21:16:16.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9593400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f95940cfd40 0x7f95940b2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44316/0 (socket says 172.21.15.106:44316) 2024-04-26T21:16:16.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9593400640 1 -- 172.21.15.106:0/4260213105 learned_addr learned my addr 172.21.15.106:0/4260213105 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:16.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9598a00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95940d01c0 0x7f95940b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:16.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156537380 0 0) 0x7f957c001120 con 0x7f95940cfd40 2024-04-26T21:16:16.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9578003530 con 0x7f95940cfd40 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2657869048 0 0) 0x7f9578003530 con 0x7f95940cfd40 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95940d01c0 msgr2=0x7f95940b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9592a00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95940d01c0 0x7f95940b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 >> v1:172.21.15.112:6789/0 conn(0x7f959415d060 legacy=0x7f95940cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95940ce660 con 0x7f95940cfd40 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f957c001850 con 0x7f95940cfd40 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.708+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 >> v1:172.21.15.106:6789/0 conn(0x7f95940cfd40 legacy=0x7f95940b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9592a00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95780039f0 0x7f9578003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9592a00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780043a0 0x7f9578004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9592a00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95940d01c0 0x7f95780050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f95940b25a0 con 0x7f95780039f0 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f957800b9d0 con 0x7f95780043a0 2024-04-26T21:16:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f957800bbd0 con 0x7f95940d01c0 2024-04-26T21:16:16.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9593e00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95780039f0 0x7f9578003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:16.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9593400640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780043a0 0x7f9578004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:16.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9598a00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95940d01c0 0x7f95780050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:16.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9593e00640 1 -- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95940d01c0 msgr2=0x7f95780050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:16.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9593e00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f95940d01c0 0x7f95780050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9593e00640 1 -- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780043a0 msgr2=0x7f9578004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:16.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9593e00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780043a0 0x7f9578004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9593e00640 1 -- 172.21.15.106:0/4260213105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9578003530 con 0x7f95780039f0 2024-04-26T21:16:16.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9593400640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780043a0 0x7f9578004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:16.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9593e00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95780039f0 0x7f9578003dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9584001860 tx=0x7f958401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4366ececa6fecd99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584001460 con 0x7f95780039f0 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95840b0070 con 0x7f95780039f0 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.712+0000 7f9592a00640 1 -- 172.21.15.106:0/4260213105 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840ab840 con 0x7f95780039f0 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 -- 172.21.15.106:0/4260213105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95780039f0 msgr2=0x7f9578003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 --2- 172.21.15.106:0/4260213105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95780039f0 0x7f9578003dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9584001860 tx=0x7f958401c520 comp rx=0 tx=0).stop 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9598a00640 1 -- 172.21.15.106:0/4260213105 reap_dead start 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 -- 172.21.15.106:0/4260213105 shutdown_connections 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 -- 172.21.15.106:0/4260213105 >> 172.21.15.106:0/4260213105 conn(0x7f95940d2c60 msgr2=0x7f95940d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 -- 172.21.15.106:0/4260213105 shutdown_connections 2024-04-26T21:16:16.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 -- 172.21.15.106:0/4260213105 wait complete. 2024-04-26T21:16:16.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 Processor -- start 2024-04-26T21:16:16.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 -- start start 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780039f0 0x7f959415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95940cc810 0x7f95940c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9594146f00 0x7f9594158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f95940ce400 con 0x7f95940cc810 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f95940ce280 con 0x7f95780039f0 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f959aa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f95940b3950 con 0x7f9594146f00 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95940cc810 0x7f95940c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95940cc810 0x7f95940c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38488/0 (socket says 172.21.15.106:38488) 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593400640 1 -- 172.21.15.106:0/2165949729 learned_addr learned my addr 172.21.15.106:0/2165949729 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593e00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780039f0 0x7f959415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9598a00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9594146f00 0x7f9594158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593400640 1 -- 172.21.15.106:0/2165949729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9594146f00 msgr2=0x7f9594158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:16.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593400640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9594146f00 0x7f9594158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593400640 1 -- 172.21.15.106:0/2165949729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780039f0 msgr2=0x7f959415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593400640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780039f0 0x7f959415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593400640 1 -- 172.21.15.106:0/2165949729 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95940ca270 con 0x7f95940cc810 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593e00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780039f0 0x7f959415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.716+0000 7f9593400640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95940cc810 0x7f95940c9d30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f957c00e7e0 tx=0x7f957c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f958be00640 1 -- 172.21.15.106:0/2165949729 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c00ee90 con 0x7f95940cc810 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f958be00640 1 -- 172.21.15.106:0/2165949729 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c018070 con 0x7f95940cc810 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f958be00640 1 -- 172.21.15.106:0/2165949729 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c00ca70 con 0x7f95940cc810 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95940cba50 con 0x7f95940cc810 2024-04-26T21:16:16.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95940cc010 con 0x7f95940cc810 2024-04-26T21:16:16.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9594069400 con 0x7f95940cc810 2024-04-26T21:16:16.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f958be00640 1 -- 172.21.15.106:0/2165949729 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f957c00cc10 con 0x7f95940cc810 2024-04-26T21:16:16.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f958be00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9570068520 0x7f957006a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:16.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f958be00640 1 -- 172.21.15.106:0/2165949729 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f957c086460 con 0x7f95940cc810 2024-04-26T21:16:16.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f9593e00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9570068520 0x7f957006a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:16.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.720+0000 7f9593e00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9570068520 0x7f957006a9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9584001860 tx=0x7f95840a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:16.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.724+0000 7f958be00640 1 -- 172.21.15.106:0/2165949729 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f95940d1840 con 0x7f95940cc810 2024-04-26T21:16:16.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95940b3ce0 con 0x7f95940cc810 2024-04-26T21:16:16.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f958be00640 1 -- 172.21.15.106:0/2165949729 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7f957c056d60 con 0x7f95940cc810 2024-04-26T21:16:16.918 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:16.918 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T21:16:16.918 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 3 2024-04-26T21:16:16.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9570068520 msgr2=0x7f957006a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:16.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9570068520 0x7f957006a9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9584001860 tx=0x7f95840a7000 comp rx=0 tx=0).stop 2024-04-26T21:16:16.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95940cc810 msgr2=0x7f95940c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95940cc810 0x7f95940c9d30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f957c00e7e0 tx=0x7f957c00eca0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 shutdown_connections 2024-04-26T21:16:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9570068520 0x7f957006a9e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9594146f00 0x7f9594158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95940cc810 0x7f95940c9d30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 --2- 172.21.15.106:0/2165949729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95780039f0 0x7f959415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 >> 172.21.15.106:0/2165949729 conn(0x7f95940d2c60 msgr2=0x7f95940cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 shutdown_connections 2024-04-26T21:16:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:16.916+0000 7f959aa00640 1 -- 172.21.15.106:0/2165949729 wait complete. 2024-04-26T21:16:16.940 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:17.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.072+0000 7fa8c7200640 1 Processor -- start 2024-04-26T21:16:17.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.072+0000 7fa8c7200640 1 -- start start 2024-04-26T21:16:17.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 0x7fa8c006c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c7200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c01605e0 con 0x7fa8c006f260 2024-04-26T21:16:17.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c7200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c006ce80 con 0x7fa8c006c940 2024-04-26T21:16:17.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c7200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c00cc300 con 0x7fa8c0160200 2024-04-26T21:16:17.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c6800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa8c006f260 0x7fa8c00cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54038/0 (socket says 172.21.15.106:54038) 2024-04-26T21:16:17.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c6800640 1 -- 172.21.15.106:0/3649125825 learned_addr learned my addr 172.21.15.106:0/3649125825 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:17.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c5e00640 1 --2- 172.21.15.106:0/3649125825 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 0x7fa8c006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c4a00640 1 -- 172.21.15.106:0/3649125825 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766979003 0 0) 0x7fa8c01605e0 con 0x7fa8c006f260 2024-04-26T21:16:17.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c4a00640 1 -- 172.21.15.106:0/3649125825 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a8003530 con 0x7fa8c006f260 2024-04-26T21:16:17.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c4a00640 1 -- 172.21.15.106:0/3649125825 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 442300251 0 0) 0x7fa8c006ce80 con 0x7fa8c006c940 2024-04-26T21:16:17.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c4a00640 1 -- 172.21.15.106:0/3649125825 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c01605e0 con 0x7fa8c006c940 2024-04-26T21:16:17.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c5e00640 1 -- 172.21.15.106:0/3649125825 >> v1:172.21.15.112:6789/0 conn(0x7fa8c006c940 legacy=0x7fa8c006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c5e00640 1 -- 172.21.15.106:0/3649125825 >> v1:172.21.15.106:6789/0 conn(0x7fa8c006f260 legacy=0x7fa8c00cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.076+0000 7fa8c5e00640 1 -- 172.21.15.106:0/3649125825 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c00cc5e0 con 0x7fa8c0160200 2024-04-26T21:16:17.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c5e00640 1 --2- 172.21.15.106:0/3649125825 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 0x7fa8c006c400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40097f0 tx=0x7fa8b401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66f0211fa25e6370 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:17.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c4a00640 1 -- 172.21.15.106:0/3649125825 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40ab620 con 0x7fa8c0160200 2024-04-26T21:16:17.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c4a00640 1 -- 172.21.15.106:0/3649125825 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b40b0070 con 0x7fa8c0160200 2024-04-26T21:16:17.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c4a00640 1 -- 172.21.15.106:0/3649125825 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40ab9e0 con 0x7fa8c0160200 2024-04-26T21:16:17.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 -- 172.21.15.106:0/3649125825 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 msgr2=0x7fa8c006c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 --2- 172.21.15.106:0/3649125825 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 0x7fa8c006c400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40097f0 tx=0x7fa8b401c420 comp rx=0 tx=0).stop 2024-04-26T21:16:17.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 -- 172.21.15.106:0/3649125825 shutdown_connections 2024-04-26T21:16:17.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 --2- 172.21.15.106:0/3649125825 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 0x7fa8c006c400 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 -- 172.21.15.106:0/3649125825 >> 172.21.15.106:0/3649125825 conn(0x7fa8c00d1970 msgr2=0x7fa8c00d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:17.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 -- 172.21.15.106:0/3649125825 shutdown_connections 2024-04-26T21:16:17.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 -- 172.21.15.106:0/3649125825 wait complete. 2024-04-26T21:16:17.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 Processor -- start 2024-04-26T21:16:17.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 -- start start 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8c006c940 0x7fa8c00cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c006f260 0x7fa8c00b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 0x7fa8c0150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c016a8c0 con 0x7fa8c006f260 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c00b0c80 con 0x7fa8c006c940 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.080+0000 7fa8c7200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c016aa40 con 0x7fa8c0160200 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c006f260 0x7fa8c00b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c006f260 0x7fa8c00b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35534/0 (socket says 172.21.15.106:35534) 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5400640 1 -- 172.21.15.106:0/335761569 learned_addr learned my addr 172.21.15.106:0/335761569 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:17.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5e00640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8c006c940 0x7fa8c00cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c6800640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 0x7fa8c0150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5400640 1 -- 172.21.15.106:0/335761569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 msgr2=0x7fa8c0150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5400640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 0x7fa8c0150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5400640 1 -- 172.21.15.106:0/335761569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8c006c940 msgr2=0x7fa8c00cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5400640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8c006c940 0x7fa8c00cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5400640 1 -- 172.21.15.106:0/335761569 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c00cfc90 con 0x7fa8c006f260 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c5400640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c006f260 0x7fa8c00b69b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000c500 tx=0x7fa8b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8ba000640 1 -- 172.21.15.106:0/335761569 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00052d0 con 0x7fa8c006f260 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8ba000640 1 -- 172.21.15.106:0/335761569 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b0005490 con 0x7fa8c006f260 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c00cff70 con 0x7fa8c006f260 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8ba000640 1 -- 172.21.15.106:0/335761569 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0012850 con 0x7fa8c006f260 2024-04-26T21:16:17.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c00c64a0 con 0x7fa8c006f260 2024-04-26T21:16:17.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c0069400 con 0x7fa8c006f260 2024-04-26T21:16:17.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8ba000640 1 -- 172.21.15.106:0/335761569 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8b00129f0 con 0x7fa8c006f260 2024-04-26T21:16:17.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.084+0000 7fa8ba000640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8a4068380 0x7fa8a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.088+0000 7fa8ba000640 1 -- 172.21.15.106:0/335761569 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fa8b0086230 con 0x7fa8c006f260 2024-04-26T21:16:17.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.088+0000 7fa8c5e00640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8a4068380 0x7fa8a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.088+0000 7fa8c5e00640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8a4068380 0x7fa8a406a840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40af000 tx=0x7fa8b40b6040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:17.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.092+0000 7fa8ba000640 1 -- 172.21.15.106:0/335761569 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa8b0056500 con 0x7fa8c006f260 2024-04-26T21:16:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.248+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8c006db80 con 0x7fa8c006f260 2024-04-26T21:16:17.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8ba000640 1 -- 172.21.15.106:0/335761569 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12932 (secure 0 0 0) 0x7fa8b005a800 con 0x7fa8c006f260 2024-04-26T21:16:17.253 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:17.253 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":19,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:11.254056+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:17.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8a4068380 msgr2=0x7fa8a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8a4068380 0x7fa8a406a840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40af000 tx=0x7fa8b40b6040 comp rx=0 tx=0).stop 2024-04-26T21:16:17.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c006f260 msgr2=0x7fa8c00b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c006f260 0x7fa8c00b69b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000c500 tx=0x7fa8b000c9c0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 shutdown_connections 2024-04-26T21:16:17.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8a4068380 0x7fa8a406a840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8c0160200 0x7fa8c0150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c006f260 0x7fa8c00b69b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 --2- 172.21.15.106:0/335761569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8c006c940 0x7fa8c00cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 >> 172.21.15.106:0/335761569 conn(0x7fa8c00d1970 msgr2=0x7fa8c00b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 shutdown_connections 2024-04-26T21:16:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.252+0000 7fa8c7200640 1 -- 172.21.15.106:0/335761569 wait complete. 2024-04-26T21:16:17.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:16:17.274 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:16:17.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4523a00640 1 Processor -- start 2024-04-26T21:16:17.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4523a00640 1 -- start start 2024-04-26T21:16:17.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4523a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f451c15d530 0x7f451c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4523a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451c0b44a0 con 0x7f451c15e020 2024-04-26T21:16:17.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4523a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451c0b4780 con 0x7f451c0b5260 2024-04-26T21:16:17.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4523a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f451c0b4a60 con 0x7f451c15d530 2024-04-26T21:16:17.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4521000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f451c15d530 0x7f451c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4521a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f451c15e020 0x7f451c166ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54042/0 (socket says 172.21.15.106:54042) 2024-04-26T21:16:17.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4521a00640 1 -- 172.21.15.106:0/17717947 learned_addr learned my addr 172.21.15.106:0/17717947 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:17.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4521000640 1 -- 172.21.15.106:0/17717947 >> v1:172.21.15.112:6789/0 conn(0x7f451c0b5260 legacy=0x7f451c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4521000640 1 -- 172.21.15.106:0/17717947 >> v1:172.21.15.106:6789/0 conn(0x7f451c15e020 legacy=0x7f451c166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f4521000640 1 -- 172.21.15.106:0/17717947 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c0b4d40 con 0x7f451c15d530 2024-04-26T21:16:17.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.412+0000 7f451b400640 1 -- 172.21.15.106:0/17717947 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529509238 0 0) 0x7f451c0b44a0 con 0x7f451c15e020 2024-04-26T21:16:17.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f4521000640 1 --2- 172.21.15.106:0/17717947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c15d530 0x7f451c0cfe20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f450c0097c0 tx=0x7f450c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bbdc41cc04286b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:17.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f451b400640 1 -- 172.21.15.106:0/17717947 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c0b1070 con 0x7f451c15d530 2024-04-26T21:16:17.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f451b400640 1 -- 172.21.15.106:0/17717947 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c0ac410 con 0x7f451c15d530 2024-04-26T21:16:17.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f451b400640 1 -- 172.21.15.106:0/17717947 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c0ac7e0 con 0x7f451c15d530 2024-04-26T21:16:17.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f4523a00640 1 -- 172.21.15.106:0/17717947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c15d530 msgr2=0x7f451c0cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f4523a00640 1 --2- 172.21.15.106:0/17717947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c15d530 0x7f451c0cfe20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f450c0097c0 tx=0x7f450c01c4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f4523a00640 1 -- 172.21.15.106:0/17717947 shutdown_connections 2024-04-26T21:16:17.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f4523a00640 1 --2- 172.21.15.106:0/17717947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c15d530 0x7f451c0cfe20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f4523a00640 1 -- 172.21.15.106:0/17717947 >> 172.21.15.106:0/17717947 conn(0x7f451c0b2910 msgr2=0x7f451c0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:17.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f4523a00640 1 -- 172.21.15.106:0/17717947 shutdown_connections 2024-04-26T21:16:17.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.416+0000 7f4523a00640 1 -- 172.21.15.106:0/17717947 wait complete. 2024-04-26T21:16:17.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 Processor -- start 2024-04-26T21:16:17.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 -- start start 2024-04-26T21:16:17.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c0b5260 0x7f451c15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f451c15d530 0x7f451c15f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f451c15e020 0x7f451c141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f451c16adb0 con 0x7f451c0b5260 2024-04-26T21:16:17.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f451c16ac30 con 0x7f451c15e020 2024-04-26T21:16:17.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f451c16af30 con 0x7f451c15d530 2024-04-26T21:16:17.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c0b5260 0x7f451c15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c0b5260 0x7f451c15c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35552/0 (socket says 172.21.15.106:35552) 2024-04-26T21:16:17.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521000640 1 -- 172.21.15.106:0/2638613876 learned_addr learned my addr 172.21.15.106:0/2638613876 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521a00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f451c15e020 0x7f451c141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f451be00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f451c15d530 0x7f451c15f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521000640 1 -- 172.21.15.106:0/2638613876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f451c15d530 msgr2=0x7f451c15f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521000640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f451c15d530 0x7f451c15f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521000640 1 -- 172.21.15.106:0/2638613876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f451c15e020 msgr2=0x7f451c141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521000640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f451c15e020 0x7f451c141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521000640 1 -- 172.21.15.106:0/2638613876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c15ffe0 con 0x7f451c0b5260 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521a00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f451c15e020 0x7f451c141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4521000640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c0b5260 0x7f451c15c7c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f450c0190b0 tx=0x7f450c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4518c00640 1 -- 172.21.15.106:0/2638613876 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c0b9070 con 0x7f451c0b5260 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4518c00640 1 -- 172.21.15.106:0/2638613876 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c0ace40 con 0x7f451c0b5260 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4518c00640 1 -- 172.21.15.106:0/2638613876 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c0b1040 con 0x7f451c0b5260 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451c1602c0 con 0x7f451c0b5260 2024-04-26T21:16:17.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451c15cd00 con 0x7f451c0b5260 2024-04-26T21:16:17.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.420+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f451c069400 con 0x7f451c0b5260 2024-04-26T21:16:17.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.424+0000 7f4518c00640 1 -- 172.21.15.106:0/2638613876 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f450c0bc070 con 0x7f451c0b5260 2024-04-26T21:16:17.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.424+0000 7f4518c00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f44fc068380 0x7f44fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.424+0000 7f4518c00640 1 -- 172.21.15.106:0/2638613876 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f450c120330 con 0x7f451c0b5260 2024-04-26T21:16:17.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.424+0000 7f451be00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f44fc068380 0x7f44fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.424+0000 7f451be00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f44fc068380 0x7f44fc06a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f451c0740b0 tx=0x7f4508009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:17.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.428+0000 7f4518c00640 1 -- 172.21.15.106:0/2638613876 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f450c016090 con 0x7f451c0b5260 2024-04-26T21:16:17.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.584+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f451c160490 con 0x7f451c0b5260 2024-04-26T21:16:17.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.584+0000 7f4518c00640 1 -- 172.21.15.106:0/2638613876 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f450c0f0c30 con 0x7f451c0b5260 2024-04-26T21:16:17.588 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f44fc068380 msgr2=0x7f44fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f44fc068380 0x7f44fc06a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f451c0740b0 tx=0x7f4508009040 comp rx=0 tx=0).stop 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c0b5260 msgr2=0x7f451c15c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c0b5260 0x7f451c15c7c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f450c0190b0 tx=0x7f450c019240 comp rx=0 tx=0).stop 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 shutdown_connections 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f451c15e020 0x7f451c141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f44fc068380 0x7f44fc06a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f451c15d530 0x7f451c15f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 --2- 172.21.15.106:0/2638613876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c0b5260 0x7f451c15c7c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 >> 172.21.15.106:0/2638613876 conn(0x7f451c0b2910 msgr2=0x7f451c0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 shutdown_connections 2024-04-26T21:16:17.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.588+0000 7f4523a00640 1 -- 172.21.15.106:0/2638613876 wait complete. 2024-04-26T21:16:17.609 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T21:16:17.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.740+0000 7fb631a00640 1 Processor -- start 2024-04-26T21:16:17.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.740+0000 7fb631a00640 1 -- start start 2024-04-26T21:16:17.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb631a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb62c1624a0 0x7fb62c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb631a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb62c0b55e0 con 0x7fb62c0aeae0 2024-04-26T21:16:17.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb631a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb62c0b58c0 con 0x7fb62c0b39f0 2024-04-26T21:16:17.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb631a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fb62c0b5ba0 con 0x7fb62c1624a0 2024-04-26T21:16:17.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb62aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb62c1624a0 0x7fb62c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb622000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb62c0aeae0 0x7fb62c0b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54056/0 (socket says 172.21.15.106:54056) 2024-04-26T21:16:17.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb622000640 1 -- 172.21.15.106:0/2998422343 learned_addr learned my addr 172.21.15.106:0/2998422343 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:17.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb62aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb62c1624a0 0x7fb62c0b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35566/0 (socket says 172.21.15.106:35566) 2024-04-26T21:16:17.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb62aa00640 1 -- 172.21.15.106:0/2998422343 >> v1:172.21.15.112:6789/0 conn(0x7fb62c0b39f0 legacy=0x7fb62c06f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb62aa00640 1 -- 172.21.15.106:0/2998422343 >> v1:172.21.15.106:6789/0 conn(0x7fb62c0aeae0 legacy=0x7fb62c0b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb62aa00640 1 -- 172.21.15.106:0/2998422343 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c06e810 con 0x7fb62c1624a0 2024-04-26T21:16:17.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.744+0000 7fb62a000640 1 -- 172.21.15.106:0/2998422343 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480669505 0 0) 0x7fb62c0b55e0 con 0x7fb62c0aeae0 2024-04-26T21:16:17.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb62aa00640 1 --2- 172.21.15.106:0/2998422343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c1624a0 0x7fb62c0b4d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0097c0 tx=0x7fb61c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcab194897697f6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:17.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb62a000640 1 -- 172.21.15.106:0/2998422343 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0ab430 con 0x7fb62c1624a0 2024-04-26T21:16:17.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb62a000640 1 -- 172.21.15.106:0/2998422343 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb61c0b0070 con 0x7fb62c1624a0 2024-04-26T21:16:17.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb62a000640 1 -- 172.21.15.106:0/2998422343 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0ab7f0 con 0x7fb62c1624a0 2024-04-26T21:16:17.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 -- 172.21.15.106:0/2998422343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c1624a0 msgr2=0x7fb62c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 --2- 172.21.15.106:0/2998422343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c1624a0 0x7fb62c0b4d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0097c0 tx=0x7fb61c01c470 comp rx=0 tx=0).stop 2024-04-26T21:16:17.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 -- 172.21.15.106:0/2998422343 shutdown_connections 2024-04-26T21:16:17.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 --2- 172.21.15.106:0/2998422343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c1624a0 0x7fb62c0b4d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 -- 172.21.15.106:0/2998422343 >> 172.21.15.106:0/2998422343 conn(0x7fb62c06c5d0 msgr2=0x7fb62c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:17.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 -- 172.21.15.106:0/2998422343 shutdown_connections 2024-04-26T21:16:17.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 -- 172.21.15.106:0/2998422343 wait complete. 2024-04-26T21:16:17.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 Processor -- start 2024-04-26T21:16:17.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 -- start start 2024-04-26T21:16:17.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c0aeae0 0x7fb62c14aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb62c0b39f0 0x7fb62c148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62c1624a0 0x7fb62c14b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c0700b0 con 0x7fb62c0aeae0 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c06ff30 con 0x7fb62c1624a0 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.748+0000 7fb631a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb62c070230 con 0x7fb62c0b39f0 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c0aeae0 0x7fb62c14aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c0aeae0 0x7fb62c14aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35582/0 (socket says 172.21.15.106:35582) 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62aa00640 1 -- 172.21.15.106:0/55124843 learned_addr learned my addr 172.21.15.106:0/55124843 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb622000640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb62c0b39f0 0x7fb62c148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62b400640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62c1624a0 0x7fb62c14b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62aa00640 1 -- 172.21.15.106:0/55124843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb62c0b39f0 msgr2=0x7fb62c148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62aa00640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb62c0b39f0 0x7fb62c148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62aa00640 1 -- 172.21.15.106:0/55124843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62c1624a0 msgr2=0x7fb62c14b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62aa00640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62c1624a0 0x7fb62c14b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62aa00640 1 -- 172.21.15.106:0/55124843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c149120 con 0x7fb62c0aeae0 2024-04-26T21:16:17.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb62aa00640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c0aeae0 0x7fb62c14aa60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb61c019080 tx=0x7fb61c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:17.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb623400640 1 -- 172.21.15.106:0/55124843 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0bf610 con 0x7fb62c0aeae0 2024-04-26T21:16:17.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb623400640 1 -- 172.21.15.106:0/55124843 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb61c0bf7b0 con 0x7fb62c0aeae0 2024-04-26T21:16:17.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb623400640 1 -- 172.21.15.106:0/55124843 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0bfba0 con 0x7fb62c0aeae0 2024-04-26T21:16:17.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62c1493c0 con 0x7fb62c0aeae0 2024-04-26T21:16:17.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb62c149980 con 0x7fb62c0aeae0 2024-04-26T21:16:17.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62c069400 con 0x7fb62c0aeae0 2024-04-26T21:16:17.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb623400640 1 -- 172.21.15.106:0/55124843 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb61c0bd020 con 0x7fb62c0aeae0 2024-04-26T21:16:17.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb623400640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb608068380 0x7fb60806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:17.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.752+0000 7fb623400640 1 -- 172.21.15.106:0/55124843 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fb61c0a8030 con 0x7fb62c0aeae0 2024-04-26T21:16:17.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.756+0000 7fb622000640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb608068380 0x7fb60806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:17.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.756+0000 7fb622000640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb608068380 0x7fb60806a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb62c148b10 tx=0x7fb614007d10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:17.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.756+0000 7fb623400640 1 -- 172.21.15.106:0/55124843 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb61c0c4060 con 0x7fb62c0aeae0 2024-04-26T21:16:17.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb62c0b2ae0 con 0x7fb62c0aeae0 2024-04-26T21:16:17.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb623400640 1 -- 172.21.15.106:0/55124843 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fb61c016090 con 0x7fb62c0aeae0 2024-04-26T21:16:17.918 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:17.918 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2024-04-26T21:16:17.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:16:17.918 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2024-04-26T21:16:17.918 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2024-04-26T21:16:17.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:16:17.918 INFO:teuthology.orchestra.run.smithi106.stdout:] 2024-04-26T21:16:17.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb608068380 msgr2=0x7fb60806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb608068380 0x7fb60806a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb62c148b10 tx=0x7fb614007d10 comp rx=0 tx=0).stop 2024-04-26T21:16:17.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c0aeae0 msgr2=0x7fb62c14aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:17.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c0aeae0 0x7fb62c14aa60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb61c019080 tx=0x7fb61c01acb0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 shutdown_connections 2024-04-26T21:16:17.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb62c1624a0 0x7fb62c14b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb608068380 0x7fb60806a840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb62c0b39f0 0x7fb62c148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 --2- 172.21.15.106:0/55124843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb62c0aeae0 0x7fb62c14aa60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:17.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 >> 172.21.15.106:0/55124843 conn(0x7fb62c06c5d0 msgr2=0x7fb62c0b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:17.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 shutdown_connections 2024-04-26T21:16:17.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:17.916+0000 7fb631a00640 1 -- 172.21.15.106:0/55124843 wait complete. 2024-04-26T21:16:17.939 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T21:16:17.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T21:16:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27db000640 1 Processor -- start 2024-04-26T21:16:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27db000640 1 -- start start 2024-04-26T21:16:18.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27db000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27d406fff0 0x7f27d4166d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27db000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d40b4ab0 con 0x7f27d4072010 2024-04-26T21:16:18.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27db000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d4159d80 con 0x7f27d41599a0 2024-04-26T21:16:18.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27db000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f27d415cda0 con 0x7f27d406fff0 2024-04-26T21:16:18.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27cbe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f27d4072010 0x7f27d406f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54068/0 (socket says 172.21.15.106:54068) 2024-04-26T21:16:18.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27cbe00640 1 -- 172.21.15.106:0/4197104610 learned_addr learned my addr 172.21.15.106:0/4197104610 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:18.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d9000640 1 --2- 172.21.15.106:0/4197104610 >> v2:172.21.15.112:3300/0 conn(0x7f27d406fff0 0x7f27d4166d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753822589 0 0) 0x7f27bc001120 con 0x7f27d4072010 2024-04-26T21:16:18.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b8003530 con 0x7f27d4072010 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 430732332 0 0) 0x7f27b8003530 con 0x7f27d4072010 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 >> v2:172.21.15.112:3300/0 conn(0x7f27d406fff0 msgr2=0x7f27d4166d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 --2- 172.21.15.106:0/4197104610 >> v2:172.21.15.112:3300/0 conn(0x7f27d406fff0 0x7f27d4166d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 >> v1:172.21.15.112:6789/0 conn(0x7f27d41599a0 legacy=0x7f27d40b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d40b59e0 con 0x7f27d4072010 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f27bc001870 con 0x7f27d4072010 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 >> v1:172.21.15.106:6789/0 conn(0x7f27d4072010 legacy=0x7f27d406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27b80039c0 0x7f27b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27b8004810 0x7f27b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8005220 0x7f27b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f27d415cda0 con 0x7f27b8005220 2024-04-26T21:16:18.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f27b800c150 con 0x7f27b80039c0 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f27b800c350 con 0x7f27b8004810 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d9000640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8005220 0x7f27b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3e00640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27b80039c0 0x7f27b8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27cbe00640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27b8004810 0x7f27b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d9000640 1 -- 172.21.15.106:0/4197104610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27b8004810 msgr2=0x7f27b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d9000640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27b8004810 0x7f27b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d9000640 1 -- 172.21.15.106:0/4197104610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27b80039c0 msgr2=0x7f27b8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d9000640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27b80039c0 0x7f27b8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d9000640 1 -- 172.21.15.106:0/4197104610 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b8003530 con 0x7f27b8005220 2024-04-26T21:16:18.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.076+0000 7f27d3e00640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27b80039c0 0x7f27b8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:18.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27d9000640 1 -- 172.21.15.106:0/4197104610 reap_dead start 2024-04-26T21:16:18.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27d9000640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8005220 0x7f27b800b9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009fc0 tx=0x7f27cc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6db98067a93d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:18.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc009c10 con 0x7f27b8005220 2024-04-26T21:16:18.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27cc0a5d10 con 0x7f27b8005220 2024-04-26T21:16:18.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27d3400640 1 -- 172.21.15.106:0/4197104610 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc003be0 con 0x7f27b8005220 2024-04-26T21:16:18.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27db000640 1 -- 172.21.15.106:0/4197104610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8005220 msgr2=0x7f27b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27db000640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8005220 0x7f27b800b9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009fc0 tx=0x7f27cc01ccc0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27db000640 1 -- 172.21.15.106:0/4197104610 shutdown_connections 2024-04-26T21:16:18.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27db000640 1 --2- 172.21.15.106:0/4197104610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8005220 0x7f27b800b9d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27db000640 1 -- 172.21.15.106:0/4197104610 >> 172.21.15.106:0/4197104610 conn(0x7f27d40b27a0 msgr2=0x7f27d40b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:18.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27db000640 1 -- 172.21.15.106:0/4197104610 shutdown_connections 2024-04-26T21:16:18.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.080+0000 7f27db000640 1 -- 172.21.15.106:0/4197104610 wait complete. 2024-04-26T21:16:18.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 Processor -- start 2024-04-26T21:16:18.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 -- start start 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27b8005220 0x7f27d40af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27d413f1e0 0x7f27d413f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27d4150c80 0x7f27d4151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f27d415ca30 con 0x7f27d4150c80 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f27d415c750 con 0x7f27d413f1e0 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f27d415d230 con 0x7f27b8005220 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d9000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27d4150c80 0x7f27d4151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d9000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27d4150c80 0x7f27d4151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35590/0 (socket says 172.21.15.106:35590) 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d9000640 1 -- 172.21.15.106:0/3942934644 learned_addr learned my addr 172.21.15.106:0/3942934644 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d3e00640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27b8005220 0x7f27d40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27cbe00640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27d413f1e0 0x7f27d413f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d9000640 1 -- 172.21.15.106:0/3942934644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27b8005220 msgr2=0x7f27d40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d9000640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27b8005220 0x7f27d40af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d9000640 1 -- 172.21.15.106:0/3942934644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27d413f1e0 msgr2=0x7f27d413f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d9000640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27d413f1e0 0x7f27d413f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d9000640 1 -- 172.21.15.106:0/3942934644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d4151640 con 0x7f27d4150c80 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d9000640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27d4150c80 0x7f27d4151100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0987f0 tx=0x7f27cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d0c00640 1 -- 172.21.15.106:0/3942934644 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc009c10 con 0x7f27d4150c80 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d0c00640 1 -- 172.21.15.106:0/3942934644 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27cc0bd070 con 0x7f27d4150c80 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d4151900 con 0x7f27d4150c80 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27d0c00640 1 -- 172.21.15.106:0/3942934644 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0aeec0 con 0x7f27d4150c80 2024-04-26T21:16:18.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.084+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d4151ec0 con 0x7f27d4150c80 2024-04-26T21:16:18.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.088+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d4069400 con 0x7f27d4150c80 2024-04-26T21:16:18.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.088+0000 7f27d0c00640 1 -- 172.21.15.106:0/3942934644 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27cc0039a0 con 0x7f27d4150c80 2024-04-26T21:16:18.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.088+0000 7f27d0c00640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f27b0068520 0x7f27b006a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.088+0000 7f27d0c00640 1 -- 172.21.15.106:0/3942934644 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f27cc1220b0 con 0x7f27d4150c80 2024-04-26T21:16:18.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.088+0000 7f27d3e00640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f27b0068520 0x7f27b006a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.088+0000 7f27d3e00640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f27b0068520 0x7f27b006a9e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27c4000c10 tx=0x7f27c4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:18.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.092+0000 7f27d0c00640 1 -- 172.21.15.106:0/3942934644 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f27cc0c7020 con 0x7f27d4150c80 2024-04-26T21:16:18.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.248+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f27d406e210 con 0x7f27d4150c80 2024-04-26T21:16:18.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.368+0000 7f27d0c00640 1 -- 172.21.15.106:0/3942934644 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f27cc0169d0 con 0x7f27d4150c80 2024-04-26T21:16:18.371 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2024-04-26T21:16:18.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f27b0068520 msgr2=0x7f27b006a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f27b0068520 0x7f27b006a9e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27c4000c10 tx=0x7f27c4009040 comp rx=0 tx=0).stop 2024-04-26T21:16:18.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27d4150c80 msgr2=0x7f27d4151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27d4150c80 0x7f27d4151100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0987f0 tx=0x7f27cc009750 comp rx=0 tx=0).stop 2024-04-26T21:16:18.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 shutdown_connections 2024-04-26T21:16:18.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27d413f1e0 0x7f27d413f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f27b0068520 0x7f27b006a9e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27d4150c80 0x7f27d4151100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 --2- 172.21.15.106:0/3942934644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27b8005220 0x7f27d40af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 >> 172.21.15.106:0/3942934644 conn(0x7f27d40b27a0 msgr2=0x7f27d406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:18.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 shutdown_connections 2024-04-26T21:16:18.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.372+0000 7f27db000640 1 -- 172.21.15.106:0/3942934644 wait complete. 2024-04-26T21:16:18.397 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-26T21:16:18.480 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:16:18.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:16:18.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612fa00640 1 Processor -- start 2024-04-26T21:16:18.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612fa00640 1 -- start start 2024-04-26T21:16:18.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612fa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f61280b4040 0x7f612806d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612fa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612fa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61280cd270 con 0x7f61280d3890 2024-04-26T21:16:18.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612fa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f612806dd80 con 0x7f61280b4040 2024-04-26T21:16:18.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612fa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f61280ce160 con 0x7f61280cfd40 2024-04-26T21:16:18.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f61280b4040 0x7f612806d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f61280b4040 0x7f612806d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35596/0 (socket says 172.21.15.106:35596) 2024-04-26T21:16:18.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612d000640 1 -- 172.21.15.106:0/1979407539 learned_addr learned my addr 172.21.15.106:0/1979407539 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:18.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612da00640 1 --2- 172.21.15.106:0/1979407539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612d000640 1 -- 172.21.15.106:0/1979407539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 msgr2=0x7f61280ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:18.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612d000640 1 --2- 172.21.15.106:0/1979407539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612d000640 1 -- 172.21.15.106:0/1979407539 >> v1:172.21.15.112:6789/0 conn(0x7f61280d3890 legacy=0x7f61280cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612d000640 1 -- 172.21.15.106:0/1979407539 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61280cd550 con 0x7f61280b4040 2024-04-26T21:16:18.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.540+0000 7f612da00640 1 --2- 172.21.15.106:0/1979407539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:18.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f612d000640 1 --2- 172.21.15.106:0/1979407539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280b4040 0x7f612806d840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6118009870 tx=0x7f611801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb304a6db222499 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:18.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f6127e00640 1 -- 172.21.15.106:0/1979407539 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180aa600 con 0x7f61280b4040 2024-04-26T21:16:18.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f6127e00640 1 -- 172.21.15.106:0/1979407539 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61180af070 con 0x7f61280b4040 2024-04-26T21:16:18.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f6127e00640 1 -- 172.21.15.106:0/1979407539 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180aa9c0 con 0x7f61280b4040 2024-04-26T21:16:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f612fa00640 1 -- 172.21.15.106:0/1979407539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280b4040 msgr2=0x7f612806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f612fa00640 1 --2- 172.21.15.106:0/1979407539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280b4040 0x7f612806d840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6118009870 tx=0x7f611801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f612fa00640 1 -- 172.21.15.106:0/1979407539 shutdown_connections 2024-04-26T21:16:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f612fa00640 1 --2- 172.21.15.106:0/1979407539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f612fa00640 1 --2- 172.21.15.106:0/1979407539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280b4040 0x7f612806d840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f612fa00640 1 -- 172.21.15.106:0/1979407539 >> 172.21.15.106:0/1979407539 conn(0x7f61280d2c20 msgr2=0x7f61280d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f612fa00640 1 -- 172.21.15.106:0/1979407539 shutdown_connections 2024-04-26T21:16:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.544+0000 7f612fa00640 1 -- 172.21.15.106:0/1979407539 wait complete. 2024-04-26T21:16:18.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 Processor -- start 2024-04-26T21:16:18.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 -- start start 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61280b4040 0x7f61281520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280d3890 0x7f61280cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f612815e890 con 0x7f61280d3890 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f61280b4420 con 0x7f61280b4040 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f612815ea10 con 0x7f61280cfd40 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280d3890 0x7f61280cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61280b4040 0x7f61281520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280d3890 0x7f61280cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35602/0 (socket says 172.21.15.106:35602) 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612da00640 1 -- 172.21.15.106:0/1991346482 learned_addr learned my addr 172.21.15.106:0/1991346482 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f611fe00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612da00640 1 -- 172.21.15.106:0/1991346482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 msgr2=0x7f61280caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612da00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612da00640 1 -- 172.21.15.106:0/1991346482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61280b4040 msgr2=0x7f61281520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612da00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61280b4040 0x7f61281520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612da00640 1 -- 172.21.15.106:0/1991346482 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61280cbac0 con 0x7f61280d3890 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f611fe00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612da00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280d3890 0x7f61280cb470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6120007ef0 tx=0x7f612000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f6125600640 1 -- 172.21.15.106:0/1991346482 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612001a070 con 0x7f61280d3890 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f6125600640 1 -- 172.21.15.106:0/1991346482 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6120003ba0 con 0x7f61280d3890 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f6125600640 1 -- 172.21.15.106:0/1991346482 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612000de80 con 0x7f61280d3890 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61280cbda0 con 0x7f61280d3890 2024-04-26T21:16:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61280c6960 con 0x7f61280d3890 2024-04-26T21:16:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.548+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6128069400 con 0x7f61280d3890 2024-04-26T21:16:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.552+0000 7f6125600640 1 -- 172.21.15.106:0/1991346482 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f612001d070 con 0x7f61280d3890 2024-04-26T21:16:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.552+0000 7f6125600640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6104068380 0x7f610406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.552+0000 7f6125600640 1 -- 172.21.15.106:0/1991346482 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f61200869b0 con 0x7f61280d3890 2024-04-26T21:16:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.552+0000 7f612d000640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6104068380 0x7f610406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.552+0000 7f612d000640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6104068380 0x7f610406a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61180ae000 tx=0x7f61180a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.556+0000 7f6125600640 1 -- 172.21.15.106:0/1991346482 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6120010070 con 0x7f61280d3890 2024-04-26T21:16:18.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:18.716+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f61280700c0 con 0x7f61280d3890 2024-04-26T21:16:19.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.376+0000 7f6125600640 1 -- 172.21.15.106:0/1991346482 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f6120056af0 con 0x7f61280d3890 2024-04-26T21:16:19.378 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2024-04-26T21:16:19.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6104068380 msgr2=0x7f610406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:19.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6104068380 0x7f610406a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61180ae000 tx=0x7f61180a7000 comp rx=0 tx=0).stop 2024-04-26T21:16:19.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280d3890 msgr2=0x7f61280cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:19.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280d3890 0x7f61280cb470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6120007ef0 tx=0x7f612000d4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 shutdown_connections 2024-04-26T21:16:19.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6104068380 0x7f610406a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61280d3890 0x7f61280cb470 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f61280cfd40 0x7f61280caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 --2- 172.21.15.106:0/1991346482 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61280b4040 0x7f61281520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 >> 172.21.15.106:0/1991346482 conn(0x7f61280d2c20 msgr2=0x7f612806df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:19.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 shutdown_connections 2024-04-26T21:16:19.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.380+0000 7f612fa00640 1 -- 172.21.15.106:0/1991346482 wait complete. 2024-04-26T21:16:19.425 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T21:16:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.608+0000 7f157f400640 1 Processor -- start 2024-04-26T21:16:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f157f400640 1 -- start start 2024-04-26T21:16:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f157f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815c4e0 0x7f157815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f157f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f157815d080 0x7f15780b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f157f400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f157815ce00 con 0x7f157815fa20 2024-04-26T21:16:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f157f400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f157815d5f0 con 0x7f157815d080 2024-04-26T21:16:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f157f400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f15780b4f00 con 0x7f157815c4e0 2024-04-26T21:16:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f1577e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f157815d080 0x7f15780b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f1577e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f157815d080 0x7f15780b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35612/0 (socket says 172.21.15.106:35612) 2024-04-26T21:16:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f1577e00640 1 -- 172.21.15.106:0/2319550563 learned_addr learned my addr 172.21.15.106:0/2319550563 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f157ca00640 1 --2- 172.21.15.106:0/2319550563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815c4e0 0x7f157815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f1577e00640 1 -- 172.21.15.106:0/2319550563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815c4e0 msgr2=0x7f157815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f1577e00640 1 --2- 172.21.15.106:0/2319550563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815c4e0 0x7f157815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f1577e00640 1 -- 172.21.15.106:0/2319550563 >> v1:172.21.15.112:6789/0 conn(0x7f157815fa20 legacy=0x7f157815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.612+0000 7f1577e00640 1 -- 172.21.15.106:0/2319550563 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15780b51e0 con 0x7f157815d080 2024-04-26T21:16:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f1577e00640 1 --2- 172.21.15.106:0/2319550563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815d080 0x7f15780b4620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1564009870 tx=0x7f156401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5c170c286c8a6e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f1577400640 1 -- 172.21.15.106:0/2319550563 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640a95f0 con 0x7f157815d080 2024-04-26T21:16:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f1577400640 1 -- 172.21.15.106:0/2319550563 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15640a9790 con 0x7f157815d080 2024-04-26T21:16:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f1577400640 1 -- 172.21.15.106:0/2319550563 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640a9b60 con 0x7f157815d080 2024-04-26T21:16:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f157f400640 1 -- 172.21.15.106:0/2319550563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815d080 msgr2=0x7f15780b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f157f400640 1 --2- 172.21.15.106:0/2319550563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815d080 0x7f15780b4620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1564009870 tx=0x7f156401c530 comp rx=0 tx=0).stop 2024-04-26T21:16:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f157f400640 1 -- 172.21.15.106:0/2319550563 shutdown_connections 2024-04-26T21:16:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f157f400640 1 --2- 172.21.15.106:0/2319550563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815d080 0x7f15780b4620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f157f400640 1 --2- 172.21.15.106:0/2319550563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815c4e0 0x7f157815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f157f400640 1 -- 172.21.15.106:0/2319550563 >> 172.21.15.106:0/2319550563 conn(0x7f15780b2910 msgr2=0x7f15780b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f157f400640 1 -- 172.21.15.106:0/2319550563 shutdown_connections 2024-04-26T21:16:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f157f400640 1 -- 172.21.15.106:0/2319550563 wait complete. 2024-04-26T21:16:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.616+0000 7f157f400640 1 Processor -- start 2024-04-26T21:16:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 -- start start 2024-04-26T21:16:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815c4e0 0x7f157815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f157815d080 0x7f1578166030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815fa20 0x7f15780ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f15780b4ce0 con 0x7f157815c4e0 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f15780b4b60 con 0x7f157815d080 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f15781695d0 con 0x7f157815fa20 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815c4e0 0x7f157815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815c4e0 0x7f157815b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35624/0 (socket says 172.21.15.106:35624) 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157ca00640 1 -- 172.21.15.106:0/507814926 learned_addr learned my addr 172.21.15.106:0/507814926 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157d400640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815fa20 0x7f15780ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f1577e00640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f157815d080 0x7f1578166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157ca00640 1 -- 172.21.15.106:0/507814926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815fa20 msgr2=0x7f15780ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157ca00640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815fa20 0x7f15780ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157ca00640 1 -- 172.21.15.106:0/507814926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f157815d080 msgr2=0x7f1578166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157ca00640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f157815d080 0x7f1578166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157ca00640 1 -- 172.21.15.106:0/507814926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1578073a50 con 0x7f157815c4e0 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157ca00640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815c4e0 0x7f157815b250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f156c00e930 tx=0x7f156c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f1574c00640 1 -- 172.21.15.106:0/507814926 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c017070 con 0x7f157815c4e0 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f1574c00640 1 -- 172.21.15.106:0/507814926 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f156c00ca00 con 0x7f157815c4e0 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f1574c00640 1 -- 172.21.15.106:0/507814926 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c00cdb0 con 0x7f157815c4e0 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1578073d30 con 0x7f157815c4e0 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157815b960 con 0x7f157815c4e0 2024-04-26T21:16:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.620+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1578069400 con 0x7f157815c4e0 2024-04-26T21:16:19.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.624+0000 7f1574c00640 1 -- 172.21.15.106:0/507814926 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f156c01a070 con 0x7f157815c4e0 2024-04-26T21:16:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.624+0000 7f1574c00640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1558068380 0x7f155806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.624+0000 7f1574c00640 1 -- 172.21.15.106:0/507814926 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f156c087050 con 0x7f157815c4e0 2024-04-26T21:16:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.624+0000 7f1577e00640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1558068380 0x7f155806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.624+0000 7f1577e00640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1558068380 0x7f155806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15640ae000 tx=0x7f15640b3040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:19.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.628+0000 7f1574c00640 1 -- 172.21.15.106:0/507814926 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f156c057250 con 0x7f157815c4e0 2024-04-26T21:16:19.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:19.816+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1578073f00 con 0x7f157815c4e0 2024-04-26T21:16:20.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.392+0000 7f1574c00640 1 -- 172.21.15.106:0/507814926 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f156c05b550 con 0x7f157815c4e0 2024-04-26T21:16:20.400 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T21:16:20.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1558068380 msgr2=0x7f155806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:20.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1558068380 0x7f155806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15640ae000 tx=0x7f15640b3040 comp rx=0 tx=0).stop 2024-04-26T21:16:20.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815c4e0 msgr2=0x7f157815b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:20.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815c4e0 0x7f157815b250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f156c00e930 tx=0x7f156c00edf0 comp rx=0 tx=0).stop 2024-04-26T21:16:20.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 shutdown_connections 2024-04-26T21:16:20.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f157815d080 0x7f1578166030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:20.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1558068380 0x7f155806a840 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15640ae000 tx=0x7f15640b3040 comp rx=0 tx=0).stop 2024-04-26T21:16:20.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f157815fa20 0x7f15780ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:20.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 --2- 172.21.15.106:0/507814926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f157815c4e0 0x7f157815b250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:20.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.400+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 >> 172.21.15.106:0/507814926 conn(0x7f15780b2910 msgr2=0x7f15780d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:20.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.412+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 shutdown_connections 2024-04-26T21:16:20.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.412+0000 7f157f400640 1 -- 172.21.15.106:0/507814926 wait complete. 2024-04-26T21:16:20.443 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-26T21:16:20.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-26T21:16:20.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd7e00640 1 Processor -- start 2024-04-26T21:16:20.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd7e00640 1 -- start start 2024-04-26T21:16:20.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd7e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4fd80cd510 0x7f4fd80b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:20.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd7e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4fd8160760 0x7f4fd80d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:20.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd7e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd80ce6d0 con 0x7f4fd8160380 2024-04-26T21:16:20.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd7e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd80b60d0 con 0x7f4fd80cd510 2024-04-26T21:16:20.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd7e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd80ce9b0 con 0x7f4fd8160760 2024-04-26T21:16:20.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd6000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4fd80cd510 0x7f4fd80b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:20.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd6000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4fd80cd510 0x7f4fd80b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35626/0 (socket says 172.21.15.106:35626) 2024-04-26T21:16:20.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd6000640 1 -- 172.21.15.106:0/3935603775 learned_addr learned my addr 172.21.15.106:0/3935603775 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:20.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd7400640 1 --2- 172.21.15.106:0/3935603775 >> v2:172.21.15.112:3300/0 conn(0x7f4fd8160760 0x7f4fd80d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:20.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd6000640 1 -- 172.21.15.106:0/3935603775 >> v2:172.21.15.112:3300/0 conn(0x7f4fd8160760 msgr2=0x7f4fd80d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:20.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd6000640 1 --2- 172.21.15.106:0/3935603775 >> v2:172.21.15.112:3300/0 conn(0x7f4fd8160760 0x7f4fd80d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:20.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd6000640 1 -- 172.21.15.106:0/3935603775 >> v1:172.21.15.112:6789/0 conn(0x7f4fd8160380 legacy=0x7f4fd80b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:20.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.584+0000 7f4fd6000640 1 -- 172.21.15.106:0/3935603775 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd80cec90 con 0x7f4fd80cd510 2024-04-26T21:16:20.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd6000640 1 --2- 172.21.15.106:0/3935603775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 0x7f4fd80b4030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80c9bd0 tx=0x7f4fc401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cff747f3a7661c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:20.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd5600640 1 -- 172.21.15.106:0/3935603775 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40b5070 con 0x7f4fd80cd510 2024-04-26T21:16:20.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd5600640 1 -- 172.21.15.106:0/3935603775 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc40a8a10 con 0x7f4fd80cd510 2024-04-26T21:16:20.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd5600640 1 -- 172.21.15.106:0/3935603775 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40a8de0 con 0x7f4fd80cd510 2024-04-26T21:16:20.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 -- 172.21.15.106:0/3935603775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 msgr2=0x7f4fd80b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:20.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 --2- 172.21.15.106:0/3935603775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 0x7f4fd80b4030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80c9bd0 tx=0x7f4fc401ed10 comp rx=0 tx=0).stop 2024-04-26T21:16:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 -- 172.21.15.106:0/3935603775 shutdown_connections 2024-04-26T21:16:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 --2- 172.21.15.106:0/3935603775 >> v2:172.21.15.112:3300/0 conn(0x7f4fd8160760 0x7f4fd80d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 --2- 172.21.15.106:0/3935603775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 0x7f4fd80b4030 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 -- 172.21.15.106:0/3935603775 >> 172.21.15.106:0/3935603775 conn(0x7f4fd80b4680 msgr2=0x7f4fd80b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 -- 172.21.15.106:0/3935603775 shutdown_connections 2024-04-26T21:16:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 -- 172.21.15.106:0/3935603775 wait complete. 2024-04-26T21:16:20.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 Processor -- start 2024-04-26T21:16:20.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.588+0000 7f4fd7e00640 1 -- start start 2024-04-26T21:16:20.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 0x7f4fd80c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:20.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd8160380 0x7f4fd814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd8160760 0x7f4fd815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd80b52f0 con 0x7f4fd80cd510 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd80b5170 con 0x7f4fd8160380 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd80d11b0 con 0x7f4fd8160760 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 0x7f4fd80c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 0x7f4fd80c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35640/0 (socket says 172.21.15.106:35640) 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6a00640 1 -- 172.21.15.106:0/1465104509 learned_addr learned my addr 172.21.15.106:0/1465104509 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7400640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd8160760 0x7f4fd815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6000640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd8160380 0x7f4fd814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6a00640 1 -- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd8160760 msgr2=0x7f4fd815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6a00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd8160760 0x7f4fd815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6a00640 1 -- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd8160380 msgr2=0x7f4fd814c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6a00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd8160380 0x7f4fd814c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:20.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6a00640 1 -- 172.21.15.106:0/1465104509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd80c7870 con 0x7f4fd80cd510 2024-04-26T21:16:20.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6000640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd8160380 0x7f4fd814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:20.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7400640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd8160760 0x7f4fd815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:20.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd6a00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 0x7f4fd80c8910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800c420 tx=0x7f4fc800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:20.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fcea00640 1 -- 172.21.15.106:0/1465104509 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80052d0 con 0x7f4fd80cd510 2024-04-26T21:16:20.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fcea00640 1 -- 172.21.15.106:0/1465104509 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc8005470 con 0x7f4fd80cd510 2024-04-26T21:16:20.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd80c7b50 con 0x7f4fd80cd510 2024-04-26T21:16:20.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fcea00640 1 -- 172.21.15.106:0/1465104509 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8007260 con 0x7f4fd80cd510 2024-04-26T21:16:20.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd80c8110 con 0x7f4fd80cd510 2024-04-26T21:16:20.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd8069400 con 0x7f4fd80cd510 2024-04-26T21:16:20.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.592+0000 7f4fcea00640 1 -- 172.21.15.106:0/1465104509 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4fc8007400 con 0x7f4fd80cd510 2024-04-26T21:16:20.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.596+0000 7f4fcea00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fb8068380 0x7f4fb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:20.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.596+0000 7f4fcea00640 1 -- 172.21.15.106:0/1465104509 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4fc8085ed0 con 0x7f4fd80cd510 2024-04-26T21:16:20.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.596+0000 7f4fd6000640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fb8068380 0x7f4fb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:20.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.596+0000 7f4fd6000640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fb8068380 0x7f4fb806a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40b2000 tx=0x7f4fc4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:20.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.600+0000 7f4fcea00640 1 -- 172.21.15.106:0/1465104509 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4fc8056480 con 0x7f4fd80cd510 2024-04-26T21:16:20.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:20.772+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f4fd80b8af0 con 0x7f4fd80cd510 2024-04-26T21:16:21.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.396+0000 7f4fcea00640 1 -- 172.21.15.106:0/1465104509 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7f4fc8055d80 con 0x7f4fd80cd510 2024-04-26T21:16:21.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fb8068380 msgr2=0x7f4fb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fb8068380 0x7f4fb806a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40b2000 tx=0x7f4fc4008040 comp rx=0 tx=0).stop 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 msgr2=0x7f4fd80c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 0x7f4fd80c8910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800c420 tx=0x7f4fc800c8e0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 shutdown_connections 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fd8160380 0x7f4fd814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fb8068380 0x7f4fb806a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fd8160760 0x7f4fd815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 --2- 172.21.15.106:0/1465104509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fd80cd510 0x7f4fd80c8910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 >> 172.21.15.106:0/1465104509 conn(0x7f4fd80b4680 msgr2=0x7f4fd80b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 shutdown_connections 2024-04-26T21:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.400+0000 7f4fd7e00640 1 -- 172.21.15.106:0/1465104509 wait complete. 2024-04-26T21:16:21.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T21:16:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.568+0000 7feb56c00640 1 Processor -- start 2024-04-26T21:16:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.568+0000 7feb56c00640 1 -- start start 2024-04-26T21:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb56c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1860 0x7feb500b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb56c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feb500d1c40 0x7feb500cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb56c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb500b5c00 con 0x7feb500b6570 2024-04-26T21:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb56c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7feb500d5e50 con 0x7feb500d1c40 2024-04-26T21:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb56c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7feb500d3880 con 0x7feb500d1860 2024-04-26T21:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb54c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feb500d1c40 0x7feb500cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb4f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7feb500b6570 0x7feb5015f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54072/0 (socket says 172.21.15.106:54072) 2024-04-26T21:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb4f400640 1 -- 172.21.15.106:0/3688453437 learned_addr learned my addr 172.21.15.106:0/3688453437 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb4fe00640 1 --2- 172.21.15.106:0/3688453437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1860 0x7feb500b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb54c00640 1 -- 172.21.15.106:0/3688453437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1860 msgr2=0x7feb500b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb54c00640 1 --2- 172.21.15.106:0/3688453437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1860 0x7feb500b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb54c00640 1 -- 172.21.15.106:0/3688453437 >> v1:172.21.15.106:6789/0 conn(0x7feb500b6570 legacy=0x7feb5015f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb54c00640 1 -- 172.21.15.106:0/3688453437 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb500d5b70 con 0x7feb500d1c40 2024-04-26T21:16:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb4fe00640 1 --2- 172.21.15.106:0/3688453437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1860 0x7feb500b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb4ea00640 1 -- 172.21.15.106:0/3688453437 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966986475 0 0) 0x7feb500b5c00 con 0x7feb500b6570 2024-04-26T21:16:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb54c00640 1 --2- 172.21.15.106:0/3688453437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1c40 0x7feb500cfae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb48009d90 tx=0x7feb4801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39062854226ba3b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:21.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.572+0000 7feb4ea00640 1 -- 172.21.15.106:0/3688453437 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb480b2070 con 0x7feb500d1c40 2024-04-26T21:16:21.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4ea00640 1 -- 172.21.15.106:0/3688453437 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb480a5940 con 0x7feb500d1c40 2024-04-26T21:16:21.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4ea00640 1 -- 172.21.15.106:0/3688453437 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb480a5d10 con 0x7feb500d1c40 2024-04-26T21:16:21.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 -- 172.21.15.106:0/3688453437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1c40 msgr2=0x7feb500cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:21.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 --2- 172.21.15.106:0/3688453437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1c40 0x7feb500cfae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb48009d90 tx=0x7feb4801c970 comp rx=0 tx=0).stop 2024-04-26T21:16:21.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 -- 172.21.15.106:0/3688453437 shutdown_connections 2024-04-26T21:16:21.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 --2- 172.21.15.106:0/3688453437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1c40 0x7feb500cfae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 --2- 172.21.15.106:0/3688453437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1860 0x7feb500b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 -- 172.21.15.106:0/3688453437 >> 172.21.15.106:0/3688453437 conn(0x7feb500d4ed0 msgr2=0x7feb500d52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:21.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 -- 172.21.15.106:0/3688453437 shutdown_connections 2024-04-26T21:16:21.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 -- 172.21.15.106:0/3688453437 wait complete. 2024-04-26T21:16:21.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 Processor -- start 2024-04-26T21:16:21.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 -- start start 2024-04-26T21:16:21.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb500b6570 0x7feb5015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:21.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1860 0x7feb5015d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:21.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1c40 0x7feb5014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:21.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feb5016c160 con 0x7feb500d1860 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feb500d0a40 con 0x7feb500b6570 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb56c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7feb5016c2e0 con 0x7feb500d1c40 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1860 0x7feb5015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1860 0x7feb5015d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35654/0 (socket says 172.21.15.106:35654) 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4f400640 1 -- 172.21.15.106:0/1285266448 learned_addr learned my addr 172.21.15.106:0/1285266448 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4fe00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb500b6570 0x7feb5015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb54c00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1c40 0x7feb5014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4f400640 1 -- 172.21.15.106:0/1285266448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1c40 msgr2=0x7feb5014eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4f400640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1c40 0x7feb5014eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4f400640 1 -- 172.21.15.106:0/1285266448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb500b6570 msgr2=0x7feb5015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4f400640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb500b6570 0x7feb5015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb4f400640 1 -- 172.21.15.106:0/1285266448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5015bb60 con 0x7feb500d1860 2024-04-26T21:16:21.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.576+0000 7feb54c00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1c40 0x7feb5014eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:21.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb4f400640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1860 0x7feb5015d240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00c4b0 tx=0x7feb3c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:21.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb47e00640 1 -- 172.21.15.106:0/1285266448 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c018070 con 0x7feb500d1860 2024-04-26T21:16:21.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb47e00640 1 -- 172.21.15.106:0/1285266448 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3c007500 con 0x7feb500d1860 2024-04-26T21:16:21.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb47e00640 1 -- 172.21.15.106:0/1285266448 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c004a30 con 0x7feb500d1860 2024-04-26T21:16:21.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb50159690 con 0x7feb500d1860 2024-04-26T21:16:21.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb50159ed0 con 0x7feb500d1860 2024-04-26T21:16:21.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb50069400 con 0x7feb500d1860 2024-04-26T21:16:21.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb47e00640 1 -- 172.21.15.106:0/1285266448 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb3c004bd0 con 0x7feb500d1860 2024-04-26T21:16:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb47e00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feb30068380 0x7feb3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb47e00640 1 -- 172.21.15.106:0/1285266448 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7feb3c085f00 con 0x7feb500d1860 2024-04-26T21:16:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.580+0000 7feb4fe00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feb30068380 0x7feb3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.584+0000 7feb4fe00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feb30068380 0x7feb3006a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb4000a9a0 tx=0x7feb40008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.588+0000 7feb47e00640 1 -- 172.21.15.106:0/1285266448 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feb50159690 con 0x7feb500d1860 2024-04-26T21:16:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:21.744+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7feb500b3e50 con 0x7feb500d1860 2024-04-26T21:16:23.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb47e00640 1 -- 172.21.15.106:0/1285266448 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7feb3c0563b0 con 0x7feb500d1860 2024-04-26T21:16:23.418 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data_ec' created 2024-04-26T21:16:23.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feb30068380 msgr2=0x7feb3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feb30068380 0x7feb3006a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb4000a9a0 tx=0x7feb40008040 comp rx=0 tx=0).stop 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1860 msgr2=0x7feb5015d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1860 0x7feb5015d240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00c4b0 tx=0x7feb3c00c970 comp rx=0 tx=0).stop 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 shutdown_connections 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feb30068380 0x7feb3006a840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb500d1c40 0x7feb5014eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb500d1860 0x7feb5015d240 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 --2- 172.21.15.106:0/1285266448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb500b6570 0x7feb5015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.416+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 >> 172.21.15.106:0/1285266448 conn(0x7feb500d4ed0 msgr2=0x7feb5015edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.420+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 shutdown_connections 2024-04-26T21:16:23.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.420+0000 7feb56c00640 1 -- 172.21.15.106:0/1285266448 wait complete. 2024-04-26T21:16:23.453 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-26T21:16:23.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.592+0000 7f772c400640 1 Processor -- start 2024-04-26T21:16:23.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.592+0000 7f772c400640 1 -- start start 2024-04-26T21:16:23.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.592+0000 7f772c400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7724157540 0x7f77240cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:23.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.592+0000 7f772c400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7724161930 con 0x7f7724160ad0 2024-04-26T21:16:23.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.592+0000 7f772c400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7724071f10 con 0x7f7724160f30 2024-04-26T21:16:23.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.592+0000 7f772c400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f772406e950 con 0x7f7724157540 2024-04-26T21:16:23.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.592+0000 7f7729000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7724160ad0 0x7f772415d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54074/0 (socket says 172.21.15.106:54074) 2024-04-26T21:16:23.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.592+0000 7f7729000640 1 -- 172.21.15.106:0/734668131 learned_addr learned my addr 172.21.15.106:0/734668131 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:23.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3863481994 0 0) 0x7f7710001120 con 0x7f7724160ad0 2024-04-26T21:16:23.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f770c003530 con 0x7f7724160ad0 2024-04-26T21:16:23.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7729a00640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7724157540 0x7f77240cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:23.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 634680095 0 0) 0x7f770c003530 con 0x7f7724160ad0 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7724157540 msgr2=0x7f77240cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7724157540 0x7f77240cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 >> v1:172.21.15.112:6789/0 conn(0x7f7724160f30 legacy=0x7f772415dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772406ec30 con 0x7f7724160ad0 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f7710001850 con 0x7f7724160ad0 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 >> v1:172.21.15.106:6789/0 conn(0x7f7724160ad0 legacy=0x7f772415d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f770c0039f0 0x7f770c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f770c004810 0x7f770c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7724157540 0x7f770c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f772406e950 con 0x7f770c004810 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f770c00ba80 con 0x7f770c0039f0 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f770c00bc80 con 0x7f7724157540 2024-04-26T21:16:23.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7729000640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f770c004810 0x7f770c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:23.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7729a00640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f770c0039f0 0x7f770c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:23.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f772a400640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7724157540 0x7f770c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:23.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7729000640 1 -- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7724157540 msgr2=0x7f770c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:23.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7729000640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7724157540 0x7f770c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7729000640 1 -- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f770c0039f0 msgr2=0x7f770c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:23.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7729000640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f770c0039f0 0x7f770c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.596+0000 7f7729000640 1 -- 172.21.15.106:0/734668131 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c003530 con 0x7f770c004810 2024-04-26T21:16:23.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f7729000640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f770c004810 0x7f770c004c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f771000c490 tx=0x7f771001f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ee6c9d2280158e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:23.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771000c0e0 con 0x7f770c004810 2024-04-26T21:16:23.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7710005b00 con 0x7f770c004810 2024-04-26T21:16:23.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f7723e00640 1 -- 172.21.15.106:0/734668131 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710007070 con 0x7f770c004810 2024-04-26T21:16:23.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 -- 172.21.15.106:0/734668131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f770c004810 msgr2=0x7f770c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:23.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 --2- 172.21.15.106:0/734668131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f770c004810 0x7f770c004c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f771000c490 tx=0x7f771001f3a0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772a400640 1 -- 172.21.15.106:0/734668131 reap_dead start 2024-04-26T21:16:23.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 -- 172.21.15.106:0/734668131 shutdown_connections 2024-04-26T21:16:23.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 -- 172.21.15.106:0/734668131 >> 172.21.15.106:0/734668131 conn(0x7f77240b27a0 msgr2=0x7f77240b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:23.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 -- 172.21.15.106:0/734668131 shutdown_connections 2024-04-26T21:16:23.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 -- 172.21.15.106:0/734668131 wait complete. 2024-04-26T21:16:23.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 Processor -- start 2024-04-26T21:16:23.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 -- start start 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f770c004810 0x7f77240d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724150300 0x7f77241e85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77241512c0 0x7f7724151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f772406f4d0 con 0x7f7724150300 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f772406f1f0 con 0x7f770c004810 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.600+0000 7f772c400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f77240cf370 con 0x7f77241512c0 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724150300 0x7f77241e85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724150300 0x7f77241e85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35662/0 (socket says 172.21.15.106:35662) 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729000640 1 -- 172.21.15.106:0/541602614 learned_addr learned my addr 172.21.15.106:0/541602614 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729a00640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f770c004810 0x7f77240d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:23.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f772a400640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77241512c0 0x7f7724151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:23.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729000640 1 -- 172.21.15.106:0/541602614 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77241512c0 msgr2=0x7f7724151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:23.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729000640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77241512c0 0x7f7724151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729000640 1 -- 172.21.15.106:0/541602614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f770c004810 msgr2=0x7f77240d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:23.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729000640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f770c004810 0x7f77240d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:23.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729000640 1 -- 172.21.15.106:0/541602614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77240d0f10 con 0x7f7724150300 2024-04-26T21:16:23.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7729000640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724150300 0x7f77241e85f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7710001b50 tx=0x7f770c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:23.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7721600640 1 -- 172.21.15.106:0/541602614 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710005cb0 con 0x7f7724150300 2024-04-26T21:16:23.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7721600640 1 -- 172.21.15.106:0/541602614 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7710005e50 con 0x7f7724150300 2024-04-26T21:16:23.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7721600640 1 -- 172.21.15.106:0/541602614 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77100049f0 con 0x7f7724150300 2024-04-26T21:16:23.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77241f77f0 con 0x7f7724150300 2024-04-26T21:16:23.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77241f6d10 con 0x7f7724150300 2024-04-26T21:16:23.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7724069400 con 0x7f7724150300 2024-04-26T21:16:23.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.604+0000 7f7721600640 1 -- 172.21.15.106:0/541602614 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7710004b90 con 0x7f7724150300 2024-04-26T21:16:23.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.608+0000 7f7721600640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7704068380 0x7f770406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:23.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.608+0000 7f7721600640 1 -- 172.21.15.106:0/541602614 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f7710123da0 con 0x7f7724150300 2024-04-26T21:16:23.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.608+0000 7f7729a00640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7704068380 0x7f770406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:23.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.608+0000 7f7729a00640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7704068380 0x7f770406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7718014510 tx=0x7f771800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:23.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.612+0000 7f7721600640 1 -- 172.21.15.106:0/541602614 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f77100c3030 con 0x7f7724150300 2024-04-26T21:16:23.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:23.768+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f7724073c00 con 0x7f7724150300 2024-04-26T21:16:24.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f7721600640 1 -- 172.21.15.106:0/541602614 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7f77240d0f10 con 0x7f7724150300 2024-04-26T21:16:24.426 INFO:teuthology.orchestra.run.smithi106.stderr:set pool 4 allow_ec_overwrites to true 2024-04-26T21:16:24.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7704068380 msgr2=0x7f770406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:24.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7704068380 0x7f770406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7718014510 tx=0x7f771800b040 comp rx=0 tx=0).stop 2024-04-26T21:16:24.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724150300 msgr2=0x7f77241e85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:24.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724150300 0x7f77241e85f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7710001b50 tx=0x7f770c005840 comp rx=0 tx=0).stop 2024-04-26T21:16:24.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 shutdown_connections 2024-04-26T21:16:24.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7704068380 0x7f770406a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77241512c0 0x7f7724151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724150300 0x7f77241e85f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 --2- 172.21.15.106:0/541602614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f770c004810 0x7f77240d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 >> 172.21.15.106:0/541602614 conn(0x7f77240b27a0 msgr2=0x7f772406f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:24.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 shutdown_connections 2024-04-26T21:16:24.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.424+0000 7f772c400640 1 -- 172.21.15.106:0/541602614 wait complete. 2024-04-26T21:16:24.477 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-26T21:16:24.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fc0e00640 1 Processor -- start 2024-04-26T21:16:24.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fc0e00640 1 -- start start 2024-04-26T21:16:24.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fc0e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8fbc15d080 0x7f8fbc0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:24.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fc0e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15da80 0x7f8fbc15df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:24.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fc0e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fbc0b4f00 con 0x7f8fbc15c4e0 2024-04-26T21:16:24.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fc0e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8fbc15d5f0 con 0x7f8fbc15d080 2024-04-26T21:16:24.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fc0e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc0b51e0 con 0x7f8fbc15da80 2024-04-26T21:16:24.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb9e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8fbc15c4e0 0x7f8fbc15c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54078/0 (socket says 172.21.15.106:54078) 2024-04-26T21:16:24.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb9e00640 1 -- 172.21.15.106:0/2011655358 learned_addr learned my addr 172.21.15.106:0/2011655358 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494451697 0 0) 0x7f8fbc0b4f00 con 0x7f8fbc15c4e0 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fa0003530 con 0x7f8fbc15c4e0 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fba800640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15da80 0x7f8fbc15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb9400640 1 --2- 172.21.15.106:0/2011655358 >> v2:172.21.15.112:3300/0 conn(0x7f8fbc15d080 0x7f8fbc0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4109053175 0 0) 0x7f8fa0003530 con 0x7f8fbc15c4e0 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15da80 msgr2=0x7f8fbc15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15da80 0x7f8fbc15df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 >> v2:172.21.15.112:3300/0 conn(0x7f8fbc15d080 msgr2=0x7f8fbc0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 --2- 172.21.15.106:0/2011655358 >> v2:172.21.15.112:3300/0 conn(0x7f8fbc15d080 0x7f8fbc0b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc0b54c0 con 0x7f8fbc15c4e0 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f8fac001680 con 0x7f8fbc15c4e0 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 >> v1:172.21.15.106:6789/0 conn(0x7f8fbc15c4e0 legacy=0x7f8fbc15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15da80 0x7f8fa00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fa0003f40 0x7f8fa0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa0004d50 0x7f8fa00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc15d5f0 con 0x7f8fa0004d50 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc0b51e0 con 0x7f8fa0003f40 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.612+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa000b9d0 con 0x7f8fbc15da80 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fb9400640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fa0003f40 0x7f8fa0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fba800640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa0004d50 0x7f8fa00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fb9e00640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15da80 0x7f8fa00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fba800640 1 -- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15da80 msgr2=0x7f8fa00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fba800640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15da80 0x7f8fa00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fba800640 1 -- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fa0003f40 msgr2=0x7f8fa0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fba800640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fa0003f40 0x7f8fa0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fba800640 1 -- 172.21.15.106:0/2011655358 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa0003530 con 0x7f8fa0004d50 2024-04-26T21:16:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fb9400640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fa0003f40 0x7f8fa0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fba800640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa0004d50 0x7f8fa00051d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009fc0 tx=0x7f8fb401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd99c9bf00e7ec9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40b2070 con 0x7f8fa0004d50 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb40a5c90 con 0x7f8fa0004d50 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.616+0000 7f8fb8a00640 1 -- 172.21.15.106:0/2011655358 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4009c10 con 0x7f8fa0004d50 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 -- 172.21.15.106:0/2011655358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa0004d50 msgr2=0x7f8fa00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 --2- 172.21.15.106:0/2011655358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa0004d50 0x7f8fa00051d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009fc0 tx=0x7f8fb401cc20 comp rx=0 tx=0).stop 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fba800640 1 -- 172.21.15.106:0/2011655358 reap_dead start 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 -- 172.21.15.106:0/2011655358 shutdown_connections 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 -- 172.21.15.106:0/2011655358 >> 172.21.15.106:0/2011655358 conn(0x7f8fbc0b2910 msgr2=0x7f8fbc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 -- 172.21.15.106:0/2011655358 shutdown_connections 2024-04-26T21:16:24.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 -- 172.21.15.106:0/2011655358 wait complete. 2024-04-26T21:16:24.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 Processor -- start 2024-04-26T21:16:24.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 -- start start 2024-04-26T21:16:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fbc15b8e0 0x7f8fbc0c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15bcc0 0x7f8fbc1312a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc1317e0 0x7f8fbc13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc0b4b60 con 0x7f8fbc1317e0 2024-04-26T21:16:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc145ba0 con 0x7f8fbc15b8e0 2024-04-26T21:16:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fc0e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc0b4ce0 con 0x7f8fbc15bcc0 2024-04-26T21:16:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fba800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc1317e0 0x7f8fbc13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fba800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc1317e0 0x7f8fbc13c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35668/0 (socket says 172.21.15.106:35668) 2024-04-26T21:16:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fba800640 1 -- 172.21.15.106:0/796505329 learned_addr learned my addr 172.21.15.106:0/796505329 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fb9400640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15bcc0 0x7f8fbc1312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fb9e00640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fbc15b8e0 0x7f8fbc0c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fba800640 1 -- 172.21.15.106:0/796505329 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15bcc0 msgr2=0x7f8fbc1312a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fba800640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15bcc0 0x7f8fbc1312a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fba800640 1 -- 172.21.15.106:0/796505329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fbc15b8e0 msgr2=0x7f8fbc0c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fba800640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fbc15b8e0 0x7f8fbc0c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.620+0000 7f8fba800640 1 -- 172.21.15.106:0/796505329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc0ca4d0 con 0x7f8fbc1317e0 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fba800640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc1317e0 0x7f8fbc13c2a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4002240 tx=0x7f8fb4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fb2000640 1 -- 172.21.15.106:0/796505329 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40bd070 con 0x7f8fbc1317e0 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fb2000640 1 -- 172.21.15.106:0/796505329 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb40a5a90 con 0x7f8fbc1317e0 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc0ca770 con 0x7f8fbc1317e0 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fb2000640 1 -- 172.21.15.106:0/796505329 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40b2040 con 0x7f8fbc1317e0 2024-04-26T21:16:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc0cad30 con 0x7f8fbc1317e0 2024-04-26T21:16:24.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc069400 con 0x7f8fbc1317e0 2024-04-26T21:16:24.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fb2000640 1 -- 172.21.15.106:0/796505329 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8fb40c0070 con 0x7f8fbc1317e0 2024-04-26T21:16:24.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fb2000640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8f9c068380 0x7f8f9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:24.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fb2000640 1 -- 172.21.15.106:0/796505329 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f8fb4120750 con 0x7f8fbc1317e0 2024-04-26T21:16:24.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.624+0000 7f8fb9e00640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8f9c068380 0x7f8f9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:24.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.628+0000 7f8fb9e00640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8f9c068380 0x7f8f9c06a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fac001560 tx=0x7f8fac007900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:24.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.628+0000 7f8fb2000640 1 -- 172.21.15.106:0/796505329 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8fb4016990 con 0x7f8fbc1317e0 2024-04-26T21:16:24.634 INFO:tasks.ceph.mds.d.smithi112.stderr:2024-04-26T21:16:24.635+0000 7fb725400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:16:24.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:24.820+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f8fbc06fb90 con 0x7f8fbc1317e0 2024-04-26T21:16:25.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.424+0000 7f8fb2000640 1 -- 172.21.15.106:0/796505329 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f8fb40f0330 con 0x7f8fbc1317e0 2024-04-26T21:16:25.428 INFO:teuthology.orchestra.run.smithi106.stderr:added data pool 4 to fsmap 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8f9c068380 msgr2=0x7f8f9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8f9c068380 0x7f8f9c06a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fac001560 tx=0x7f8fac007900 comp rx=0 tx=0).stop 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc1317e0 msgr2=0x7f8fbc13c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc1317e0 0x7f8fbc13c2a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4002240 tx=0x7f8fb4009750 comp rx=0 tx=0).stop 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 shutdown_connections 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8f9c068380 0x7f8f9c06a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc1317e0 0x7f8fbc13c2a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8fbc15bcc0 0x7f8fbc1312a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 --2- 172.21.15.106:0/796505329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fbc15b8e0 0x7f8fbc0c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 >> 172.21.15.106:0/796505329 conn(0x7f8fbc0b2910 msgr2=0x7f8fbc13aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:25.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 shutdown_connections 2024-04-26T21:16:25.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.428+0000 7f8fc0e00640 1 -- 172.21.15.106:0/796505329 wait complete. 2024-04-26T21:16:25.454 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:16:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.588+0000 7fb8ace00640 1 Processor -- start 2024-04-26T21:16:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.588+0000 7fb8ace00640 1 -- start start 2024-04-26T21:16:25.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.588+0000 7fb8ace00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb8a813ed60 0x7fb8a815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.588+0000 7fb8ace00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8a806eb70 0x7fb8a80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.588+0000 7fb8ace00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a80b3d10 con 0x7fb8a813f140 2024-04-26T21:16:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.588+0000 7fb8ace00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a80b3ac0 con 0x7fb8a813ed60 2024-04-26T21:16:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.588+0000 7fb8ace00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a80b4920 con 0x7fb8a806eb70 2024-04-26T21:16:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a5e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb8a813ed60 0x7fb8a815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a5e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb8a813ed60 0x7fb8a815c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35680/0 (socket says 172.21.15.106:35680) 2024-04-26T21:16:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a5e00640 1 -- 172.21.15.106:0/3370348841 learned_addr learned my addr 172.21.15.106:0/3370348841 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a5400640 1 --1- 172.21.15.106:0/3370348841 >> v1:172.21.15.106:6789/0 conn(0x7fb8a813f140 0x7fb8a80b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54088/0 (socket says 172.21.15.106:54088) 2024-04-26T21:16:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a6800640 1 --2- 172.21.15.106:0/3370348841 >> v2:172.21.15.112:3300/0 conn(0x7fb8a806eb70 0x7fb8a80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a5e00640 1 -- 172.21.15.106:0/3370348841 >> v2:172.21.15.112:3300/0 conn(0x7fb8a806eb70 msgr2=0x7fb8a80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a5e00640 1 --2- 172.21.15.106:0/3370348841 >> v2:172.21.15.112:3300/0 conn(0x7fb8a806eb70 0x7fb8a80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a5e00640 1 -- 172.21.15.106:0/3370348841 >> v1:172.21.15.106:6789/0 conn(0x7fb8a813f140 legacy=0x7fb8a80b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a5e00640 1 -- 172.21.15.106:0/3370348841 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a80b3ff0 con 0x7fb8a813ed60 2024-04-26T21:16:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a6800640 1 --2- 172.21.15.106:0/3370348841 >> v2:172.21.15.112:3300/0 conn(0x7fb8a806eb70 0x7fb8a80d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:25.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a5e00640 1 --2- 172.21.15.106:0/3370348841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a813ed60 0x7fb8a815c3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80cdcb0 tx=0x7fb89001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afac06e6cf44f529 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:25.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a4a00640 1 -- 172.21.15.106:0/3370348841 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8900b1070 con 0x7fb8a813ed60 2024-04-26T21:16:25.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a4a00640 1 -- 172.21.15.106:0/3370348841 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8900ac640 con 0x7fb8a813ed60 2024-04-26T21:16:25.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.592+0000 7fb8a4a00640 1 -- 172.21.15.106:0/3370348841 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8900aca10 con 0x7fb8a813ed60 2024-04-26T21:16:25.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 -- 172.21.15.106:0/3370348841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a813ed60 msgr2=0x7fb8a815c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 --2- 172.21.15.106:0/3370348841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a813ed60 0x7fb8a815c3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80cdcb0 tx=0x7fb89001c400 comp rx=0 tx=0).stop 2024-04-26T21:16:25.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 -- 172.21.15.106:0/3370348841 shutdown_connections 2024-04-26T21:16:25.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 --2- 172.21.15.106:0/3370348841 >> v2:172.21.15.112:3300/0 conn(0x7fb8a806eb70 0x7fb8a80d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 --2- 172.21.15.106:0/3370348841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a813ed60 0x7fb8a815c3e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 -- 172.21.15.106:0/3370348841 >> 172.21.15.106:0/3370348841 conn(0x7fb8a8068340 msgr2=0x7fb8a8068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:25.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 -- 172.21.15.106:0/3370348841 shutdown_connections 2024-04-26T21:16:25.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 -- 172.21.15.106:0/3370348841 wait complete. 2024-04-26T21:16:25.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 Processor -- start 2024-04-26T21:16:25.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 -- start start 2024-04-26T21:16:25.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8a813ed60 0x7fb8a80aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a81654f0 0x7fb8a814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8a80abc60 0x7fb8a815b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a81607b0 con 0x7fb8a81654f0 2024-04-26T21:16:25.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a8160630 con 0x7fb8a80abc60 2024-04-26T21:16:25.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8ace00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a8168b60 con 0x7fb8a813ed60 2024-04-26T21:16:25.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a81654f0 0x7fb8a814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a81654f0 0x7fb8a814c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35686/0 (socket says 172.21.15.106:35686) 2024-04-26T21:16:25.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5400640 1 -- 172.21.15.106:0/4012829266 learned_addr learned my addr 172.21.15.106:0/4012829266 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a6800640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8a80abc60 0x7fb8a815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5e00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8a813ed60 0x7fb8a80aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5400640 1 -- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8a813ed60 msgr2=0x7fb8a80aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5400640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8a813ed60 0x7fb8a80aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5400640 1 -- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8a80abc60 msgr2=0x7fb8a815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5400640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8a80abc60 0x7fb8a815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5400640 1 -- 172.21.15.106:0/4012829266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a8165970 con 0x7fb8a81654f0 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a6800640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8a80abc60 0x7fb8a815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.596+0000 7fb8a5e00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8a813ed60 0x7fb8a80aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb8a5400640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a81654f0 0x7fb8a814c4d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c3a0 tx=0x7fb89800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb89e000640 1 -- 172.21.15.106:0/4012829266 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8980074e0 con 0x7fb8a81654f0 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb89e000640 1 -- 172.21.15.106:0/4012829266 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb898007680 con 0x7fb8a81654f0 2024-04-26T21:16:25.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a814ca10 con 0x7fb8a81654f0 2024-04-26T21:16:25.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb89e000640 1 -- 172.21.15.106:0/4012829266 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898004a30 con 0x7fb8a81654f0 2024-04-26T21:16:25.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a80aaea0 con 0x7fb8a81654f0 2024-04-26T21:16:25.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a80ab770 con 0x7fb8a81654f0 2024-04-26T21:16:25.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb89e000640 1 -- 172.21.15.106:0/4012829266 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb89801a020 con 0x7fb8a81654f0 2024-04-26T21:16:25.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb89e000640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb8840683b0 0x7fb88406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb89e000640 1 -- 172.21.15.106:0/4012829266 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb898086490 con 0x7fb8a81654f0 2024-04-26T21:16:25.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.600+0000 7fb8a5e00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb8840683b0 0x7fb88406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.604+0000 7fb8a5e00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb8840683b0 0x7fb88406a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8900ae000 tx=0x7fb8900a6070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:25.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.604+0000 7fb89e000640 1 -- 172.21.15.106:0/4012829266 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb8a8165970 con 0x7fb8a81654f0 2024-04-26T21:16:25.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.792+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8a8166970 con 0x7fb8a81654f0 2024-04-26T21:16:25.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.792+0000 7fb89e000640 1 -- 172.21.15.106:0/4012829266 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5186 (secure 0 0 0) 0x7fb8a8166970 con 0x7fb8a81654f0 2024-04-26T21:16:25.796 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:25.797 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:24.824879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:16:25.797 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 7 2024-04-26T21:16:25.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb8840683b0 msgr2=0x7fb88406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb8840683b0 0x7fb88406a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8900ae000 tx=0x7fb8900a6070 comp rx=0 tx=0).stop 2024-04-26T21:16:25.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a81654f0 msgr2=0x7fb8a814c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a81654f0 0x7fb8a814c4d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c3a0 tx=0x7fb89800c860 comp rx=0 tx=0).stop 2024-04-26T21:16:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 shutdown_connections 2024-04-26T21:16:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8a80abc60 0x7fb8a815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb8840683b0 0x7fb88406a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8a81654f0 0x7fb8a814c4d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 --2- 172.21.15.106:0/4012829266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb8a813ed60 0x7fb8a80aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 >> 172.21.15.106:0/4012829266 conn(0x7fb8a8068340 msgr2=0x7fb8a815ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 shutdown_connections 2024-04-26T21:16:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.796+0000 7fb8ace00640 1 -- 172.21.15.106:0/4012829266 wait complete. 2024-04-26T21:16:25.821 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:25.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.952+0000 7f39e8e00640 1 Processor -- start 2024-04-26T21:16:25.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.952+0000 7f39e8e00640 1 -- start start 2024-04-26T21:16:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e8e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 0x7f39e415df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e8e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39e4146870 0x7f39e40d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e8e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e40b3da0 con 0x7f39e4146490 2024-04-26T21:16:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e8e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f39e4160fa0 con 0x7f39e4146870 2024-04-26T21:16:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e8e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f39e4161280 con 0x7f39e4160ac0 2024-04-26T21:16:25.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e2800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39e4146870 0x7f39e40d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e1e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f39e4146490 0x7f39e40cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:56950/0 (socket says 172.21.15.106:56950) 2024-04-26T21:16:25.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e1e00640 1 -- 172.21.15.106:0/1152296881 learned_addr learned my addr 172.21.15.106:0/1152296881 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:25.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39d9400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 0x7f39e415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e2800640 1 -- 172.21.15.106:0/1152296881 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 msgr2=0x7f39e415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:25.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e2800640 1 --2- 172.21.15.106:0/1152296881 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 0x7f39e415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e2800640 1 -- 172.21.15.106:0/1152296881 >> v1:172.21.15.112:6789/0 conn(0x7f39e4146490 legacy=0x7f39e40cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.956+0000 7f39e2800640 1 -- 172.21.15.106:0/1152296881 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e4161560 con 0x7f39e4146870 2024-04-26T21:16:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e2800640 1 --2- 172.21.15.106:0/1152296881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39e4146870 0x7f39e40d0da0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0097c0 tx=0x7f39dc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6783b2bf508b1aa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e1400640 1 -- 172.21.15.106:0/1152296881 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0b0070 con 0x7f39e4146870 2024-04-26T21:16:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e1400640 1 -- 172.21.15.106:0/1152296881 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc0ab600 con 0x7f39e4146870 2024-04-26T21:16:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e1400640 1 -- 172.21.15.106:0/1152296881 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0ab9d0 con 0x7f39e4146870 2024-04-26T21:16:25.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 -- 172.21.15.106:0/1152296881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39e4146870 msgr2=0x7f39e40d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 --2- 172.21.15.106:0/1152296881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39e4146870 0x7f39e40d0da0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0097c0 tx=0x7f39dc01c4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 -- 172.21.15.106:0/1152296881 shutdown_connections 2024-04-26T21:16:25.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 --2- 172.21.15.106:0/1152296881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39e4146870 0x7f39e40d0da0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 --2- 172.21.15.106:0/1152296881 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 0x7f39e415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 -- 172.21.15.106:0/1152296881 >> 172.21.15.106:0/1152296881 conn(0x7f39e4068340 msgr2=0x7f39e4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:25.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 -- 172.21.15.106:0/1152296881 shutdown_connections 2024-04-26T21:16:25.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 -- 172.21.15.106:0/1152296881 wait complete. 2024-04-26T21:16:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 Processor -- start 2024-04-26T21:16:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.960+0000 7f39e8e00640 1 -- start start 2024-04-26T21:16:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e8e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39e4146490 0x7f39e4143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e8e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39e4146870 0x7f39e41536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e8e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 0x7f39e4140950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e8e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40b5150 con 0x7f39e4146870 2024-04-26T21:16:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e8e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40b4fd0 con 0x7f39e4146490 2024-04-26T21:16:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e8e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f39e4169e60 con 0x7f39e4160ac0 2024-04-26T21:16:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39d9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39e4146870 0x7f39e41536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39d9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39e4146870 0x7f39e41536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35692/0 (socket says 172.21.15.106:35692) 2024-04-26T21:16:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39d9400640 1 -- 172.21.15.106:0/3122145638 learned_addr learned my addr 172.21.15.106:0/3122145638 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e2800640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 0x7f39e4140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e1e00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39e4146490 0x7f39e4143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39d9400640 1 -- 172.21.15.106:0/3122145638 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 msgr2=0x7f39e4140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39d9400640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 0x7f39e4140950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39d9400640 1 -- 172.21.15.106:0/3122145638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39e4146490 msgr2=0x7f39e4143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39d9400640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39e4146490 0x7f39e4143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39d9400640 1 -- 172.21.15.106:0/3122145638 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e413c450 con 0x7f39e4146870 2024-04-26T21:16:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39d9400640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39e4146870 0x7f39e41536d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00e930 tx=0x7f39cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39daa00640 1 -- 172.21.15.106:0/3122145638 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc017070 con 0x7f39e4146870 2024-04-26T21:16:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39daa00640 1 -- 172.21.15.106:0/3122145638 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc00ca00 con 0x7f39e4146870 2024-04-26T21:16:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e413c730 con 0x7f39e4146870 2024-04-26T21:16:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39daa00640 1 -- 172.21.15.106:0/3122145638 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00cdb0 con 0x7f39e4146870 2024-04-26T21:16:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e413ccf0 con 0x7f39e4146870 2024-04-26T21:16:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e4069400 con 0x7f39e4146870 2024-04-26T21:16:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.964+0000 7f39daa00640 1 -- 172.21.15.106:0/3122145638 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39cc01a070 con 0x7f39e4146870 2024-04-26T21:16:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.968+0000 7f39daa00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f39c0068380 0x7f39c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.968+0000 7f39daa00640 1 -- 172.21.15.106:0/3122145638 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f39cc087170 con 0x7f39e4146870 2024-04-26T21:16:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.968+0000 7f39e1e00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f39c0068380 0x7f39c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.968+0000 7f39e1e00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f39c0068380 0x7f39c006a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39d40012f0 tx=0x7f39d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:25.972+0000 7f39daa00640 1 -- 172.21.15.106:0/3122145638 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f39cc057410 con 0x7f39e4146870 2024-04-26T21:16:26.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.128+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39e4073d70 con 0x7f39e4146870 2024-04-26T21:16:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.128+0000 7f39daa00640 1 -- 172.21.15.106:0/3122145638 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7f39cc056d10 con 0x7f39e4146870 2024-04-26T21:16:26.132 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:26.132 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f39c0068380 msgr2=0x7f39c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f39c0068380 0x7f39c006a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39d40012f0 tx=0x7f39d4009040 comp rx=0 tx=0).stop 2024-04-26T21:16:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39e4146870 msgr2=0x7f39e41536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39e4146870 0x7f39e41536d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00e930 tx=0x7f39cc00edf0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 shutdown_connections 2024-04-26T21:16:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f39c0068380 0x7f39c006a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f39e4160ac0 0x7f39e4140950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39e4146870 0x7f39e41536d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 --2- 172.21.15.106:0/3122145638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39e4146490 0x7f39e4143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 >> 172.21.15.106:0/3122145638 conn(0x7f39e4068340 msgr2=0x7f39e40b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 shutdown_connections 2024-04-26T21:16:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.132+0000 7f39e8e00640 1 -- 172.21.15.106:0/3122145638 wait complete. 2024-04-26T21:16:26.154 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:26.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.284+0000 7fdd9ec00640 1 Processor -- start 2024-04-26T21:16:26.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9ec00640 1 -- start start 2024-04-26T21:16:26.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9ec00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdd9815f5a0 0x7fdd980710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9ec00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd98070030 con 0x7fdd9815f980 2024-04-26T21:16:26.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9ec00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd98070310 con 0x7fdd9815d3a0 2024-04-26T21:16:26.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9ec00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fdd980705f0 con 0x7fdd9815f5a0 2024-04-26T21:16:26.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9d800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdd9815f5a0 0x7fdd980710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9d800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdd9815f5a0 0x7fdd980710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35704/0 (socket says 172.21.15.106:35704) 2024-04-26T21:16:26.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9d800640 1 -- 172.21.15.106:0/1329432329 learned_addr learned my addr 172.21.15.106:0/1329432329 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:26.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9d800640 1 -- 172.21.15.106:0/1329432329 >> v1:172.21.15.112:6789/0 conn(0x7fdd9815d3a0 legacy=0x7fdd9815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9d800640 1 -- 172.21.15.106:0/1329432329 >> v1:172.21.15.106:6789/0 conn(0x7fdd9815f980 legacy=0x7fdd980d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.288+0000 7fdd9d800640 1 -- 172.21.15.106:0/1329432329 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd980708d0 con 0x7fdd9815f5a0 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9d800640 1 --2- 172.21.15.106:0/1329432329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f5a0 0x7fdd980710d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009870 tx=0x7fdd8c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38af0c75f622377 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd97e00640 1 -- 172.21.15.106:0/1329432329 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0ab660 con 0x7fdd9815f5a0 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd97e00640 1 -- 172.21.15.106:0/1329432329 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8c0b0070 con 0x7fdd9815f5a0 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd97e00640 1 -- 172.21.15.106:0/1329432329 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0aba20 con 0x7fdd9815f5a0 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9ec00640 1 -- 172.21.15.106:0/1329432329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f5a0 msgr2=0x7fdd980710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9ec00640 1 --2- 172.21.15.106:0/1329432329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f5a0 0x7fdd980710d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009870 tx=0x7fdd8c01c4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9ec00640 1 -- 172.21.15.106:0/1329432329 shutdown_connections 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9ec00640 1 --2- 172.21.15.106:0/1329432329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f5a0 0x7fdd980710d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9ec00640 1 -- 172.21.15.106:0/1329432329 >> 172.21.15.106:0/1329432329 conn(0x7fdd980b46f0 msgr2=0x7fdd980b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9ec00640 1 -- 172.21.15.106:0/1329432329 shutdown_connections 2024-04-26T21:16:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9ec00640 1 -- 172.21.15.106:0/1329432329 wait complete. 2024-04-26T21:16:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9ec00640 1 Processor -- start 2024-04-26T21:16:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.292+0000 7fdd9ec00640 1 -- start start 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9815d3a0 0x7fdd98159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ec00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd9815f5a0 0x7fdd98154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f980 0x7fdd981554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdd980d2180 con 0x7fdd9815f980 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd980d2000 con 0x7fdd9815d3a0 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ec00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9816d6a0 con 0x7fdd9815f5a0 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9e200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f980 0x7fdd981554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9e200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f980 0x7fdd981554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35710/0 (socket says 172.21.15.106:35710) 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9e200640 1 -- 172.21.15.106:0/3821077295 learned_addr learned my addr 172.21.15.106:0/3821077295 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9d800640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9815d3a0 0x7fdd98159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ce00640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd9815f5a0 0x7fdd98154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9e200640 1 -- 172.21.15.106:0/3821077295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd9815f5a0 msgr2=0x7fdd98154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9e200640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd9815f5a0 0x7fdd98154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9e200640 1 -- 172.21.15.106:0/3821077295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9815d3a0 msgr2=0x7fdd98159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9e200640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9815d3a0 0x7fdd98159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9e200640 1 -- 172.21.15.106:0/3821077295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd980b12b0 con 0x7fdd9815f980 2024-04-26T21:16:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9e200640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f980 0x7fdd981554c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c7a0 tx=0x7fdd9000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:26.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd95600640 1 -- 172.21.15.106:0/3821077295 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90003b80 con 0x7fdd9815f980 2024-04-26T21:16:26.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd95600640 1 -- 172.21.15.106:0/3821077295 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd90003d20 con 0x7fdd9815f980 2024-04-26T21:16:26.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd980b1590 con 0x7fdd9815f980 2024-04-26T21:16:26.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd95600640 1 -- 172.21.15.106:0/3821077295 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9000aa90 con 0x7fdd9815f980 2024-04-26T21:16:26.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd980b1b50 con 0x7fdd9815f980 2024-04-26T21:16:26.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.296+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd980b1d50 con 0x7fdd9815f980 2024-04-26T21:16:26.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.300+0000 7fdd95600640 1 -- 172.21.15.106:0/3821077295 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd9000ac30 con 0x7fdd9815f980 2024-04-26T21:16:26.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.300+0000 7fdd95600640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdd78068380 0x7fdd7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.300+0000 7fdd95600640 1 -- 172.21.15.106:0/3821077295 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdd90086bd0 con 0x7fdd9815f980 2024-04-26T21:16:26.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.300+0000 7fdd9d800640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdd78068380 0x7fdd7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.300+0000 7fdd9d800640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdd78068380 0x7fdd7806a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0af000 tx=0x7fdd8c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:26.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.304+0000 7fdd95600640 1 -- 172.21.15.106:0/3821077295 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdd900566d0 con 0x7fdd9815f980 2024-04-26T21:16:26.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd98069b10 con 0x7fdd9815f980 2024-04-26T21:16:26.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd95600640 1 -- 172.21.15.106:0/3821077295 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7fdd9005a9d0 con 0x7fdd9815f980 2024-04-26T21:16:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:26.467 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:26.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdd78068380 msgr2=0x7fdd7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdd78068380 0x7fdd7806a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0af000 tx=0x7fdd8c0a7000 comp rx=0 tx=0).stop 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f980 msgr2=0x7fdd981554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f980 0x7fdd981554c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c7a0 tx=0x7fdd9000cc60 comp rx=0 tx=0).stop 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 shutdown_connections 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdd78068380 0x7fdd7806a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd9815f980 0x7fdd981554c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdd9815f5a0 0x7fdd98154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 --2- 172.21.15.106:0/3821077295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9815d3a0 0x7fdd98159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.464+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 >> 172.21.15.106:0/3821077295 conn(0x7fdd980b46f0 msgr2=0x7fdd980b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.468+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 shutdown_connections 2024-04-26T21:16:26.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.468+0000 7fdd9ec00640 1 -- 172.21.15.106:0/3821077295 wait complete. 2024-04-26T21:16:26.502 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:16:26.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb1ea00640 1 Processor -- start 2024-04-26T21:16:26.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb1ea00640 1 -- start start 2024-04-26T21:16:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb1ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb180cec60 0x7feb18169df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb1ea00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb180d0300 con 0x7feb180d37f0 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb1ea00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb180d1d70 con 0x7feb1815f3d0 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb1ea00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7feb180d2050 con 0x7feb180cec60 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb17400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7feb180d37f0 0x7feb180cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54106/0 (socket says 172.21.15.106:54106) 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb17400640 1 -- 172.21.15.106:0/3713012981 learned_addr learned my addr 172.21.15.106:0/3713012981 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb1ca00640 1 --2- 172.21.15.106:0/3713012981 >> v2:172.21.15.112:3300/0 conn(0x7feb180cec60 0x7feb18169df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 150905267 0 0) 0x7feb180d0300 con 0x7feb180d37f0 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feafc003530 con 0x7feb180d37f0 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2259891038 0 0) 0x7feafc003530 con 0x7feb180d37f0 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 >> v2:172.21.15.112:3300/0 conn(0x7feb180cec60 msgr2=0x7feb18169df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 --2- 172.21.15.106:0/3713012981 >> v2:172.21.15.112:3300/0 conn(0x7feb180cec60 0x7feb18169df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 >> v1:172.21.15.112:6789/0 conn(0x7feb1815f3d0 legacy=0x7feb180cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb180cd450 con 0x7feb180d37f0 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7feb04001680 con 0x7feb180d37f0 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb1ca00640 1 --2- 172.21.15.106:0/3713012981 >> v2:172.21.15.112:3300/0 conn(0x7feb180cec60 0x7feb18169df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 >> v1:172.21.15.106:6789/0 conn(0x7feb180d37f0 legacy=0x7feb180cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0039c0 0x7feafc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feafc004810 0x7feafc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feafc0051d0 0x7feafc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feb180d2050 con 0x7feafc0051d0 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feafc00c070 con 0x7feafc0039c0 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7feafc00c270 con 0x7feafc004810 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb1ca00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feafc0051d0 0x7feafc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb17e00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0039c0 0x7feafc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.636+0000 7feb17400640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feafc004810 0x7feafc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ca00640 1 -- 172.21.15.106:0/3713012981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feafc004810 msgr2=0x7feafc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ca00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feafc004810 0x7feafc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ca00640 1 -- 172.21.15.106:0/3713012981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0039c0 msgr2=0x7feafc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ca00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0039c0 0x7feafc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ca00640 1 -- 172.21.15.106:0/3713012981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc003530 con 0x7feafc0051d0 2024-04-26T21:16:26.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ca00640 1 -- 172.21.15.106:0/3713012981 reap_dead start 2024-04-26T21:16:26.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ca00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feafc0051d0 0x7feafc00b9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb10009cb0 tx=0x7feb1001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a568cb1473610 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:26.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10009880 con 0x7feafc0051d0 2024-04-26T21:16:26.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb10004020 con 0x7feafc0051d0 2024-04-26T21:16:26.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb16a00640 1 -- 172.21.15.106:0/3713012981 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10004410 con 0x7feafc0051d0 2024-04-26T21:16:26.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ea00640 1 -- 172.21.15.106:0/3713012981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feafc0051d0 msgr2=0x7feafc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ea00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feafc0051d0 0x7feafc00b9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb10009cb0 tx=0x7feb1001cc90 comp rx=0 tx=0).stop 2024-04-26T21:16:26.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ea00640 1 -- 172.21.15.106:0/3713012981 shutdown_connections 2024-04-26T21:16:26.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ea00640 1 --2- 172.21.15.106:0/3713012981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feafc0051d0 0x7feafc00b9d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ea00640 1 -- 172.21.15.106:0/3713012981 >> 172.21.15.106:0/3713012981 conn(0x7feb180d2c60 msgr2=0x7feb180d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:26.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ea00640 1 -- 172.21.15.106:0/3713012981 shutdown_connections 2024-04-26T21:16:26.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.640+0000 7feb1ea00640 1 -- 172.21.15.106:0/3713012981 wait complete. 2024-04-26T21:16:26.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 Processor -- start 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 -- start start 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0051d0 0x7feb1815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb180b35a0 0x7feb181f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb1809e460 0x7feb1809e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feb180d1b00 con 0x7feb180b35a0 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feb180d1980 con 0x7feafc0051d0 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7feb180cf4e0 con 0x7feb1809e460 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb180b35a0 0x7feb181f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb180b35a0 0x7feb181f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35736/0 (socket says 172.21.15.106:35736) 2024-04-26T21:16:26.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17400640 1 -- 172.21.15.106:0/3245249893 learned_addr learned my addr 172.21.15.106:0/3245249893 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17400640 1 -- 172.21.15.106:0/3245249893 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb1809e460 msgr2=0x7feb1809e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17400640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb1809e460 0x7feb1809e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17400640 1 -- 172.21.15.106:0/3245249893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0051d0 msgr2=0x7feb1815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17e00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0051d0 0x7feb1815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17400640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0051d0 0x7feb1815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17400640 1 -- 172.21.15.106:0/3245249893 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1809cae0 con 0x7feb180b35a0 2024-04-26T21:16:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17e00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0051d0 0x7feb1815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb17400640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb180b35a0 0x7feb181f4d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb0400e7b0 tx=0x7feb0400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb0fe00640 1 -- 172.21.15.106:0/3245249893 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0400c6c0 con 0x7feb180b35a0 2024-04-26T21:16:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb0fe00640 1 -- 172.21.15.106:0/3245249893 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb04018070 con 0x7feb180b35a0 2024-04-26T21:16:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb181f55d0 con 0x7feb180b35a0 2024-04-26T21:16:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb0fe00640 1 -- 172.21.15.106:0/3245249893 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0400cac0 con 0x7feb180b35a0 2024-04-26T21:16:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.644+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb181f5b90 con 0x7feb180b35a0 2024-04-26T21:16:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.648+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb18069400 con 0x7feb180b35a0 2024-04-26T21:16:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.648+0000 7feb0fe00640 1 -- 172.21.15.106:0/3245249893 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb0400cc60 con 0x7feb180b35a0 2024-04-26T21:16:26.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.648+0000 7feb0fe00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feaf80683b0 0x7feaf806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.648+0000 7feb0fe00640 1 -- 172.21.15.106:0/3245249893 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7feb04086890 con 0x7feb180b35a0 2024-04-26T21:16:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.648+0000 7feb17e00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feaf80683b0 0x7feaf806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.648+0000 7feb17e00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feaf80683b0 0x7feaf806a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb08000f90 tx=0x7feb08009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:26.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.652+0000 7feb0fe00640 1 -- 172.21.15.106:0/3245249893 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feb04056a70 con 0x7feb180b35a0 2024-04-26T21:16:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.840+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb180c95c0 con 0x7feb180b35a0 2024-04-26T21:16:26.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.840+0000 7feb0fe00640 1 -- 172.21.15.106:0/3245249893 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5186 (secure 0 0 0) 0x7feb04056370 con 0x7feb180b35a0 2024-04-26T21:16:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:26.843 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:24.824879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:16:26.844 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 7 2024-04-26T21:16:26.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feaf80683b0 msgr2=0x7feaf806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feaf80683b0 0x7feaf806a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb08000f90 tx=0x7feb08009040 comp rx=0 tx=0).stop 2024-04-26T21:16:26.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb180b35a0 msgr2=0x7feb181f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:26.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb180b35a0 0x7feb181f4d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb0400e7b0 tx=0x7feb0400ec70 comp rx=0 tx=0).stop 2024-04-26T21:16:26.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 shutdown_connections 2024-04-26T21:16:26.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feaf80683b0 0x7feaf806a870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feb1809e460 0x7feb1809e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb180b35a0 0x7feb181f4d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 --2- 172.21.15.106:0/3245249893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feafc0051d0 0x7feb1815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:26.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 >> 172.21.15.106:0/3245249893 conn(0x7feb180d2c60 msgr2=0x7feb180d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:26.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 shutdown_connections 2024-04-26T21:16:26.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.844+0000 7feb1ea00640 1 -- 172.21.15.106:0/3245249893 wait complete. 2024-04-26T21:16:26.864 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:26.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.996+0000 7f8990c00640 1 Processor -- start 2024-04-26T21:16:26.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.996+0000 7f8990c00640 1 -- start start 2024-04-26T21:16:27.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.996+0000 7f8990c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f898c146490 0x7f898c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.996+0000 7f8990c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c146870 0x7f898c0d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.996+0000 7f8990c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898c0b3da0 con 0x7f898c160ac0 2024-04-26T21:16:27.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.996+0000 7f8990c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f898c160fa0 con 0x7f898c146490 2024-04-26T21:16:27.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:26.996+0000 7f8990c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f898c161280 con 0x7f898c146870 2024-04-26T21:16:27.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8981400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f898c160ac0 0x7f898c0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33968/0 (socket says 172.21.15.106:33968) 2024-04-26T21:16:27.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8981400640 1 -- 172.21.15.106:0/47310520 learned_addr learned my addr 172.21.15.106:0/47310520 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f898a800640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c146870 0x7f898c0d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989e00640 1 --2- 172.21.15.106:0/47310520 >> v2:172.21.15.112:3300/0 conn(0x7f898c146490 0x7f898c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408462368 0 0) 0x7f898c0b3da0 con 0x7f898c160ac0 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8970003530 con 0x7f898c160ac0 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2678528590 0 0) 0x7f8970003530 con 0x7f898c160ac0 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c146870 msgr2=0x7f898c0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c146870 0x7f898c0d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 >> v2:172.21.15.112:3300/0 conn(0x7f898c146490 msgr2=0x7f898c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 --2- 172.21.15.106:0/47310520 >> v2:172.21.15.112:3300/0 conn(0x7f898c146490 0x7f898c15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c161560 con 0x7f898c160ac0 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f89740016a0 con 0x7f898c160ac0 2024-04-26T21:16:27.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989e00640 1 --2- 172.21.15.106:0/47310520 >> v2:172.21.15.112:3300/0 conn(0x7f898c146490 0x7f898c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 >> v1:172.21.15.106:6789/0 conn(0x7f898c160ac0 legacy=0x7f898c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89700039c0 0x7f8970003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c146870 0x7f8970004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8970004d50 0x7f89700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f898c160fa0 con 0x7f8970004d50 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f898c161280 con 0x7f89700039c0 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f897000b9d0 con 0x7f898c146870 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f898a800640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8970004d50 0x7f89700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8989e00640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89700039c0 0x7f8970003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8981400640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c146870 0x7f8970004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f898a800640 1 -- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c146870 msgr2=0x7f8970004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f898a800640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c146870 0x7f8970004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f898a800640 1 -- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89700039c0 msgr2=0x7f8970003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f898a800640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89700039c0 0x7f8970003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f898a800640 1 -- 172.21.15.106:0/47310520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8970003530 con 0x7f8970004d50 2024-04-26T21:16:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.000+0000 7f8981400640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c146870 0x7f8970004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f898a800640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8970004d50 0x7f89700051d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8984009a90 tx=0x7f898401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce48c4eadde0fa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89840b2070 con 0x7f8970004d50 2024-04-26T21:16:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89840a5620 con 0x7f8970004d50 2024-04-26T21:16:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8989400640 1 -- 172.21.15.106:0/47310520 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8984009690 con 0x7f8970004d50 2024-04-26T21:16:27.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8990c00640 1 -- 172.21.15.106:0/47310520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8970004d50 msgr2=0x7f89700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8990c00640 1 --2- 172.21.15.106:0/47310520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8970004d50 0x7f89700051d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8984009a90 tx=0x7f898401ca30 comp rx=0 tx=0).stop 2024-04-26T21:16:27.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f898a800640 1 -- 172.21.15.106:0/47310520 reap_dead start 2024-04-26T21:16:27.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8990c00640 1 -- 172.21.15.106:0/47310520 shutdown_connections 2024-04-26T21:16:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8990c00640 1 -- 172.21.15.106:0/47310520 >> 172.21.15.106:0/47310520 conn(0x7f898c068340 msgr2=0x7f898c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8990c00640 1 -- 172.21.15.106:0/47310520 shutdown_connections 2024-04-26T21:16:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8990c00640 1 -- 172.21.15.106:0/47310520 wait complete. 2024-04-26T21:16:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8990c00640 1 Processor -- start 2024-04-26T21:16:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.004+0000 7f8990c00640 1 -- start start 2024-04-26T21:16:27.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8990c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8970004d50 0x7f898c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8990c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f898c153690 0x7f898c1f8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8990c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c1f8cc0 0x7f898c15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8990c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f898c0d0da0 con 0x7f898c153690 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8990c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f898c0b4090 con 0x7f8970004d50 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8990c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f898c0d0f20 con 0x7f898c1f8cc0 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8981400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f898c153690 0x7f898c1f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8981400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f898c153690 0x7f898c1f8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45860/0 (socket says 172.21.15.106:45860) 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8981400640 1 -- 172.21.15.106:0/1531715920 learned_addr learned my addr 172.21.15.106:0/1531715920 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8989e00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8970004d50 0x7f898c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f898a800640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c1f8cc0 0x7f898c15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8981400640 1 -- 172.21.15.106:0/1531715920 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c1f8cc0 msgr2=0x7f898c15ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8981400640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c1f8cc0 0x7f898c15ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8981400640 1 -- 172.21.15.106:0/1531715920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8970004d50 msgr2=0x7f898c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8981400640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8970004d50 0x7f898c155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8981400640 1 -- 172.21.15.106:0/1531715920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c1f9160 con 0x7f898c153690 2024-04-26T21:16:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8981400640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f898c153690 0x7f898c1f8780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8974000fe0 tx=0x7f897400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8982a00640 1 -- 172.21.15.106:0/1531715920 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897400c8d0 con 0x7f898c153690 2024-04-26T21:16:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8982a00640 1 -- 172.21.15.106:0/1531715920 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8974018070 con 0x7f898c153690 2024-04-26T21:16:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898c1f9440 con 0x7f898c153690 2024-04-26T21:16:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8982a00640 1 -- 172.21.15.106:0/1531715920 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897400cc70 con 0x7f898c153690 2024-04-26T21:16:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898c1e6aa0 con 0x7f898c153690 2024-04-26T21:16:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898c1545b0 con 0x7f898c153690 2024-04-26T21:16:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.008+0000 7f8982a00640 1 -- 172.21.15.106:0/1531715920 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f897401d460 con 0x7f898c153690 2024-04-26T21:16:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.012+0000 7f8982a00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8968068380 0x7f896806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.012+0000 7f8982a00640 1 -- 172.21.15.106:0/1531715920 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8974086b10 con 0x7f898c153690 2024-04-26T21:16:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.012+0000 7f8989e00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8968068380 0x7f896806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.012+0000 7f8989e00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8968068380 0x7f896806a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f897c009a40 tx=0x7f897c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.016+0000 7f8982a00640 1 -- 172.21.15.106:0/1531715920 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f898c1545b0 con 0x7f898c153690 2024-04-26T21:16:27.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.172+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f898c069400 con 0x7f898c153690 2024-04-26T21:16:27.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.172+0000 7f8982a00640 1 -- 172.21.15.106:0/1531715920 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7f8974056740 con 0x7f898c153690 2024-04-26T21:16:27.176 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:27.176 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:27.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8968068380 msgr2=0x7f896806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8968068380 0x7f896806a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f897c009a40 tx=0x7f897c00b040 comp rx=0 tx=0).stop 2024-04-26T21:16:27.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f898c153690 msgr2=0x7f898c1f8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f898c153690 0x7f898c1f8780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8974000fe0 tx=0x7f897400eca0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 shutdown_connections 2024-04-26T21:16:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8968068380 0x7f896806a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f898c1f8cc0 0x7f898c15ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f898c153690 0x7f898c1f8780 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 --2- 172.21.15.106:0/1531715920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8970004d50 0x7f898c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 >> 172.21.15.106:0/1531715920 conn(0x7f898c068340 msgr2=0x7f898c0cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 shutdown_connections 2024-04-26T21:16:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.176+0000 7f8990c00640 1 -- 172.21.15.106:0/1531715920 wait complete. 2024-04-26T21:16:27.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:16:19.820202+0000', 'modified': '2024-04-26T21:16:24.824879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6835/3320582993', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6833', 'nonce': 3320582993}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 3320582993}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-04-26T21:16:27.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T21:16:27.602 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-26T21:16:27.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba9c00640 1 Processor -- start 2024-04-26T21:16:27.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba9c00640 1 -- start start 2024-04-26T21:16:27.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba9c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffba415f0c0 0x7ffba40cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba9c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffba40ce900 0x7ffba40cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba9c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba40cd160 con 0x7ffba40d3560 2024-04-26T21:16:27.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba9c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ffba40d1850 con 0x7ffba415f0c0 2024-04-26T21:16:27.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba9c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ffba415f4a0 con 0x7ffba40ce900 2024-04-26T21:16:27.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffba415f0c0 0x7ffba40cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba3400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ffba40d3560 0x7ffba406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33982/0 (socket says 172.21.15.106:33982) 2024-04-26T21:16:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba3400640 1 -- 172.21.15.106:0/2882662079 learned_addr learned my addr 172.21.15.106:0/2882662079 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba3e00640 1 -- 172.21.15.106:0/2882662079 >> v2:172.21.15.112:3300/0 conn(0x7ffba40ce900 msgr2=0x7ffba40cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba9200640 1 --2- 172.21.15.106:0/2882662079 >> v2:172.21.15.112:3300/0 conn(0x7ffba40ce900 0x7ffba40cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba3e00640 1 --2- 172.21.15.106:0/2882662079 >> v2:172.21.15.112:3300/0 conn(0x7ffba40ce900 0x7ffba40cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba2a00640 1 -- 172.21.15.106:0/2882662079 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3765880771 0 0) 0x7ffba40cd160 con 0x7ffba40d3560 2024-04-26T21:16:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba3e00640 1 -- 172.21.15.106:0/2882662079 >> v1:172.21.15.106:6789/0 conn(0x7ffba40d3560 legacy=0x7ffba406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba3e00640 1 -- 172.21.15.106:0/2882662079 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba40d1aa0 con 0x7ffba415f0c0 2024-04-26T21:16:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.736+0000 7ffba9200640 1 --2- 172.21.15.106:0/2882662079 >> v2:172.21.15.112:3300/0 conn(0x7ffba40ce900 0x7ffba40cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba3e00640 1 --2- 172.21.15.106:0/2882662079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba415f0c0 0x7ffba40cf2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffba40cf0b0 tx=0x7ffb8c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df6b8eae9f42281 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba2a00640 1 -- 172.21.15.106:0/2882662079 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0b0070 con 0x7ffba415f0c0 2024-04-26T21:16:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba2a00640 1 -- 172.21.15.106:0/2882662079 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0ab600 con 0x7ffba415f0c0 2024-04-26T21:16:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba2a00640 1 -- 172.21.15.106:0/2882662079 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0ab9d0 con 0x7ffba415f0c0 2024-04-26T21:16:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba9c00640 1 -- 172.21.15.106:0/2882662079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba415f0c0 msgr2=0x7ffba40cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba9c00640 1 --2- 172.21.15.106:0/2882662079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba415f0c0 0x7ffba40cf2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffba40cf0b0 tx=0x7ffb8c01c450 comp rx=0 tx=0).stop 2024-04-26T21:16:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba9c00640 1 -- 172.21.15.106:0/2882662079 shutdown_connections 2024-04-26T21:16:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba9c00640 1 --2- 172.21.15.106:0/2882662079 >> v2:172.21.15.112:3300/0 conn(0x7ffba40ce900 0x7ffba40cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba9c00640 1 --2- 172.21.15.106:0/2882662079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba415f0c0 0x7ffba40cf2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba9c00640 1 -- 172.21.15.106:0/2882662079 >> 172.21.15.106:0/2882662079 conn(0x7ffba40d2a70 msgr2=0x7ffba40d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba9c00640 1 -- 172.21.15.106:0/2882662079 shutdown_connections 2024-04-26T21:16:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.740+0000 7ffba9c00640 1 -- 172.21.15.106:0/2882662079 wait complete. 2024-04-26T21:16:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 Processor -- start 2024-04-26T21:16:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 -- start start 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffba40ce900 0x7ffba4156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba40d3560 0x7ffba414da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba415f0c0 0x7ffba40b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffba40d0230 con 0x7ffba40d3560 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffba40c9800 con 0x7ffba415f0c0 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ffba40b49c0 con 0x7ffba40ce900 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba40d3560 0x7ffba414da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba40d3560 0x7ffba414da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45868/0 (socket says 172.21.15.106:45868) 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3400640 1 -- 172.21.15.106:0/1338630916 learned_addr learned my addr 172.21.15.106:0/1338630916 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9200640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba415f0c0 0x7ffba40b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3e00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffba40ce900 0x7ffba4156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3400640 1 -- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffba40ce900 msgr2=0x7ffba4156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3400640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffba40ce900 0x7ffba4156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3400640 1 -- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba415f0c0 msgr2=0x7ffba40b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3400640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba415f0c0 0x7ffba40b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3400640 1 -- 172.21.15.106:0/1338630916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba414dfa0 con 0x7ffba40d3560 2024-04-26T21:16:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9200640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba415f0c0 0x7ffba40b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3e00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffba40ce900 0x7ffba4156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba3400640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba40d3560 0x7ffba414da60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400c480 tx=0x7ffb9400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffb9be00640 1 -- 172.21.15.106:0/1338630916 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94018070 con 0x7ffba40d3560 2024-04-26T21:16:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffb9be00640 1 -- 172.21.15.106:0/1338630916 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb94007500 con 0x7ffba40d3560 2024-04-26T21:16:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffb9be00640 1 -- 172.21.15.106:0/1338630916 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94004a30 con 0x7ffba40d3560 2024-04-26T21:16:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 -- 172.21.15.106:0/1338630916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba40b4410 con 0x7ffba40d3560 2024-04-26T21:16:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.744+0000 7ffba9c00640 1 -- 172.21.15.106:0/1338630916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba41559a0 con 0x7ffba40d3560 2024-04-26T21:16:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffb9be00640 1 -- 172.21.15.106:0/1338630916 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb94004bd0 con 0x7ffba40d3560 2024-04-26T21:16:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffb9be00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffb80068380 0x7ffb8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffb9be00640 1 -- 172.21.15.106:0/1338630916 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffb94085ec0 con 0x7ffba40d3560 2024-04-26T21:16:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffba3e00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffb80068380 0x7ffb8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffbae7b8000 1 Processor -- start 2024-04-26T21:16:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffba3e00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffb80068380 0x7ffb8006a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0ad000 tx=0x7ffb8c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffbae7b8000 1 -- start start 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 0x55e21548fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215446200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e215446b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e2152fe140 con 0x55e215490020 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e215293e00 con 0x55e215446740 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55e21524ca00 con 0x55e21548f700 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffba3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215446200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffba3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215446200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45876/0 (socket says 172.21.15.106:45876) 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffba3400640 1 -- 172.21.15.106:0/40906657 learned_addr learned my addr 172.21.15.106:0/40906657 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffba9200640 1 --2- 172.21.15.106:0/40906657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e215446b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.748+0000 7ffba3e00640 1 --2- 172.21.15.106:0/40906657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 0x55e21548fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba3400640 1 -- 172.21.15.106:0/40906657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 msgr2=0x55e21548fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba3400640 1 --2- 172.21.15.106:0/40906657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 0x55e21548fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba3400640 1 -- 172.21.15.106:0/40906657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 msgr2=0x55e215446b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba3400640 1 --2- 172.21.15.106:0/40906657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e215446b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba3400640 1 -- 172.21.15.106:0/40906657 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2152510e0 con 0x55e215490020 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba3400640 1 --2- 172.21.15.106:0/40906657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215446200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb94055730 tx=0x7ffb94055af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7aa278da99511b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffb98c00640 1 -- 172.21.15.106:0/40906657 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94053d30 con 0x55e215490020 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffb98c00640 1 -- 172.21.15.106:0/40906657 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb94084120 con 0x55e215490020 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffb98c00640 1 -- 172.21.15.106:0/40906657 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9405c070 con 0x55e215490020 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 -- 172.21.15.106:0/40906657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 msgr2=0x55e215446200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/40906657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215446200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb94055730 tx=0x7ffb94055af0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 -- 172.21.15.106:0/40906657 shutdown_connections 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/40906657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e215446b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/40906657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215446200 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/40906657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 0x55e21548fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 -- 172.21.15.106:0/40906657 >> 172.21.15.106:0/40906657 conn(0x55e2154426f0 msgr2=0x55e215444ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 -- 172.21.15.106:0/40906657 shutdown_connections 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 -- 172.21.15.106:0/40906657 wait complete. 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 -- start start 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 Processor -- start 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215446740 0x55e2154510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e21548f700 0x55e2154515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215451b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e2152a1200 con 0x55e215490020 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e215237e80 con 0x55e21548f700 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55e21528eae0 con 0x55e215446740 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffbae7b8000 10 client.0 _ll_register_callbacks cb 0x55e2152a0da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:16:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215451b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215451b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45882/0 (socket says 172.21.15.106:45882) 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba9200640 1 -- 172.21.15.106:0/2070990506 learned_addr learned my addr 172.21.15.106:0/2070990506 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba3e00640 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215446740 0x55e2154510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba3400640 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e21548f700 0x55e2154515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba9200640 1 -- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215446740 msgr2=0x55e2154510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba9200640 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215446740 0x55e2154510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba9200640 1 -- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e21548f700 msgr2=0x55e2154515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba9200640 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e21548f700 0x55e2154515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.752+0000 7ffba9200640 1 -- 172.21.15.106:0/2070990506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2152334e0 con 0x55e215490020 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffba9200640 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215451b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c010bd0 tx=0x7ffb9c00e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a646ce164bef8c1b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 1 -- 172.21.15.106:0/2070990506 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c01d060 con 0x55e215490020 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 -- 172.21.15.106:0/2070990506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb94084120 con 0x55e215490020 2024-04-26T21:16:27.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 1 -- 172.21.15.106:0/2070990506 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffb9c00a780 con 0x55e215490020 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 1 -- 172.21.15.106:0/2070990506 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7ffb9c023050 con 0x55e215490020 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 10 client.4419 fetch_fsmap learned FSMap version 7 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 -- 172.21.15.106:0/2070990506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55e215219e80 con 0x55e215490020 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 1 -- 172.21.15.106:0/2070990506 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb94084120 con 0x55e215490020 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 1 -- 172.21.15.106:0/2070990506 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7ffb9c026020 con 0x55e215490020 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 10 client.4419 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 20 client.4419 populate_metadata read hostname 'smithi106' 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x55e215452530 0x55e2154a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 4 client.4419 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 -- 172.21.15.106:0/2070990506 --> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e21522cbc0 con 0x55e215452530 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffba3e00640 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x55e215452530 0x55e2154a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffba3e00640 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x55e215452530 0x55e2154a17b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d06901517a0a7c53 server_cookie=8e761d589f2b22c1 in_seq=0 out_seq=0 2024-04-26T21:16:27.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 10 client.4419 ms_handle_connect on v2:172.21.15.112:6833/3320582993 2024-04-26T21:16:27.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 1 -- 172.21.15.106:0/2070990506 <== mds.0 v2:172.21.15.112:6833/3320582993 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e21522cbc0 con 0x55e215452530 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 10 client.4419 handle_command_reply: tid=0 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 client.4419 shutdown 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 -- 172.21.15.106:0/2070990506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 msgr2=0x55e215451b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215451b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c010bd0 tx=0x7ffb9c00e750 comp rx=0 tx=0).stop 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 -- 172.21.15.106:0/2070990506 shutdown_connections 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x55e215452530 0x55e2154a17b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e21548f700 0x55e2154515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffb91600640 0 client.4419 ms_handle_reset on v2:172.21.15.112:6833/3320582993 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e215451b20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/2070990506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215446740 0x55e2154510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 -- 172.21.15.106:0/2070990506 >> 172.21.15.106:0/2070990506 conn(0x55e2154426f0 msgr2=0x55e215445370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:27.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 -- 172.21.15.106:0/2070990506 shutdown_connections 2024-04-26T21:16:27.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 1 -- 172.21.15.106:0/2070990506 wait complete. 2024-04-26T21:16:27.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.756+0000 7ffbae7b8000 20 client.4419 trim_cache size 0 max 16384 2024-04-26T21:16:27.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 Processor -- start 2024-04-26T21:16:27.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 -- start start 2024-04-26T21:16:27.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e2154a4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e21548f700 0x55e2154a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215490020 0x55e2154a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4204570 con 0x55e21548f700 2024-04-26T21:16:27.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffba40b2e00 con 0x55e215446740 2024-04-26T21:16:27.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ffba4203f20 con 0x55e215490020 2024-04-26T21:16:27.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e21548f700 0x55e2154a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e21548f700 0x55e2154a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45898/0 (socket says 172.21.15.106:45898) 2024-04-26T21:16:27.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3400640 1 -- 172.21.15.106:0/509654464 learned_addr learned my addr 172.21.15.106:0/509654464 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:27.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3e00640 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e2154a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba9200640 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215490020 0x55e2154a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3400640 1 -- 172.21.15.106:0/509654464 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215490020 msgr2=0x55e2154a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3400640 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215490020 0x55e2154a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3400640 1 -- 172.21.15.106:0/509654464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 msgr2=0x55e2154a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3400640 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e2154a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3400640 1 -- 172.21.15.106:0/509654464 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e21524cc50 con 0x55e21548f700 2024-04-26T21:16:27.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3e00640 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e2154a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:27.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffba3400640 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e21548f700 0x55e2154a4c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400ce40 tx=0x7ffb94013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7044ef6bbd4a36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffb93e00640 1 -- 172.21.15.106:0/509654464 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb940520a0 con 0x55e21548f700 2024-04-26T21:16:27.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffb93e00640 1 -- 172.21.15.106:0/509654464 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb94084040 con 0x55e21548f700 2024-04-26T21:16:27.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffb93e00640 1 -- 172.21.15.106:0/509654464 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9405c2b0 con 0x55e21548f700 2024-04-26T21:16:27.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 -- 172.21.15.106:0/509654464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e21548f700 msgr2=0x55e2154a4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e21548f700 0x55e2154a4c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400ce40 tx=0x7ffb94013000 comp rx=0 tx=0).stop 2024-04-26T21:16:27.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 -- 172.21.15.106:0/509654464 shutdown_connections 2024-04-26T21:16:27.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e215490020 0x55e2154a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e21548f700 0x55e2154a4c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/509654464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e2154a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 -- 172.21.15.106:0/509654464 >> 172.21.15.106:0/509654464 conn(0x55e2154426f0 msgr2=0x55e21549ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:27.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 -- 172.21.15.106:0/509654464 shutdown_connections 2024-04-26T21:16:27.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.776+0000 7ffbae7b8000 1 -- 172.21.15.106:0/509654464 wait complete. 2024-04-26T21:16:27.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 -- start start 2024-04-26T21:16:27.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 Processor -- start 2024-04-26T21:16:27.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e2154a4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 0x55e2154bb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e2154bb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e215293110 con 0x55e215490020 2024-04-26T21:16:27.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e2152297b0 con 0x55e215446740 2024-04-26T21:16:27.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55e215298430 con 0x55e21548f700 2024-04-26T21:16:27.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 10 client.0 _ll_register_callbacks cb 0x7ffb9c007800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:16:27.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e2154bb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e2154a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e2154bb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45906/0 (socket says 172.21.15.106:45906) 2024-04-26T21:16:27.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba9200640 1 -- 172.21.15.106:0/1456872380 learned_addr learned my addr 172.21.15.106:0/1456872380 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:27.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba3400640 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 0x55e2154bb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba9200640 1 -- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 msgr2=0x55e2154bb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba9200640 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 0x55e2154bb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba9200640 1 -- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 msgr2=0x55e2154a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba9200640 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e2154a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba9200640 1 -- 172.21.15.106:0/1456872380 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e215316160 con 0x55e215490020 2024-04-26T21:16:27.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba9200640 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e2154bb880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c010490 tx=0x7ffb9c012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d78cebe96b842a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffb91600640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-26T21:16:27.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffb91600640 1 -- 172.21.15.106:0/1456872380 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c00ec50 con 0x55e215490020 2024-04-26T21:16:27.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffb91600640 1 -- 172.21.15.106:0/1456872380 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffb9c01db60 con 0x55e215490020 2024-04-26T21:16:27.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 -- 172.21.15.106:0/1456872380 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb94084040 con 0x55e215490020 2024-04-26T21:16:27.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffb91600640 1 -- 172.21.15.106:0/1456872380 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7ffb9c01dd60 con 0x55e215490020 2024-04-26T21:16:27.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 10 client.4425 fetch_fsmap learned FSMap version 7 2024-04-26T21:16:27.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 -- 172.21.15.106:0/1456872380 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55e214f4d0c0 con 0x55e215490020 2024-04-26T21:16:27.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffb91600640 1 -- 172.21.15.106:0/1456872380 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb94084040 con 0x55e215490020 2024-04-26T21:16:27.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffb91600640 1 -- 172.21.15.106:0/1456872380 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7ffb9c026070 con 0x55e215490020 2024-04-26T21:16:27.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T21:16:27.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 10 client.4425 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T21:16:27.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 20 client.4425 populate_metadata read hostname 'smithi106' 2024-04-26T21:16:27.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x55e2154ff1c0 0x55e2154ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 4 client.4425 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T21:16:27.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffbae7b8000 1 -- 172.21.15.106:0/1456872380 --> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] -- command(tid 0: {"prefix": "status"}) -- 0x55e2152a1a10 con 0x55e2154ff1c0 2024-04-26T21:16:27.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.780+0000 7ffba3e00640 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x55e2154ff1c0 0x55e2154ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba3e00640 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x55e2154ff1c0 0x55e2154ff5a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68d5d600ba53d16c server_cookie=2179c1c4fb5a7795 in_seq=0 out_seq=0 2024-04-26T21:16:27.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffb91600640 10 client.4425 ms_handle_connect on v2:172.21.15.112:6833/3320582993 2024-04-26T21:16:27.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffb91600640 1 -- 172.21.15.106:0/1456872380 <== mds.0 v2:172.21.15.112:6833/3320582993 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55e2152a1a10 con 0x55e2154ff1c0 2024-04-26T21:16:27.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffb91600640 10 client.4425 handle_command_reply: tid=0 2024-04-26T21:16:27.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 client.4425 shutdown 2024-04-26T21:16:27.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 -- 172.21.15.106:0/1456872380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 msgr2=0x55e2154bb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e2154bb880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c010490 tx=0x7ffb9c012040 comp rx=0 tx=0).stop 2024-04-26T21:16:27.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 -- 172.21.15.106:0/1456872380 shutdown_connections 2024-04-26T21:16:27.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x55e2154ff1c0 0x55e2154ff5a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e215490020 0x55e2154bb880 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55e21548f700 0x55e2154bb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 --2- 172.21.15.106:0/1456872380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e215446740 0x55e2154a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 -- 172.21.15.106:0/1456872380 >> 172.21.15.106:0/1456872380 conn(0x55e2154426f0 msgr2=0x55e21549ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:27.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffb91600640 0 client.4425 ms_handle_reset on v2:172.21.15.112:6833/3320582993 2024-04-26T21:16:27.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 -- 172.21.15.106:0/1456872380 shutdown_connections 2024-04-26T21:16:27.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 1 -- 172.21.15.106:0/1456872380 wait complete. 2024-04-26T21:16:27.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffbae7b8000 20 client.4425 trim_cache size 0 max 16384 2024-04-26T21:16:27.803 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:16:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "f2bfe958-5421-4d89-8d8f-237a3ca1f771", 2024-04-26T21:16:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2024-04-26T21:16:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4281, 2024-04-26T21:16:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2024-04-26T21:16:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2024-04-26T21:16:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2024-04-26T21:16:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 7.390308492, 2024-04-26T21:16:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 7, 2024-04-26T21:16:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 27, 2024-04-26T21:16:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 26, 2024-04-26T21:16:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 14.143973627999999 2024-04-26T21:16:27.804 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:16:27.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 -- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffb80068380 msgr2=0x7ffb8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffb80068380 0x7ffb8006a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0ad000 tx=0x7ffb8c0a6000 comp rx=0 tx=0).stop 2024-04-26T21:16:27.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 -- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba40d3560 msgr2=0x7ffba414da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba40d3560 0x7ffba414da60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400c480 tx=0x7ffb9400c940 comp rx=0 tx=0).stop 2024-04-26T21:16:27.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 -- 172.21.15.106:0/1338630916 shutdown_connections 2024-04-26T21:16:27.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffba415f0c0 0x7ffba40b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffb80068380 0x7ffb8006a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba40d3560 0x7ffba414da60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 --2- 172.21.15.106:0/1338630916 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffba40ce900 0x7ffba4156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 -- 172.21.15.106:0/1338630916 >> 172.21.15.106:0/1338630916 conn(0x7ffba40d2a70 msgr2=0x7ffba40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:27.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 -- 172.21.15.106:0/1338630916 shutdown_connections 2024-04-26T21:16:27.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.784+0000 7ffba9c00640 1 -- 172.21.15.106:0/1338630916 wait complete. 2024-04-26T21:16:27.808 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:16:27.808 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:16:27.808 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:16:27.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.940+0000 7f175ea00640 1 Processor -- start 2024-04-26T21:16:27.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.940+0000 7f175ea00640 1 -- start start 2024-04-26T21:16:27.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f175ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17581624a0 0x7f17580b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f175ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 0x7f175806f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f175ea00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17580b55e0 con 0x7f17580aeae0 2024-04-26T21:16:27.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f175ea00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f17580b58c0 con 0x7f17581624a0 2024-04-26T21:16:27.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f175ea00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17580b5ba0 con 0x7f17580b39f0 2024-04-26T21:16:27.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f1757e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17581624a0 0x7f17580b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f175ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 0x7f175806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f1757e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17581624a0 0x7f17580b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:35808/0 (socket says 172.21.15.106:35808) 2024-04-26T21:16:27.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f1757e00640 1 -- 172.21.15.106:0/2263344365 learned_addr learned my addr 172.21.15.106:0/2263344365 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:27.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f1757400640 1 --1- 172.21.15.106:0/2263344365 >> v1:172.21.15.112:6789/0 conn(0x7f17580aeae0 0x7f17580b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:56554/0 (socket says 172.21.15.106:56554) 2024-04-26T21:16:27.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f1757e00640 1 -- 172.21.15.106:0/2263344365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 msgr2=0x7f175806f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:27.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f1757e00640 1 --2- 172.21.15.106:0/2263344365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 0x7f175806f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f1757e00640 1 -- 172.21.15.106:0/2263344365 >> v1:172.21.15.112:6789/0 conn(0x7f17580aeae0 legacy=0x7f17580b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f1757e00640 1 -- 172.21.15.106:0/2263344365 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175806e810 con 0x7f17581624a0 2024-04-26T21:16:27.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.944+0000 7f1757e00640 1 --2- 172.21.15.106:0/2263344365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17581624a0 0x7f17580b4d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1748009e50 tx=0x7f174801ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea6b38e8a12235f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f1756a00640 1 -- 172.21.15.106:0/2263344365 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17480a5890 con 0x7f17581624a0 2024-04-26T21:16:27.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f1756a00640 1 -- 172.21.15.106:0/2263344365 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17480a5a30 con 0x7f17581624a0 2024-04-26T21:16:27.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f1756a00640 1 -- 172.21.15.106:0/2263344365 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17480a5e00 con 0x7f17581624a0 2024-04-26T21:16:27.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 -- 172.21.15.106:0/2263344365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17581624a0 msgr2=0x7f17580b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 --2- 172.21.15.106:0/2263344365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17581624a0 0x7f17580b4d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1748009e50 tx=0x7f174801ca00 comp rx=0 tx=0).stop 2024-04-26T21:16:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 -- 172.21.15.106:0/2263344365 shutdown_connections 2024-04-26T21:16:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 --2- 172.21.15.106:0/2263344365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 0x7f175806f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 --2- 172.21.15.106:0/2263344365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17581624a0 0x7f17580b4d90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 -- 172.21.15.106:0/2263344365 >> 172.21.15.106:0/2263344365 conn(0x7f175806c5d0 msgr2=0x7f175806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 -- 172.21.15.106:0/2263344365 shutdown_connections 2024-04-26T21:16:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 -- 172.21.15.106:0/2263344365 wait complete. 2024-04-26T21:16:27.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 Processor -- start 2024-04-26T21:16:27.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 -- start start 2024-04-26T21:16:27.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17580aeae0 0x7f175815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 0x7f175814da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17581624a0 0x7f175814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f175806fee0 con 0x7f17581624a0 2024-04-26T21:16:27.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f175806fd60 con 0x7f17580aeae0 2024-04-26T21:16:27.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ea00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1758070060 con 0x7f17580b39f0 2024-04-26T21:16:27.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17581624a0 0x7f175814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.948+0000 7f175ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17581624a0 0x7f175814ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45916/0 (socket says 172.21.15.106:45916) 2024-04-26T21:16:27.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ca00640 1 -- 172.21.15.106:0/1984446115 learned_addr learned my addr 172.21.15.106:0/1984446115 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:27.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f1757e00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17580aeae0 0x7f175815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f1757400640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 0x7f175814da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ca00640 1 -- 172.21.15.106:0/1984446115 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 msgr2=0x7f175814da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ca00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 0x7f175814da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ca00640 1 -- 172.21.15.106:0/1984446115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17580aeae0 msgr2=0x7f175815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:27.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ca00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17580aeae0 0x7f175815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:27.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ca00640 1 -- 172.21.15.106:0/1984446115 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175814e4c0 con 0x7f17581624a0 2024-04-26T21:16:27.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ca00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17581624a0 0x7f175814ce60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f175000e850 tx=0x7f175000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f174fe00640 1 -- 172.21.15.106:0/1984446115 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1750017070 con 0x7f17581624a0 2024-04-26T21:16:27.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f174fe00640 1 -- 172.21.15.106:0/1984446115 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f175000c940 con 0x7f17581624a0 2024-04-26T21:16:27.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175814e7a0 con 0x7f17581624a0 2024-04-26T21:16:27.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f174fe00640 1 -- 172.21.15.106:0/1984446115 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175000cd10 con 0x7f17581624a0 2024-04-26T21:16:27.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175814ed60 con 0x7f17581624a0 2024-04-26T21:16:27.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1758069400 con 0x7f17581624a0 2024-04-26T21:16:27.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f174fe00640 1 -- 172.21.15.106:0/1984446115 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f175001a070 con 0x7f17581624a0 2024-04-26T21:16:27.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.952+0000 7f174fe00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1738068380 0x7f173806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:27.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.956+0000 7f174fe00640 1 -- 172.21.15.106:0/1984446115 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1750087070 con 0x7f17581624a0 2024-04-26T21:16:27.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.956+0000 7f1757e00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1738068380 0x7f173806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:27.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.956+0000 7f1757e00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1738068380 0x7f173806a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17480ae000 tx=0x7f17480a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:27.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:27.960+0000 7f174fe00640 1 -- 172.21.15.106:0/1984446115 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1750056c00 con 0x7f17581624a0 2024-04-26T21:16:28.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.147+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f175814f830 con 0x7f17581624a0 2024-04-26T21:16:28.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.147+0000 7f174fe00640 1 -- 172.21.15.106:0/1984446115 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f175005af00 con 0x7f17581624a0 2024-04-26T21:16:28.152 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1738068380 msgr2=0x7f173806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1738068380 0x7f173806a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17480ae000 tx=0x7f17480a7070 comp rx=0 tx=0).stop 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17581624a0 msgr2=0x7f175814ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17581624a0 0x7f175814ce60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f175000e850 tx=0x7f175000ed10 comp rx=0 tx=0).stop 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 shutdown_connections 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1738068380 0x7f173806a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17581624a0 0x7f175814ce60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17580b39f0 0x7f175814da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 --2- 172.21.15.106:0/1984446115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17580aeae0 0x7f175815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 >> 172.21.15.106:0/1984446115 conn(0x7f175806c5d0 msgr2=0x7f17580b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:28.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 shutdown_connections 2024-04-26T21:16:28.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28.151+0000 7f175ea00640 1 -- 172.21.15.106:0/1984446115 wait complete. 2024-04-26T21:16:28.173 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T21:16:28.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:16:28.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-04-26T21:16:28.173 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-26T21:16:28.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:16:28.173 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T21:16:28.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:16:28.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:16:28.174 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T21:16:28.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:28.174 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-04-26T21:16:28.182 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:16:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:16:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T21:16:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42428sec preferred_lft 42428sec 2024-04-26T21:16:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-04-26T21:16:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:28.184 INFO:teuthology.orchestra.run.smithi106.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T21:16:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 02:42:e8:de:01:3d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T21:16:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:28.186 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:16:28.186 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:28.186 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:28.186 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:16:28.186 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2024-04-26T21:16:28.186 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2024-04-26T21:16:28.187 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:16:28.187 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:28.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:28.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:28.341 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:16:28.359 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-04-26T21:16:28.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:28.361 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-04-26T21:16:28.771 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-04-26T21:16:28.771 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:16:28.772 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T21:16:28.772 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:16:28.772 INFO:teuthology.orchestra.run.smithi106.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T21:16:28.772 INFO:teuthology.orchestra.run.smithi106.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T21:16:28.772 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:16:28.772 INFO:teuthology.orchestra.run.smithi106.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:28.772 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:28.772 INFO:teuthology.orchestra.run.smithi106.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:28.772 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:16:28.773 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:28.773 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:28.773 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:16:28.773 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:16:28.773 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:16:28.773 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:28.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:28.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:28.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:28.868 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-26T21:16:28.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:28.921 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-04-26T21:16:28.972 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:28.972 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:28.973 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:16:28.973 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-26T21:16:28.973 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:29.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:29.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:29.098 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-26T21:16:29.098 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:29.099 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:29.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-26T21:16:29.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:16:29.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-26T21:16:29.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-26T21:16:29.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-26T21:16:29.099 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:29.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:29.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:29.265 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:29.265 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:29.265 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2024-04-26T21:16:29.265 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:16:29.265 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:29.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:29.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:29.350 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-26T21:16:29.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:29.350 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:16:29.405 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T21:16:29.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:29.405 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:16:29.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-26T21:16:29.524 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:29.581 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-26T21:16:29.581 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-26T21:16:29.581 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-26T21:16:29.581 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-26T21:16:29.581 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/run/lock 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-26T21:16:29.582 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/fs/nfsd 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/run/rpc_pipefs 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:16:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:16:29.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:29.584 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-26T21:16:29.640 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T21:16:29.640 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-26T21:16:29.687 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-26T21:16:29.707 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:29.758 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/run/lock 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-26T21:16:29.759 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/fs/nfsd 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/run/rpc_pipefs 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:16:29.760 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:16:29.761 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:16:29.761 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:16:29.761 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-26T21:16:29.761 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:16:29.761 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:16:29.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:29.762 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-26T21:16:29.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi106.stderr:2024-04-26T21:16:29.779+0000 7fd6059d2580 -1 init, newargv = 0x55e2a91aebb0 newargc=15 2024-04-26T21:16:29.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi106.stderr:ceph-fuse[33454]: starting ceph client 2024-04-26T21:16:29.793 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi106.stderr:ceph-fuse[33454]: starting fuse 2024-04-26T21:16:30.892 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-26T21:16:30.917 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:30.974 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-26T21:16:30.974 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-26T21:16:30.974 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-26T21:16:30.974 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-26T21:16:30.974 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/run/lock 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-26T21:16:30.975 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/fs/nfsd 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/run/rpc_pipefs 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:16:30.976 INFO:teuthology.orchestra.run.smithi106.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-26T21:16:30.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:30.977 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-26T21:16:31.031 INFO:teuthology.orchestra.run.smithi106.stdout:44 2024-04-26T21:16:31.032 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> import glob 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> import re 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> import os 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> import subprocess 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> def _find_admin_socket(client_name): 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> files = glob.glob(asok_path) 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-26T21:16:31.032 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> # Given a non-glob path, it better be there 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> if "*" not in asok_path: 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> assert(len(files) == 1) 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> return files[0] 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> for f in files: 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> contents = proc_f.read() 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> if mountpoint in contents: 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> return f 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:31.033 DEBUG:teuthology.orchestra.run.smithi106:> print(_find_admin_socket("client.admin")) 2024-04-26T21:16:31.034 DEBUG:teuthology.orchestra.run.smithi106:> ' 2024-04-26T21:16:31.159 INFO:teuthology.orchestra.run.smithi106.stdout:/var/run/ceph/ceph-client.admin.33454.asok 2024-04-26T21:16:31.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:31.171 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33454.asok 2024-04-26T21:16:31.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:31.171 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33454.asok status 2024-04-26T21:16:31.341 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:16:31.341 INFO:teuthology.orchestra.run.smithi106.stdout: "metadata": { 2024-04-26T21:16:31.341 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:16:31.341 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T21:16:31.341 INFO:teuthology.orchestra.run.smithi106.stdout: "entity_id": "admin", 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": "smithi106", 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "pid": "33454", 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "root": "/" 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_count": 0, 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_pinned_count": 0, 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4434, 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "inst": { 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "name": { 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "client", 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4434 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:31.342 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 63600620 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 63600620 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "inst_str": "client.4434 192.168.0.1:0/63600620", 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "addr_str": "192.168.0.1:0/63600620", 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "inode_count": 1, 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_epoch": 7, 2024-04-26T21:16:31.343 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch": 27, 2024-04-26T21:16:31.344 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:16:31.344 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklisted": false, 2024-04-26T21:16:31.344 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs" 2024-04-26T21:16:31.344 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:16:31.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:31.356 DEBUG:teuthology.orchestra.run.smithi106:> stat --file-system '--printf=%T 2024-04-26T21:16:31.356 DEBUG:teuthology.orchestra.run.smithi106:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:16:31.365 INFO:teuthology.orchestra.run.smithi106.stdout:fuseblk 2024-04-26T21:16:31.365 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:16:31.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:31.366 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:16:31.428 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-26T21:16:31.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:16:31.562 INFO:teuthology.orchestra.run.smithi106.stdout:# file: . 2024-04-26T21:16:31.562 INFO:teuthology.orchestra.run.smithi106.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-26T21:16:31.562 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:31.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:31.569 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:16:31.569 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:16:31.577 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:31.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f212b600640 1 Processor -- start 2024-04-26T21:16:31.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f212b600640 1 -- start start 2024-04-26T21:16:31.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f212b600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f21240aeae0 0x7f21240b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:31.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f212b600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21240b3820 0x7f212406f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:31.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f212b600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21240b55e0 con 0x7f21241624a0 2024-04-26T21:16:31.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f212b600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f21240b58c0 con 0x7f21240aeae0 2024-04-26T21:16:31.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f212b600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f21240b5ba0 con 0x7f21240b3820 2024-04-26T21:16:31.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f2128c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f21241624a0 0x7f21240b4d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33994/0 (socket says 172.21.15.106:33994) 2024-04-26T21:16:31.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f2128c00640 1 -- 172.21.15.106:0/1440855805 learned_addr learned my addr 172.21.15.106:0/1440855805 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:31.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f2123e00640 1 --2- 172.21.15.106:0/1440855805 >> v2:172.21.15.112:3300/0 conn(0x7f21240aeae0 0x7f21240b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:31.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.751+0000 7f2129600640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21240b3820 0x7f212406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:31.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556970202 0 0) 0x7f21240b55e0 con 0x7f21241624a0 2024-04-26T21:16:31.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2108003530 con 0x7f21241624a0 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1301039593 0 0) 0x7f2108003530 con 0x7f21241624a0 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21240b3820 msgr2=0x7f212406f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21240b3820 0x7f212406f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 >> v2:172.21.15.112:3300/0 conn(0x7f21240aeae0 msgr2=0x7f21240b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 --2- 172.21.15.106:0/1440855805 >> v2:172.21.15.112:3300/0 conn(0x7f21240aeae0 0x7f21240b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212406e810 con 0x7f21241624a0 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f2114001a00 con 0x7f21241624a0 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 >> v1:172.21.15.106:6789/0 conn(0x7f21241624a0 legacy=0x7f21240b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21080039c0 0x7f2108003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21080043b0 0x7f2108004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2108004f00 0x7f210800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f21240b58c0 con 0x7f21080043b0 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f21240b5ba0 con 0x7f2108004f00 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f210800bf10 con 0x7f21080039c0 2024-04-26T21:16:31.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123e00640 1 --2- 172.21.15.106:0/1440855805 >> v2:172.21.15.112:3300/0 conn(0x7f21240aeae0 0x7f21240b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2129600640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21240b3820 0x7f212406f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123e00640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21080043b0 0x7f2108004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2128c00640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21080039c0 0x7f2108003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2129600640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2108004f00 0x7f210800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123e00640 1 -- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21080039c0 msgr2=0x7f2108003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123e00640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21080039c0 0x7f2108003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123e00640 1 -- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2108004f00 msgr2=0x7f210800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123e00640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2108004f00 0x7f210800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.755+0000 7f2123e00640 1 -- 172.21.15.106:0/1440855805 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2108003530 con 0x7f21080043b0 2024-04-26T21:16:31.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f2123e00640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21080043b0 0x7f2108004890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2110009c90 tx=0x7f211001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc09974c833553ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:31.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110009860 con 0x7f21080043b0 2024-04-26T21:16:31.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2110004020 con 0x7f21080043b0 2024-04-26T21:16:31.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f2123400640 1 -- 172.21.15.106:0/1440855805 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110004450 con 0x7f21080043b0 2024-04-26T21:16:31.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 -- 172.21.15.106:0/1440855805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21080043b0 msgr2=0x7f2108004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:31.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 --2- 172.21.15.106:0/1440855805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21080043b0 0x7f2108004890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2110009c90 tx=0x7f211001cc70 comp rx=0 tx=0).stop 2024-04-26T21:16:31.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f2129600640 1 -- 172.21.15.106:0/1440855805 reap_dead start 2024-04-26T21:16:31.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 -- 172.21.15.106:0/1440855805 shutdown_connections 2024-04-26T21:16:31.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 -- 172.21.15.106:0/1440855805 >> 172.21.15.106:0/1440855805 conn(0x7f212406c5d0 msgr2=0x7f212406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:31.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 -- 172.21.15.106:0/1440855805 shutdown_connections 2024-04-26T21:16:31.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 -- 172.21.15.106:0/1440855805 wait complete. 2024-04-26T21:16:31.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 Processor -- start 2024-04-26T21:16:31.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 -- start start 2024-04-26T21:16:31.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21080043b0 0x7f21240ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21240b2630 0x7f212414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f212415b3b0 0x7f212415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f212406f010 con 0x7f21240b2630 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2124162880 con 0x7f212415b3b0 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f212b600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f212406f190 con 0x7f21080043b0 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f2123e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21240b2630 0x7f212414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f2123e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21240b2630 0x7f212414bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45932/0 (socket says 172.21.15.106:45932) 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.759+0000 7f2123e00640 1 -- 172.21.15.106:0/3139514642 learned_addr learned my addr 172.21.15.106:0/3139514642 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2129600640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f212415b3b0 0x7f212415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2128c00640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21080043b0 0x7f21240ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2123e00640 1 -- 172.21.15.106:0/3139514642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21080043b0 msgr2=0x7f21240ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:31.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2123e00640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21080043b0 0x7f21240ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2123e00640 1 -- 172.21.15.106:0/3139514642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f212415b3b0 msgr2=0x7f212415b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2123e00640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f212415b3b0 0x7f212415b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2123e00640 1 -- 172.21.15.106:0/3139514642 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21240cee40 con 0x7f21240b2630 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2123e00640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21240b2630 0x7f212414bc50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f211001caa0 tx=0x7f2108005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2120c00640 1 -- 172.21.15.106:0/3139514642 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21100bb020 con 0x7f21240b2630 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2120c00640 1 -- 172.21.15.106:0/3139514642 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21100a5930 con 0x7f21240b2630 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21240cf120 con 0x7f21240b2630 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2120c00640 1 -- 172.21.15.106:0/3139514642 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21100a5d20 con 0x7f21240b2630 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21240cf6e0 con 0x7f21240b2630 2024-04-26T21:16:31.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2124069400 con 0x7f21240b2630 2024-04-26T21:16:31.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2120c00640 1 -- 172.21.15.106:0/3139514642 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f21100be020 con 0x7f21240b2630 2024-04-26T21:16:31.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2120c00640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f21040683b0 0x7f210406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:31.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.763+0000 7f2120c00640 1 -- 172.21.15.106:0/3139514642 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f21101215d0 con 0x7f21240b2630 2024-04-26T21:16:31.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.767+0000 7f2128c00640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f21040683b0 0x7f210406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:31.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.767+0000 7f2128c00640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f21040683b0 0x7f210406a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f212415a810 tx=0x7f211400a060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:31.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.771+0000 7f2120c00640 1 -- 172.21.15.106:0/3139514642 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f21100c5030 con 0x7f21240b2630 2024-04-26T21:16:31.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.927+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21240b48f0 con 0x7f21240b2630 2024-04-26T21:16:31.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f2120c00640 1 -- 172.21.15.106:0/3139514642 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7f2110016980 con 0x7f21240b2630 2024-04-26T21:16:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:31.934 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f21040683b0 msgr2=0x7f210406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f21040683b0 0x7f210406a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f212415a810 tx=0x7f211400a060 comp rx=0 tx=0).stop 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21240b2630 msgr2=0x7f212414bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21240b2630 0x7f212414bc50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f211001caa0 tx=0x7f2108005840 comp rx=0 tx=0).stop 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 shutdown_connections 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f212415b3b0 0x7f212415b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f21040683b0 0x7f210406a870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21240b2630 0x7f212414bc50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 --2- 172.21.15.106:0/3139514642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f21080043b0 0x7f21240ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 >> 172.21.15.106:0/3139514642 conn(0x7f212406c5d0 msgr2=0x7f21240b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:31.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 shutdown_connections 2024-04-26T21:16:31.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:31.931+0000 7f212b600640 1 -- 172.21.15.106:0/3139514642 wait complete. 2024-04-26T21:16:31.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:16:31.955 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:16:32.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.087+0000 7f38c9000640 1 Processor -- start 2024-04-26T21:16:32.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.087+0000 7f38c9000640 1 -- start start 2024-04-26T21:16:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c9000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415c4e0 0x7f38c415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c9000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c415ce00 con 0x7f38c415d080 2024-04-26T21:16:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c9000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c40b4f00 con 0x7f38c415da80 2024-04-26T21:16:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c9000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f38c415d5f0 con 0x7f38c415c4e0 2024-04-26T21:16:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c1400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f38c415d080 0x7f38c40b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34002/0 (socket says 172.21.15.106:34002) 2024-04-26T21:16:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c1400640 1 -- 172.21.15.106:0/4082397538 learned_addr learned my addr 172.21.15.106:0/4082397538 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c1e00640 1 --2- 172.21.15.106:0/4082397538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415c4e0 0x7f38c415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c0a00640 1 -- 172.21.15.106:0/4082397538 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690368729 0 0) 0x7f38c415ce00 con 0x7f38c415d080 2024-04-26T21:16:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c0a00640 1 -- 172.21.15.106:0/4082397538 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38a8003530 con 0x7f38c415d080 2024-04-26T21:16:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c1e00640 1 -- 172.21.15.106:0/4082397538 >> v1:172.21.15.112:6789/0 conn(0x7f38c415da80 legacy=0x7f38c415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c1e00640 1 -- 172.21.15.106:0/4082397538 >> v1:172.21.15.106:6789/0 conn(0x7f38c415d080 legacy=0x7f38c40b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c0a00640 1 -- 172.21.15.106:0/4082397538 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396009045 0 0) 0x7f38c40b4f00 con 0x7f38c415da80 2024-04-26T21:16:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.091+0000 7f38c1e00640 1 -- 172.21.15.106:0/4082397538 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c40b51e0 con 0x7f38c415c4e0 2024-04-26T21:16:32.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c1e00640 1 --2- 172.21.15.106:0/4082397538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415c4e0 0x7f38c415c8c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38b40097f0 tx=0x7f38b401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0e4b20e493bf865 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:32.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c0a00640 1 -- 172.21.15.106:0/4082397538 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40b1070 con 0x7f38c415c4e0 2024-04-26T21:16:32.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c0a00640 1 -- 172.21.15.106:0/4082397538 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b40ac630 con 0x7f38c415c4e0 2024-04-26T21:16:32.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c0a00640 1 -- 172.21.15.106:0/4082397538 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40a8050 con 0x7f38c415c4e0 2024-04-26T21:16:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c9000640 1 -- 172.21.15.106:0/4082397538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415c4e0 msgr2=0x7f38c415c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c9000640 1 --2- 172.21.15.106:0/4082397538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415c4e0 0x7f38c415c8c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38b40097f0 tx=0x7f38b401c4e0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c9000640 1 -- 172.21.15.106:0/4082397538 shutdown_connections 2024-04-26T21:16:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c9000640 1 --2- 172.21.15.106:0/4082397538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415c4e0 0x7f38c415c8c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c9000640 1 -- 172.21.15.106:0/4082397538 >> 172.21.15.106:0/4082397538 conn(0x7f38c40b2910 msgr2=0x7f38c40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c9000640 1 -- 172.21.15.106:0/4082397538 shutdown_connections 2024-04-26T21:16:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c9000640 1 -- 172.21.15.106:0/4082397538 wait complete. 2024-04-26T21:16:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c9000640 1 Processor -- start 2024-04-26T21:16:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.095+0000 7f38c9000640 1 -- start start 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c9000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415c4e0 0x7f38c413c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c9000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415d080 0x7f38c40cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c9000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38c415da80 0x7f38c4142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c9000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4169f50 con 0x7f38c415da80 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c9000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4169dd0 con 0x7f38c415c4e0 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c9000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f38c416a0d0 con 0x7f38c415d080 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38c415da80 0x7f38c4142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38c415da80 0x7f38c4142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45936/0 (socket says 172.21.15.106:45936) 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c2800640 1 -- 172.21.15.106:0/1015002098 learned_addr learned my addr 172.21.15.106:0/1015002098 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:32.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c1e00640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415c4e0 0x7f38c413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c1400640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415d080 0x7f38c40cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c2800640 1 -- 172.21.15.106:0/1015002098 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415d080 msgr2=0x7f38c40cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c2800640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415d080 0x7f38c40cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c2800640 1 -- 172.21.15.106:0/1015002098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415c4e0 msgr2=0x7f38c413c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c2800640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415c4e0 0x7f38c413c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c2800640 1 -- 172.21.15.106:0/1015002098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c413cb90 con 0x7f38c415da80 2024-04-26T21:16:32.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c2800640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38c415da80 0x7f38c4142fb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00c780 tx=0x7f38bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:32.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38ba000640 1 -- 172.21.15.106:0/1015002098 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc003db0 con 0x7f38c415da80 2024-04-26T21:16:32.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38ba000640 1 -- 172.21.15.106:0/1015002098 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38bc00ce30 con 0x7f38c415da80 2024-04-26T21:16:32.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c40ce7d0 con 0x7f38c415da80 2024-04-26T21:16:32.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38ba000640 1 -- 172.21.15.106:0/1015002098 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc005290 con 0x7f38c415da80 2024-04-26T21:16:32.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c40ced90 con 0x7f38c415da80 2024-04-26T21:16:32.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.099+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c4069400 con 0x7f38c415da80 2024-04-26T21:16:32.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.103+0000 7f38ba000640 1 -- 172.21.15.106:0/1015002098 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f38bc005430 con 0x7f38c415da80 2024-04-26T21:16:32.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.103+0000 7f38ba000640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f38a0068380 0x7f38a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.103+0000 7f38ba000640 1 -- 172.21.15.106:0/1015002098 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f38bc086a20 con 0x7f38c415da80 2024-04-26T21:16:32.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.103+0000 7f38c1e00640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f38a0068380 0x7f38a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.103+0000 7f38c1e00640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f38a0068380 0x7f38a006a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38b40ae000 tx=0x7f38b40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:32.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.107+0000 7f38ba000640 1 -- 172.21.15.106:0/1015002098 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f38bc056640 con 0x7f38c415da80 2024-04-26T21:16:32.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.263+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f38c40b2640 con 0x7f38c415da80 2024-04-26T21:16:32.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.263+0000 7f38ba000640 1 -- 172.21.15.106:0/1015002098 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f38bc05a940 con 0x7f38c415da80 2024-04-26T21:16:32.268 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f38a0068380 msgr2=0x7f38a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f38a0068380 0x7f38a006a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38b40ae000 tx=0x7f38b40a7000 comp rx=0 tx=0).stop 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38c415da80 msgr2=0x7f38c4142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38c415da80 0x7f38c4142fb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00c780 tx=0x7f38bc00cc40 comp rx=0 tx=0).stop 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 shutdown_connections 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f38a0068380 0x7f38a006a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38c415da80 0x7f38c4142fb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38c415d080 0x7f38c40cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 --2- 172.21.15.106:0/1015002098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415c4e0 0x7f38c413c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 >> 172.21.15.106:0/1015002098 conn(0x7f38c40b2910 msgr2=0x7f38c40b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 shutdown_connections 2024-04-26T21:16:32.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.267+0000 7f38c9000640 1 -- 172.21.15.106:0/1015002098 wait complete. 2024-04-26T21:16:32.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:16:32.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.423+0000 7f9eefa00640 1 Processor -- start 2024-04-26T21:16:32.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.423+0000 7f9eefa00640 1 -- start start 2024-04-26T21:16:32.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.423+0000 7f9eefa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee8159890 0x7f9ee8162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.423+0000 7f9eefa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ee8070410 0x7f9ee815f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.423+0000 7f9eefa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee80729c0 con 0x7f9ee806ffb0 2024-04-26T21:16:32.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.423+0000 7f9eefa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee8072770 con 0x7f9ee8070410 2024-04-26T21:16:32.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.423+0000 7f9eefa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee8163b60 con 0x7f9ee8159890 2024-04-26T21:16:32.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9eeda00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ee8070410 0x7f9ee815f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9eeda00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ee8070410 0x7f9ee815f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:35870/0 (socket says 172.21.15.106:35870) 2024-04-26T21:16:32.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9eeda00640 1 -- 172.21.15.106:0/1673465377 learned_addr learned my addr 172.21.15.106:0/1673465377 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:32.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9ee7e00640 1 --1- 172.21.15.106:0/1673465377 >> v1:172.21.15.112:6789/0 conn(0x7f9ee806ffb0 0x7f9ee80d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:56572/0 (socket says 172.21.15.106:56572) 2024-04-26T21:16:32.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9eed000640 1 --2- 172.21.15.106:0/1673465377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee8159890 0x7f9ee8162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9eeda00640 1 -- 172.21.15.106:0/1673465377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee8159890 msgr2=0x7f9ee8162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:32.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9eeda00640 1 --2- 172.21.15.106:0/1673465377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee8159890 0x7f9ee8162bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9eeda00640 1 -- 172.21.15.106:0/1673465377 >> v1:172.21.15.112:6789/0 conn(0x7f9ee806ffb0 legacy=0x7f9ee80d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9eeda00640 1 -- 172.21.15.106:0/1673465377 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee8072ca0 con 0x7f9ee8070410 2024-04-26T21:16:32.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9eeda00640 1 --2- 172.21.15.106:0/1673465377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ee8070410 0x7f9ee815f850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009870 tx=0x7f9ee001c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=964602dd43b69237 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:32.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9ee7400640 1 -- 172.21.15.106:0/1673465377 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00a95f0 con 0x7f9ee8070410 2024-04-26T21:16:32.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9ee7400640 1 -- 172.21.15.106:0/1673465377 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee00a9790 con 0x7f9ee8070410 2024-04-26T21:16:32.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.427+0000 7f9ee7400640 1 -- 172.21.15.106:0/1673465377 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00a9b60 con 0x7f9ee8070410 2024-04-26T21:16:32.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 -- 172.21.15.106:0/1673465377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ee8070410 msgr2=0x7f9ee815f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 --2- 172.21.15.106:0/1673465377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ee8070410 0x7f9ee815f850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009870 tx=0x7f9ee001c530 comp rx=0 tx=0).stop 2024-04-26T21:16:32.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 -- 172.21.15.106:0/1673465377 shutdown_connections 2024-04-26T21:16:32.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 --2- 172.21.15.106:0/1673465377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ee8070410 0x7f9ee815f850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 --2- 172.21.15.106:0/1673465377 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee8159890 0x7f9ee8162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 -- 172.21.15.106:0/1673465377 >> 172.21.15.106:0/1673465377 conn(0x7f9ee806c400 msgr2=0x7f9ee806c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:32.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 -- 172.21.15.106:0/1673465377 shutdown_connections 2024-04-26T21:16:32.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 -- 172.21.15.106:0/1673465377 wait complete. 2024-04-26T21:16:32.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 Processor -- start 2024-04-26T21:16:32.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 -- start start 2024-04-26T21:16:32.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ee806ffb0 0x7f9ee815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee815a720 0x7f9ee814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ee814ed90 0x7f9ee814f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee816bf70 con 0x7f9ee814ed90 2024-04-26T21:16:32.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee8075e30 con 0x7f9ee806ffb0 2024-04-26T21:16:32.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eefa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee816c0f0 con 0x7f9ee815a720 2024-04-26T21:16:32.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eeda00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ee814ed90 0x7f9ee814f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eeda00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ee814ed90 0x7f9ee814f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45940/0 (socket says 172.21.15.106:45940) 2024-04-26T21:16:32.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eeda00640 1 -- 172.21.15.106:0/3944252758 learned_addr learned my addr 172.21.15.106:0/3944252758 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:32.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9eed000640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ee806ffb0 0x7f9ee815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.431+0000 7f9ee7e00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee815a720 0x7f9ee814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9eeda00640 1 -- 172.21.15.106:0/3944252758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee815a720 msgr2=0x7f9ee814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9eeda00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee815a720 0x7f9ee814fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9eeda00640 1 -- 172.21.15.106:0/3944252758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ee806ffb0 msgr2=0x7f9ee815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9eeda00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ee806ffb0 0x7f9ee815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9eeda00640 1 -- 172.21.15.106:0/3944252758 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee81581e0 con 0x7f9ee814ed90 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9eeda00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ee814ed90 0x7f9ee814f210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ee001abe0 tx=0x7f9ee00192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9ee4c00640 1 -- 172.21.15.106:0/3944252758 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00ba680 con 0x7f9ee814ed90 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee815c840 con 0x7f9ee814ed90 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9ee4c00640 1 -- 172.21.15.106:0/3944252758 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee00ba840 con 0x7f9ee814ed90 2024-04-26T21:16:32.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9ee4c00640 1 -- 172.21.15.106:0/3944252758 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00bac30 con 0x7f9ee814ed90 2024-04-26T21:16:32.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee8158760 con 0x7f9ee814ed90 2024-04-26T21:16:32.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee8069400 con 0x7f9ee814ed90 2024-04-26T21:16:32.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9ee4c00640 1 -- 172.21.15.106:0/3944252758 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ee00b13f0 con 0x7f9ee814ed90 2024-04-26T21:16:32.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.435+0000 7f9ee4c00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ec80683b0 0x7f9ec806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.439+0000 7f9ee4c00640 1 -- 172.21.15.106:0/3944252758 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9ee0120fe0 con 0x7f9ee814ed90 2024-04-26T21:16:32.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.439+0000 7f9eed000640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ec80683b0 0x7f9ec806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.439+0000 7f9eed000640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ec80683b0 0x7f9ec806a870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80113e0 tx=0x7f9ed800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:32.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.443+0000 7f9ee4c00640 1 -- 172.21.15.106:0/3944252758 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9ee00c1030 con 0x7f9ee814ed90 2024-04-26T21:16:32.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.603+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9ee80d2170 con 0x7f9ee814ed90 2024-04-26T21:16:32.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.603+0000 7f9ee4c00640 1 -- 172.21.15.106:0/3944252758 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f9ee00ad020 con 0x7f9ee814ed90 2024-04-26T21:16:32.607 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.603+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ec80683b0 msgr2=0x7f9ec806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.603+0000 7f9eefa00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ec80683b0 0x7f9ec806a870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80113e0 tx=0x7f9ed800b040 comp rx=0 tx=0).stop 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.603+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ee814ed90 msgr2=0x7f9ee814f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.603+0000 7f9eefa00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ee814ed90 0x7f9ee814f210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ee001abe0 tx=0x7f9ee00192d0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.607+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 shutdown_connections 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.607+0000 7f9eefa00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ec80683b0 0x7f9ec806a870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.607+0000 7f9eefa00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ee814ed90 0x7f9ee814f210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.607+0000 7f9eefa00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ee815a720 0x7f9ee814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.607+0000 7f9eefa00640 1 --2- 172.21.15.106:0/3944252758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ee806ffb0 0x7f9ee815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.607+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 >> 172.21.15.106:0/3944252758 conn(0x7f9ee806c400 msgr2=0x7f9ee80b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:32.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.607+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 shutdown_connections 2024-04-26T21:16:32.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.607+0000 7f9eefa00640 1 -- 172.21.15.106:0/3944252758 wait complete. 2024-04-26T21:16:32.628 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:16:32.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8ec400640 1 Processor -- start 2024-04-26T21:16:32.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8ec400640 1 -- start start 2024-04-26T21:16:32.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8ec400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa8e415c4e0 0x7fa8e415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8ec400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e415ce00 con 0x7fa8e415da80 2024-04-26T21:16:32.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8ec400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e40b4f00 con 0x7fa8e415d080 2024-04-26T21:16:32.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8ec400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e415d5f0 con 0x7fa8e415c4e0 2024-04-26T21:16:32.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8ea400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa8e415da80 0x7fa8e415df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34012/0 (socket says 172.21.15.106:34012) 2024-04-26T21:16:32.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8ea400640 1 -- 172.21.15.106:0/2681487052 learned_addr learned my addr 172.21.15.106:0/2681487052 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:32.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e9a00640 1 --2- 172.21.15.106:0/2681487052 >> v2:172.21.15.112:3300/0 conn(0x7fa8e415c4e0 0x7fa8e415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577703201 0 0) 0x7fa8e415ce00 con 0x7fa8e415da80 2024-04-26T21:16:32.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8cc005740 con 0x7fa8e415da80 2024-04-26T21:16:32.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581175840 0 0) 0x7fa8e40b4f00 con 0x7fa8e415d080 2024-04-26T21:16:32.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8e415ce00 con 0x7fa8e415d080 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3089683271 0 0) 0x7fa8cc005740 con 0x7fa8e415da80 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 >> v2:172.21.15.112:3300/0 conn(0x7fa8e415c4e0 msgr2=0x7fa8e415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 --2- 172.21.15.106:0/2681487052 >> v2:172.21.15.112:3300/0 conn(0x7fa8e415c4e0 0x7fa8e415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 >> v1:172.21.15.112:6789/0 conn(0x7fa8e415d080 legacy=0x7fa8e40b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e40b51e0 con 0x7fa8e415da80 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7fa8dc001a00 con 0x7fa8e415da80 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 >> v1:172.21.15.106:6789/0 conn(0x7fa8e415da80 legacy=0x7fa8e415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8cc005d60 0x7fa8cc006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8cc006a20 0x7fa8cc006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc0073e0 0x7fa8cc00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e415d5f0 con 0x7fa8cc006a20 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc00e260 con 0x7fa8cc0073e0 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa8cc00e460 con 0x7fa8cc005d60 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e9000640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8cc006a20 0x7fa8cc006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8e9a00640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8cc005d60 0x7fa8cc006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.763+0000 7fa8ea400640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc0073e0 0x7fa8cc00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e9000640 1 -- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8cc005d60 msgr2=0x7fa8cc006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:32.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e9000640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8cc005d60 0x7fa8cc006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e9000640 1 -- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc0073e0 msgr2=0x7fa8cc00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:32.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e9000640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc0073e0 0x7fa8cc00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e9000640 1 -- 172.21.15.106:0/2681487052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8cc005740 con 0x7fa8cc006a20 2024-04-26T21:16:32.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8ea400640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc0073e0 0x7fa8cc00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:32.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e9a00640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8cc005d60 0x7fa8cc006160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:32.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8ea400640 1 -- 172.21.15.106:0/2681487052 reap_dead start 2024-04-26T21:16:32.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e9000640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8cc006a20 0x7fa8cc006ea0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8e415d4c0 tx=0x7fa8d001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed13497d6634cca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:32.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0001520 con 0x7fa8cc006a20 2024-04-26T21:16:32.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d00052f0 con 0x7fa8cc006a20 2024-04-26T21:16:32.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8e3e00640 1 -- 172.21.15.106:0/2681487052 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00a8910 con 0x7fa8cc006a20 2024-04-26T21:16:32.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8ec400640 1 -- 172.21.15.106:0/2681487052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8cc006a20 msgr2=0x7fa8cc006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8ec400640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8cc006a20 0x7fa8cc006ea0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8e415d4c0 tx=0x7fa8d001ecb0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8ec400640 1 -- 172.21.15.106:0/2681487052 shutdown_connections 2024-04-26T21:16:32.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8ec400640 1 --2- 172.21.15.106:0/2681487052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8cc006a20 0x7fa8cc006ea0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8ec400640 1 -- 172.21.15.106:0/2681487052 >> 172.21.15.106:0/2681487052 conn(0x7fa8e40b2910 msgr2=0x7fa8e40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:32.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8ec400640 1 -- 172.21.15.106:0/2681487052 shutdown_connections 2024-04-26T21:16:32.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.767+0000 7fa8ec400640 1 -- 172.21.15.106:0/2681487052 wait complete. 2024-04-26T21:16:32.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 Processor -- start 2024-04-26T21:16:32.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 -- start start 2024-04-26T21:16:32.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc006a20 0x7fa8e41429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8e4144980 0x7fa8e4134280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8e41eac10 0x7fa8e41eb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e4145ba0 con 0x7fa8e41eac10 2024-04-26T21:16:32.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e40b57a0 con 0x7fa8cc006a20 2024-04-26T21:16:32.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e415c8c0 con 0x7fa8e4144980 2024-04-26T21:16:32.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ea400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8e41eac10 0x7fa8e41eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ea400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8e41eac10 0x7fa8e41eb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45960/0 (socket says 172.21.15.106:45960) 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ea400640 1 -- 172.21.15.106:0/761579058 learned_addr learned my addr 172.21.15.106:0/761579058 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8e9a00640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc006a20 0x7fa8e41429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8e9000640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8e4144980 0x7fa8e4134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ea400640 1 -- 172.21.15.106:0/761579058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8e4144980 msgr2=0x7fa8e4134280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ea400640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8e4144980 0x7fa8e4134280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ea400640 1 -- 172.21.15.106:0/761579058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc006a20 msgr2=0x7fa8e41429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ea400640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc006a20 0x7fa8e41429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ea400640 1 -- 172.21.15.106:0/761579058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e41438f0 con 0x7fa8e41eac10 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ea400640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8e41eac10 0x7fa8e41eb090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc000f90 tx=0x7fa8dc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8e1600640 1 -- 172.21.15.106:0/761579058 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00ec10 con 0x7fa8e41eac10 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8e1600640 1 -- 172.21.15.106:0/761579058 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc00edb0 con 0x7fa8e41eac10 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e4143050 con 0x7fa8e41eac10 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8e1600640 1 -- 172.21.15.106:0/761579058 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc014650 con 0x7fa8e41eac10 2024-04-26T21:16:32.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.771+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e4143610 con 0x7fa8e41eac10 2024-04-26T21:16:32.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.775+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e40d1b30 con 0x7fa8e41eac10 2024-04-26T21:16:32.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.775+0000 7fa8e1600640 1 -- 172.21.15.106:0/761579058 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8dc01b060 con 0x7fa8e41eac10 2024-04-26T21:16:32.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.775+0000 7fa8e1600640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8c40683b0 0x7fa8c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:32.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.775+0000 7fa8e1600640 1 -- 172.21.15.106:0/761579058 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa8dc0868a0 con 0x7fa8e41eac10 2024-04-26T21:16:32.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.775+0000 7fa8e9a00640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8c40683b0 0x7fa8c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:32.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.775+0000 7fa8e9a00640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8c40683b0 0x7fa8c406a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4069ab0 tx=0x7fa8d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:32.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.779+0000 7fa8e1600640 1 -- 172.21.15.106:0/761579058 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa8e40d1b30 con 0x7fa8e41eac10 2024-04-26T21:16:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.939+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa8e4069400 con 0x7fa8e41eac10 2024-04-26T21:16:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.939+0000 7fa8e1600640 1 -- 172.21.15.106:0/761579058 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fa8dc056b10 con 0x7fa8e41eac10 2024-04-26T21:16:32.943 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:16:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8c40683b0 msgr2=0x7fa8c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8c40683b0 0x7fa8c406a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4069ab0 tx=0x7fa8d8008040 comp rx=0 tx=0).stop 2024-04-26T21:16:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8e41eac10 msgr2=0x7fa8e41eb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8e41eac10 0x7fa8e41eb090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc000f90 tx=0x7fa8dc00e530 comp rx=0 tx=0).stop 2024-04-26T21:16:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 shutdown_connections 2024-04-26T21:16:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa8c40683b0 0x7fa8c406a870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8e41eac10 0x7fa8e41eb090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa8e4144980 0x7fa8e4134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 --2- 172.21.15.106:0/761579058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8cc006a20 0x7fa8e41429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:32.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 >> 172.21.15.106:0/761579058 conn(0x7fa8e40b2910 msgr2=0x7fa8e40b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:32.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 shutdown_connections 2024-04-26T21:16:32.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:32.943+0000 7fa8ec400640 1 -- 172.21.15.106:0/761579058 wait complete. 2024-04-26T21:16:32.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:16:33.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbae6400640 1 Processor -- start 2024-04-26T21:16:33.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbae6400640 1 -- start start 2024-04-26T21:16:33.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbae6400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbae0159890 0x7fbae0162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbae6400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d1850 0x7fbae015f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbae6400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae00729c0 con 0x7fbae006ffb0 2024-04-26T21:16:33.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbae6400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbae0072770 con 0x7fbae0159890 2024-04-26T21:16:33.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbae6400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbae0163b60 con 0x7fbae00d1850 2024-04-26T21:16:33.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadea00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbae006ffb0 0x7fbae00d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34028/0 (socket says 172.21.15.106:34028) 2024-04-26T21:16:33.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadea00640 1 -- 172.21.15.106:0/3706923513 learned_addr learned my addr 172.21.15.106:0/3706923513 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:33.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadfe00640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d1850 0x7fbae015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadf400640 1 --2- 172.21.15.106:0/3706923513 >> v2:172.21.15.112:3300/0 conn(0x7fbae0159890 0x7fbae0162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 298550763 0 0) 0x7fbae00729c0 con 0x7fbae006ffb0 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbac4003530 con 0x7fbae006ffb0 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2005415077 0 0) 0x7fbac4003530 con 0x7fbae006ffb0 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d1850 msgr2=0x7fbae015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d1850 0x7fbae015f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 >> v2:172.21.15.112:3300/0 conn(0x7fbae0159890 msgr2=0x7fbae0162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 --2- 172.21.15.106:0/3706923513 >> v2:172.21.15.112:3300/0 conn(0x7fbae0159890 0x7fbae0162bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae0072ca0 con 0x7fbae006ffb0 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7fbacc001680 con 0x7fbae006ffb0 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 >> v1:172.21.15.106:6789/0 conn(0x7fbae006ffb0 legacy=0x7fbae00d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d1850 0x7fbac40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbac4003f40 0x7fbac4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4004d50 0x7fbac40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbae0072770 con 0x7fbac4003f40 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbae0163b60 con 0x7fbac4004d50 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbac400b9d0 con 0x7fbae00d1850 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadea00640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbac4003f40 0x7fbac4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadf400640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d1850 0x7fbac40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadfe00640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4004d50 0x7fbac40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadea00640 1 -- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d1850 msgr2=0x7fbac40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadea00640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d1850 0x7fbac40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadea00640 1 -- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4004d50 msgr2=0x7fbac40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadea00640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4004d50 0x7fbac40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadea00640 1 -- 172.21.15.106:0/3706923513 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac4003530 con 0x7fbac4003f40 2024-04-26T21:16:33.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.099+0000 7fbadfe00640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4004d50 0x7fbac40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:33.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbadea00640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbac4003f40 0x7fbac4004810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c2c0 tx=0x7fbacc01f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7efe98fefe20415 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:33.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc007d60 con 0x7fbac4003f40 2024-04-26T21:16:33.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc005b00 con 0x7fbac4003f40 2024-04-26T21:16:33.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbade000640 1 -- 172.21.15.106:0/3706923513 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc007070 con 0x7fbac4003f40 2024-04-26T21:16:33.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbae6400640 1 -- 172.21.15.106:0/3706923513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbac4003f40 msgr2=0x7fbac4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbae6400640 1 --2- 172.21.15.106:0/3706923513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbac4003f40 0x7fbac4004810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c2c0 tx=0x7fbacc01f450 comp rx=0 tx=0).stop 2024-04-26T21:16:33.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbadfe00640 1 -- 172.21.15.106:0/3706923513 reap_dead start 2024-04-26T21:16:33.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbae6400640 1 -- 172.21.15.106:0/3706923513 shutdown_connections 2024-04-26T21:16:33.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbae6400640 1 -- 172.21.15.106:0/3706923513 >> 172.21.15.106:0/3706923513 conn(0x7fbae006c400 msgr2=0x7fbae006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:33.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbae6400640 1 -- 172.21.15.106:0/3706923513 shutdown_connections 2024-04-26T21:16:33.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.103+0000 7fbae6400640 1 -- 172.21.15.106:0/3706923513 wait complete. 2024-04-26T21:16:33.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 Processor -- start 2024-04-26T21:16:33.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 -- start start 2024-04-26T21:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4003f40 0x7fbae01f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbae00cdcf0 0x7fbae0157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d0220 0x7fbae00d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbae0073540 con 0x7fbae00cdcf0 2024-04-26T21:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbae0073260 con 0x7fbac4003f40 2024-04-26T21:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbae0075e30 con 0x7fbae00d0220 2024-04-26T21:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbae00cdcf0 0x7fbae0157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbae00cdcf0 0x7fbae0157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45986/0 (socket says 172.21.15.106:45986) 2024-04-26T21:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadea00640 1 -- 172.21.15.106:0/747038415 learned_addr learned my addr 172.21.15.106:0/747038415 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:33.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadf400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4003f40 0x7fbae01f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadfe00640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d0220 0x7fbae00d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadea00640 1 -- 172.21.15.106:0/747038415 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d0220 msgr2=0x7fbae00d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadea00640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d0220 0x7fbae00d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadea00640 1 -- 172.21.15.106:0/747038415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4003f40 msgr2=0x7fbae01f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadea00640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4003f40 0x7fbae01f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadea00640 1 -- 172.21.15.106:0/747038415 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae00ce360 con 0x7fbae00cdcf0 2024-04-26T21:16:33.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbadea00640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbae00cdcf0 0x7fbae0157070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbacc01f280 tx=0x7fbac4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:33.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbad7400640 1 -- 172.21.15.106:0/747038415 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc001c90 con 0x7fbae00cdcf0 2024-04-26T21:16:33.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbad7400640 1 -- 172.21.15.106:0/747038415 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc005cb0 con 0x7fbae00cdcf0 2024-04-26T21:16:33.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbad7400640 1 -- 172.21.15.106:0/747038415 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc005e60 con 0x7fbae00cdcf0 2024-04-26T21:16:33.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae00ce640 con 0x7fbae00cdcf0 2024-04-26T21:16:33.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.107+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae00cec00 con 0x7fbae00cdcf0 2024-04-26T21:16:33.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.111+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae0069400 con 0x7fbae00cdcf0 2024-04-26T21:16:33.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.111+0000 7fbad7400640 1 -- 172.21.15.106:0/747038415 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbacc0ba030 con 0x7fbae00cdcf0 2024-04-26T21:16:33.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.111+0000 7fbad7400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbac0068380 0x7fbac006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.111+0000 7fbad7400640 1 -- 172.21.15.106:0/747038415 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbacc123720 con 0x7fbae00cdcf0 2024-04-26T21:16:33.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.111+0000 7fbadf400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbac0068380 0x7fbac006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.111+0000 7fbadf400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbac0068380 0x7fbac006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009c60 tx=0x7fbad0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:33.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.115+0000 7fbad7400640 1 -- 172.21.15.106:0/747038415 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbacc0191c0 con 0x7fbae00cdcf0 2024-04-26T21:16:33.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbae00d2170 con 0x7fbae00cdcf0 2024-04-26T21:16:33.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbad7400640 1 -- 172.21.15.106:0/747038415 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fbacc0f3340 con 0x7fbae00cdcf0 2024-04-26T21:16:33.274 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:16:33.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbac0068380 msgr2=0x7fbac006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbac0068380 0x7fbac006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009c60 tx=0x7fbad0009190 comp rx=0 tx=0).stop 2024-04-26T21:16:33.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbae00cdcf0 msgr2=0x7fbae0157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbae00cdcf0 0x7fbae0157070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbacc01f280 tx=0x7fbac4005840 comp rx=0 tx=0).stop 2024-04-26T21:16:33.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 shutdown_connections 2024-04-26T21:16:33.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbac0068380 0x7fbac006a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbae00d0220 0x7fbae00d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbae00cdcf0 0x7fbae0157070 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 --2- 172.21.15.106:0/747038415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbac4003f40 0x7fbae01f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 >> 172.21.15.106:0/747038415 conn(0x7fbae006c400 msgr2=0x7fbae006e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:33.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 shutdown_connections 2024-04-26T21:16:33.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.271+0000 7fbae6400640 1 -- 172.21.15.106:0/747038415 wait complete. 2024-04-26T21:16:33.299 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:16:33.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.431+0000 7fe11be00640 1 Processor -- start 2024-04-26T21:16:33.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.431+0000 7fe11be00640 1 -- start start 2024-04-26T21:16:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe11be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413ed60 0x7fe11415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe11be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe11406eb70 0x7fe1140d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe11be00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1140b3d10 con 0x7fe11413f140 2024-04-26T21:16:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe11be00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe1140b3ac0 con 0x7fe11406eb70 2024-04-26T21:16:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe11be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe1140b4920 con 0x7fe11413ed60 2024-04-26T21:16:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe118a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe11413f140 0x7fe1140b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34038/0 (socket says 172.21.15.106:34038) 2024-04-26T21:16:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe118a00640 1 -- 172.21.15.106:0/665904961 learned_addr learned my addr 172.21.15.106:0/665904961 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe119e00640 1 --2- 172.21.15.106:0/665904961 >> v2:172.21.15.112:3300/0 conn(0x7fe11406eb70 0x7fe1140d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe119400640 1 --2- 172.21.15.106:0/665904961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413ed60 0x7fe11415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe113e00640 1 -- 172.21.15.106:0/665904961 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790912454 0 0) 0x7fe1140b3d10 con 0x7fe11413f140 2024-04-26T21:16:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe113e00640 1 -- 172.21.15.106:0/665904961 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0fc003530 con 0x7fe11413f140 2024-04-26T21:16:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe119e00640 1 -- 172.21.15.106:0/665904961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413ed60 msgr2=0x7fe11415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe119e00640 1 --2- 172.21.15.106:0/665904961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413ed60 0x7fe11415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe119e00640 1 -- 172.21.15.106:0/665904961 >> v1:172.21.15.106:6789/0 conn(0x7fe11413f140 legacy=0x7fe1140b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.435+0000 7fe119e00640 1 -- 172.21.15.106:0/665904961 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1140b3ff0 con 0x7fe11406eb70 2024-04-26T21:16:33.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe119e00640 1 --2- 172.21.15.106:0/665904961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11406eb70 0x7fe1140d0df0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00bfa0 tx=0x7fe10c01ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b1e6813662ab02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:33.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe113e00640 1 -- 172.21.15.106:0/665904961 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00b2d0 con 0x7fe11406eb70 2024-04-26T21:16:33.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe113e00640 1 -- 172.21.15.106:0/665904961 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10c0a7830 con 0x7fe11406eb70 2024-04-26T21:16:33.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe113e00640 1 -- 172.21.15.106:0/665904961 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0a7c00 con 0x7fe11406eb70 2024-04-26T21:16:33.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 -- 172.21.15.106:0/665904961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11406eb70 msgr2=0x7fe1140d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 --2- 172.21.15.106:0/665904961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11406eb70 0x7fe1140d0df0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00bfa0 tx=0x7fe10c01ea50 comp rx=0 tx=0).stop 2024-04-26T21:16:33.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 -- 172.21.15.106:0/665904961 shutdown_connections 2024-04-26T21:16:33.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 --2- 172.21.15.106:0/665904961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11406eb70 0x7fe1140d0df0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 --2- 172.21.15.106:0/665904961 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413ed60 0x7fe11415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 -- 172.21.15.106:0/665904961 >> 172.21.15.106:0/665904961 conn(0x7fe114068340 msgr2=0x7fe114068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:33.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 -- 172.21.15.106:0/665904961 shutdown_connections 2024-04-26T21:16:33.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 -- 172.21.15.106:0/665904961 wait complete. 2024-04-26T21:16:33.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 Processor -- start 2024-04-26T21:16:33.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 -- start start 2024-04-26T21:16:33.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11413ed60 0x7fe114158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1141614e0 0x7fe114161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413bce0 0x7fe11413c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe114160790 con 0x7fe1141614e0 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe114160610 con 0x7fe11413ed60 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.439+0000 7fe11be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe114071f50 con 0x7fe11413bce0 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe118a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1141614e0 0x7fe114161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe118a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1141614e0 0x7fe114161960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45988/0 (socket says 172.21.15.106:45988) 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe118a00640 1 -- 172.21.15.106:0/2354641512 learned_addr learned my addr 172.21.15.106:0/2354641512 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe118a00640 1 -- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413bce0 msgr2=0x7fe11413c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe119e00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413bce0 0x7fe11413c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe119400640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11413ed60 0x7fe114158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe118a00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413bce0 0x7fe11413c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe118a00640 1 -- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11413ed60 msgr2=0x7fe114158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe118a00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11413ed60 0x7fe114158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe118a00640 1 -- 172.21.15.106:0/2354641512 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe114162240 con 0x7fe1141614e0 2024-04-26T21:16:33.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe119400640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11413ed60 0x7fe114158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:33.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe119e00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413bce0 0x7fe11413c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:33.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe118a00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1141614e0 0x7fe114161960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1000010f0 tx=0x7fe10000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:33.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe111600640 1 -- 172.21.15.106:0/2354641512 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100017070 con 0x7fe1141614e0 2024-04-26T21:16:33.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe111600640 1 -- 172.21.15.106:0/2354641512 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe100005d10 con 0x7fe1141614e0 2024-04-26T21:16:33.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe111600640 1 -- 172.21.15.106:0/2354641512 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100007310 con 0x7fe1141614e0 2024-04-26T21:16:33.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe114162520 con 0x7fe1141614e0 2024-04-26T21:16:33.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11413b4e0 con 0x7fe1141614e0 2024-04-26T21:16:33.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe114069400 con 0x7fe1141614e0 2024-04-26T21:16:33.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.443+0000 7fe111600640 1 -- 172.21.15.106:0/2354641512 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe10001a070 con 0x7fe1141614e0 2024-04-26T21:16:33.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.447+0000 7fe111600640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe0f4068380 0x7fe0f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.447+0000 7fe111600640 1 -- 172.21.15.106:0/2354641512 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe1000860d0 con 0x7fe1141614e0 2024-04-26T21:16:33.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.447+0000 7fe119400640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe0f4068380 0x7fe0f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.447+0000 7fe119400640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe0f4068380 0x7fe0f406a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe108009ae0 tx=0x7fe108008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:33.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.451+0000 7fe111600640 1 -- 172.21.15.106:0/2354641512 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe100056340 con 0x7fe1141614e0 2024-04-26T21:16:33.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe114166800 con 0x7fe1141614e0 2024-04-26T21:16:33.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe111600640 1 -- 172.21.15.106:0/2354641512 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fe100055c40 con 0x7fe1141614e0 2024-04-26T21:16:33.622 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe0f4068380 msgr2=0x7fe0f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe0f4068380 0x7fe0f406a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe108009ae0 tx=0x7fe108008040 comp rx=0 tx=0).stop 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1141614e0 msgr2=0x7fe114161960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1141614e0 0x7fe114161960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1000010f0 tx=0x7fe10000c890 comp rx=0 tx=0).stop 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 shutdown_connections 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe0f4068380 0x7fe0f406a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe11413bce0 0x7fe11413c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1141614e0 0x7fe114161960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 --2- 172.21.15.106:0/2354641512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe11413ed60 0x7fe114158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.619+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 >> 172.21.15.106:0/2354641512 conn(0x7fe114068340 msgr2=0x7fe11415e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.623+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 shutdown_connections 2024-04-26T21:16:33.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.623+0000 7fe11be00640 1 -- 172.21.15.106:0/2354641512 wait complete. 2024-04-26T21:16:33.644 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:16:33.644 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:16:33.652 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:33.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7075e00640 1 Processor -- start 2024-04-26T21:16:33.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7075e00640 1 -- start start 2024-04-26T21:16:33.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7075e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7070070270 0x7f7070073840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7075e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707015d230 con 0x7f707006c400 2024-04-26T21:16:33.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7075e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70700708e0 con 0x7f70700cc100 2024-04-26T21:16:33.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7075e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7070070bc0 con 0x7f7070070270 2024-04-26T21:16:33.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f706ea00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f707006c400 0x7f707006c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34054/0 (socket says 172.21.15.106:34054) 2024-04-26T21:16:33.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f706ea00640 1 -- 172.21.15.106:0/1160658715 learned_addr learned my addr 172.21.15.106:0/1160658715 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:33.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7066000640 1 --2- 172.21.15.106:0/1160658715 >> v2:172.21.15.112:3300/0 conn(0x7f7070070270 0x7f7070073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f706e000640 1 -- 172.21.15.106:0/1160658715 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078328510 0 0) 0x7f707015d230 con 0x7f707006c400 2024-04-26T21:16:33.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f706e000640 1 -- 172.21.15.106:0/1160658715 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7054003530 con 0x7f707006c400 2024-04-26T21:16:33.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7066000640 1 -- 172.21.15.106:0/1160658715 >> v1:172.21.15.112:6789/0 conn(0x7f70700cc100 legacy=0x7f70700cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7066000640 1 -- 172.21.15.106:0/1160658715 >> v1:172.21.15.106:6789/0 conn(0x7f707006c400 legacy=0x7f707006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.827+0000 7f7066000640 1 -- 172.21.15.106:0/1160658715 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7070070ea0 con 0x7f7070070270 2024-04-26T21:16:33.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f7066000640 1 --2- 172.21.15.106:0/1160658715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 0x7f7070073840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70580097c0 tx=0x7f705801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=872de8899145ea73 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:33.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f706e000640 1 -- 172.21.15.106:0/1160658715 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70580b1070 con 0x7f7070070270 2024-04-26T21:16:33.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f706e000640 1 -- 172.21.15.106:0/1160658715 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70580ac5f0 con 0x7f7070070270 2024-04-26T21:16:33.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f706e000640 1 -- 172.21.15.106:0/1160658715 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70580ac9c0 con 0x7f7070070270 2024-04-26T21:16:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f7075e00640 1 -- 172.21.15.106:0/1160658715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 msgr2=0x7f7070073840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f7075e00640 1 --2- 172.21.15.106:0/1160658715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 0x7f7070073840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70580097c0 tx=0x7f705801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f7075e00640 1 -- 172.21.15.106:0/1160658715 shutdown_connections 2024-04-26T21:16:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f7075e00640 1 --2- 172.21.15.106:0/1160658715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 0x7f7070073840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f7075e00640 1 -- 172.21.15.106:0/1160658715 >> 172.21.15.106:0/1160658715 conn(0x7f70700d1ab0 msgr2=0x7f70700d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f7075e00640 1 -- 172.21.15.106:0/1160658715 shutdown_connections 2024-04-26T21:16:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.831+0000 7f7075e00640 1 -- 172.21.15.106:0/1160658715 wait complete. 2024-04-26T21:16:33.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 Processor -- start 2024-04-26T21:16:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 -- start start 2024-04-26T21:16:33.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f707006c400 0x7f70700c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 0x7f7070165e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70700cc100 0x7f70701663c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f70700ce380 con 0x7f70700cc100 2024-04-26T21:16:33.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70700ce200 con 0x7f7070070270 2024-04-26T21:16:33.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f707016acf0 con 0x7f707006c400 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70700cc100 0x7f70701663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70700cc100 0x7f70701663c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46000/0 (socket says 172.21.15.106:46000) 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706f400640 1 -- 172.21.15.106:0/3758085706 learned_addr learned my addr 172.21.15.106:0/3758085706 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7066000640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 0x7f7070165e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706ea00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f707006c400 0x7f70700c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706f400640 1 -- 172.21.15.106:0/3758085706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f707006c400 msgr2=0x7f70700c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706f400640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f707006c400 0x7f70700c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706f400640 1 -- 172.21.15.106:0/3758085706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 msgr2=0x7f7070165e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706f400640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 0x7f7070165e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706f400640 1 -- 172.21.15.106:0/3758085706 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70700d11c0 con 0x7f70700cc100 2024-04-26T21:16:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7066000640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 0x7f7070165e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:33.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f706f400640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70700cc100 0x7f70701663c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f706800c730 tx=0x7f706800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:33.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7067e00640 1 -- 172.21.15.106:0/3758085706 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068003b80 con 0x7f70700cc100 2024-04-26T21:16:33.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7067e00640 1 -- 172.21.15.106:0/3758085706 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7068003d20 con 0x7f70700cc100 2024-04-26T21:16:33.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70700c8cb0 con 0x7f70700cc100 2024-04-26T21:16:33.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7067e00640 1 -- 172.21.15.106:0/3758085706 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706800aa30 con 0x7f70700cc100 2024-04-26T21:16:33.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.835+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70700d0c00 con 0x7f70700cc100 2024-04-26T21:16:33.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.839+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70700c8e80 con 0x7f70700cc100 2024-04-26T21:16:33.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.839+0000 7f7067e00640 1 -- 172.21.15.106:0/3758085706 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f706800abd0 con 0x7f70700cc100 2024-04-26T21:16:33.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.839+0000 7f7067e00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f704c068380 0x7f704c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:33.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.839+0000 7f7067e00640 1 -- 172.21.15.106:0/3758085706 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7068086b90 con 0x7f70700cc100 2024-04-26T21:16:33.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.839+0000 7f706ea00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f704c068380 0x7f704c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:33.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.839+0000 7f706ea00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f704c068380 0x7f704c06a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70600011f0 tx=0x7f7060009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:33.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.843+0000 7f7067e00640 1 -- 172.21.15.106:0/3758085706 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7068056e00 con 0x7f70700cc100 2024-04-26T21:16:34.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.999+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7070069400 con 0x7f70700cc100 2024-04-26T21:16:34.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:33.999+0000 7f7067e00640 1 -- 172.21.15.106:0/3758085706 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7f7068056700 con 0x7f70700cc100 2024-04-26T21:16:34.005 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:34.005 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f704c068380 msgr2=0x7f704c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f704c068380 0x7f704c06a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70600011f0 tx=0x7f7060009040 comp rx=0 tx=0).stop 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70700cc100 msgr2=0x7f70701663c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70700cc100 0x7f70701663c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f706800c730 tx=0x7f706800cbf0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 shutdown_connections 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7070070270 0x7f7070165e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f704c068380 0x7f704c06a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70700cc100 0x7f70701663c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 --2- 172.21.15.106:0/3758085706 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f707006c400 0x7f70700c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 >> 172.21.15.106:0/3758085706 conn(0x7f70700d1ab0 msgr2=0x7f70700cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:34.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 shutdown_connections 2024-04-26T21:16:34.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.003+0000 7f7075e00640 1 -- 172.21.15.106:0/3758085706 wait complete. 2024-04-26T21:16:34.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:16:34.027 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:16:34.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ed6200640 1 Processor -- start 2024-04-26T21:16:34.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ed6200640 1 -- start start 2024-04-26T21:16:34.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ed6200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1ed0162bd0 0x7f1ed00d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ed6200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1ed00d1680 0x7f1ed015f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ed6200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed00d1ab0 con 0x7f1ed0159890 2024-04-26T21:16:34.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ed6200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed0072770 con 0x7f1ed0162bd0 2024-04-26T21:16:34.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ed6200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed0163b60 con 0x7f1ed00d1680 2024-04-26T21:16:34.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ec6a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1ed0162bd0 0x7f1ed00d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ec6a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1ed0162bd0 0x7f1ed00d1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46014/0 (socket says 172.21.15.106:46014) 2024-04-26T21:16:34.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ec6a00640 1 -- 172.21.15.106:0/362062070 learned_addr learned my addr 172.21.15.106:0/362062070 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:34.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ecfe00640 1 --2- 172.21.15.106:0/362062070 >> v2:172.21.15.112:3300/0 conn(0x7f1ed00d1680 0x7f1ed015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ec6a00640 1 -- 172.21.15.106:0/362062070 >> v2:172.21.15.112:3300/0 conn(0x7f1ed00d1680 msgr2=0x7f1ed015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:34.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ec6a00640 1 --2- 172.21.15.106:0/362062070 >> v2:172.21.15.112:3300/0 conn(0x7f1ed00d1680 0x7f1ed015f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ec6a00640 1 -- 172.21.15.106:0/362062070 >> v1:172.21.15.112:6789/0 conn(0x7f1ed0159890 legacy=0x7f1ed006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:34.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.163+0000 7f1ec6a00640 1 -- 172.21.15.106:0/362062070 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed00729c0 con 0x7f1ed0162bd0 2024-04-26T21:16:34.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ec6a00640 1 --2- 172.21.15.106:0/362062070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed0162bd0 0x7f1ed00d1140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ed006d3b0 tx=0x7f1eb801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a708011b60f9e92 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:34.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ecea00640 1 -- 172.21.15.106:0/362062070 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80b0070 con 0x7f1ed0162bd0 2024-04-26T21:16:34.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ecea00640 1 -- 172.21.15.106:0/362062070 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb80ab600 con 0x7f1ed0162bd0 2024-04-26T21:16:34.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ecea00640 1 -- 172.21.15.106:0/362062070 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80ab9d0 con 0x7f1ed0162bd0 2024-04-26T21:16:34.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ed6200640 1 -- 172.21.15.106:0/362062070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed0162bd0 msgr2=0x7f1ed00d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ed6200640 1 --2- 172.21.15.106:0/362062070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed0162bd0 0x7f1ed00d1140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ed006d3b0 tx=0x7f1eb801c520 comp rx=0 tx=0).stop 2024-04-26T21:16:34.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ed6200640 1 -- 172.21.15.106:0/362062070 shutdown_connections 2024-04-26T21:16:34.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ed6200640 1 --2- 172.21.15.106:0/362062070 >> v2:172.21.15.112:3300/0 conn(0x7f1ed00d1680 0x7f1ed015f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ed6200640 1 --2- 172.21.15.106:0/362062070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed0162bd0 0x7f1ed00d1140 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ed6200640 1 -- 172.21.15.106:0/362062070 >> 172.21.15.106:0/362062070 conn(0x7f1ed006c400 msgr2=0x7f1ed006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:34.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ed6200640 1 -- 172.21.15.106:0/362062070 shutdown_connections 2024-04-26T21:16:34.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.167+0000 7f1ed6200640 1 -- 172.21.15.106:0/362062070 wait complete. 2024-04-26T21:16:34.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ed6200640 1 Processor -- start 2024-04-26T21:16:34.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ed6200640 1 -- start start 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ed6200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed00d1680 0x7f1ed0151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ed6200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed0162bd0 0x7f1ed015d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ed6200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed00af960 0x7f1ed015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ed6200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed0075e30 con 0x7f1ed00af960 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ed6200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed0073540 con 0x7f1ed0162bd0 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ed6200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed016bf70 con 0x7f1ed00d1680 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ecfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed00af960 0x7f1ed015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ecf400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed00d1680 0x7f1ed0151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ecf400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed00d1680 0x7f1ed0151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:51952/0 (socket says 172.21.15.106:51952) 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec6a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed0162bd0 0x7f1ed015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ecf400640 1 -- 172.21.15.106:0/2650169816 learned_addr learned my addr 172.21.15.106:0/2650169816 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:34.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ecfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed00af960 0x7f1ed015eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46026/0 (socket says 172.21.15.106:46026) 2024-04-26T21:16:34.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec6a00640 1 -- 172.21.15.106:0/2650169816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed00d1680 msgr2=0x7f1ed0151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec6a00640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed00d1680 0x7f1ed0151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec6a00640 1 -- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed00af960 msgr2=0x7f1ed015eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec6a00640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed00af960 0x7f1ed015eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec6a00640 1 -- 172.21.15.106:0/2650169816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed00afe10 con 0x7f1ed0162bd0 2024-04-26T21:16:34.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ecfe00640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed00af960 0x7f1ed015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:34.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec6a00640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed0162bd0 0x7f1ed015d360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ed006e430 tx=0x7f1eb80192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:34.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec7e00640 1 -- 172.21.15.106:0/2650169816 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80ba070 con 0x7f1ed0162bd0 2024-04-26T21:16:34.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec7e00640 1 -- 172.21.15.106:0/2650169816 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb80b4420 con 0x7f1ed0162bd0 2024-04-26T21:16:34.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ec7e00640 1 -- 172.21.15.106:0/2650169816 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80b0040 con 0x7f1ed0162bd0 2024-04-26T21:16:34.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.171+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed015dab0 con 0x7f1ed0162bd0 2024-04-26T21:16:34.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.175+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed015e070 con 0x7f1ed0162bd0 2024-04-26T21:16:34.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.175+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed0069400 con 0x7f1ed0162bd0 2024-04-26T21:16:34.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.175+0000 7f1ec7e00640 1 -- 172.21.15.106:0/2650169816 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1eb80b47f0 con 0x7f1ed0162bd0 2024-04-26T21:16:34.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.175+0000 7f1ec7e00640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1eac068380 0x7f1eac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.175+0000 7f1ec7e00640 1 -- 172.21.15.106:0/2650169816 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1eb8120180 con 0x7f1ed0162bd0 2024-04-26T21:16:34.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.175+0000 7f1ecf400640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1eac068380 0x7f1eac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.175+0000 7f1ecf400640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1eac068380 0x7f1eac06a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00d0a90 tx=0x7f1ec0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:34.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.179+0000 7f1ec7e00640 1 -- 172.21.15.106:0/2650169816 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1eb80c3020 con 0x7f1ed0162bd0 2024-04-26T21:16:34.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.339+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ed00d2170 con 0x7f1ed0162bd0 2024-04-26T21:16:34.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.339+0000 7f1ec7e00640 1 -- 172.21.15.106:0/2650169816 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f1eb8016110 con 0x7f1ed0162bd0 2024-04-26T21:16:34.343 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:16:34.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1eac068380 msgr2=0x7f1eac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1eac068380 0x7f1eac06a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00d0a90 tx=0x7f1ec0009040 comp rx=0 tx=0).stop 2024-04-26T21:16:34.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed0162bd0 msgr2=0x7f1ed015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed0162bd0 0x7f1ed015d360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ed006e430 tx=0x7f1eb80192c0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 shutdown_connections 2024-04-26T21:16:34.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ed0162bd0 0x7f1ed015d360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1eac068380 0x7f1eac06a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ed00af960 0x7f1ed015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 --2- 172.21.15.106:0/2650169816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ed00d1680 0x7f1ed0151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 >> 172.21.15.106:0/2650169816 conn(0x7f1ed006c400 msgr2=0x7f1ed01559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:34.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 shutdown_connections 2024-04-26T21:16:34.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.343+0000 7f1ed6200640 1 -- 172.21.15.106:0/2650169816 wait complete. 2024-04-26T21:16:34.365 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:16:34.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.499+0000 7fa65fc00640 1 Processor -- start 2024-04-26T21:16:34.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.499+0000 7fa65fc00640 1 -- start start 2024-04-26T21:16:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa65fc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa65815ea90 0x7fa658166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa65fc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6580b4f00 con 0x7fa65815d080 2024-04-26T21:16:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa65fc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6580b51e0 con 0x7fa65815c4e0 2024-04-26T21:16:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa65fc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa65815d5f0 con 0x7fa65815ea90 2024-04-26T21:16:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa64fe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa65815d080 0x7fa6580b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34070/0 (socket says 172.21.15.106:34070) 2024-04-26T21:16:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa64fe00640 1 -- 172.21.15.106:0/2442221270 learned_addr learned my addr 172.21.15.106:0/2442221270 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:34.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa65dc00640 1 --2- 172.21.15.106:0/2442221270 >> v2:172.21.15.112:3300/0 conn(0x7fa65815ea90 0x7fa658166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa657e00640 1 -- 172.21.15.106:0/2442221270 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632748444 0 0) 0x7fa6580b4f00 con 0x7fa65815d080 2024-04-26T21:16:34.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa657e00640 1 -- 172.21.15.106:0/2442221270 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa63c003530 con 0x7fa65815d080 2024-04-26T21:16:34.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa657e00640 1 -- 172.21.15.106:0/2442221270 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 872498916 0 0) 0x7fa63c003530 con 0x7fa65815d080 2024-04-26T21:16:34.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa65dc00640 1 -- 172.21.15.106:0/2442221270 >> v1:172.21.15.112:6789/0 conn(0x7fa65815c4e0 legacy=0x7fa65815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa65dc00640 1 -- 172.21.15.106:0/2442221270 >> v1:172.21.15.106:6789/0 conn(0x7fa65815d080 legacy=0x7fa6580b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.503+0000 7fa65dc00640 1 -- 172.21.15.106:0/2442221270 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6580b54c0 con 0x7fa65815ea90 2024-04-26T21:16:34.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65dc00640 1 --2- 172.21.15.106:0/2442221270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65815ea90 0x7fa658166db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa650009d90 tx=0x7fa65001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df9b29b98937b39f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa657e00640 1 -- 172.21.15.106:0/2442221270 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6500b2070 con 0x7fa65815ea90 2024-04-26T21:16:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa657e00640 1 -- 172.21.15.106:0/2442221270 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6500a5580 con 0x7fa65815ea90 2024-04-26T21:16:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa657e00640 1 -- 172.21.15.106:0/2442221270 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640001680 con 0x7fa65815ea90 2024-04-26T21:16:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65fc00640 1 -- 172.21.15.106:0/2442221270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65815ea90 msgr2=0x7fa658166db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65fc00640 1 --2- 172.21.15.106:0/2442221270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65815ea90 0x7fa658166db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa650009d90 tx=0x7fa65001c890 comp rx=0 tx=0).stop 2024-04-26T21:16:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65fc00640 1 -- 172.21.15.106:0/2442221270 shutdown_connections 2024-04-26T21:16:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65fc00640 1 --2- 172.21.15.106:0/2442221270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65815ea90 0x7fa658166db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65fc00640 1 -- 172.21.15.106:0/2442221270 >> 172.21.15.106:0/2442221270 conn(0x7fa6580b2910 msgr2=0x7fa6580b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65fc00640 1 -- 172.21.15.106:0/2442221270 shutdown_connections 2024-04-26T21:16:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65fc00640 1 -- 172.21.15.106:0/2442221270 wait complete. 2024-04-26T21:16:34.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65fc00640 1 Processor -- start 2024-04-26T21:16:34.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.507+0000 7fa65fc00640 1 -- start start 2024-04-26T21:16:34.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65fc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65815c4e0 0x7fa6580cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65fc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa65815d080 0x7fa6581342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65fc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65815ea90 0x7fa658134830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65fc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa658169ea0 con 0x7fa65815c4e0 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65fc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa658169d20 con 0x7fa65815ea90 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65fc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa65816a020 con 0x7fa65815d080 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65d200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65815c4e0 0x7fa6580cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65d200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65815c4e0 0x7fa6580cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46036/0 (socket says 172.21.15.106:46036) 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65d200640 1 -- 172.21.15.106:0/4231693849 learned_addr learned my addr 172.21.15.106:0/4231693849 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65d200640 1 -- 172.21.15.106:0/4231693849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa65815d080 msgr2=0x7fa6581342f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65d200640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa65815d080 0x7fa6581342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65d200640 1 -- 172.21.15.106:0/4231693849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65815ea90 msgr2=0x7fa658134830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65d200640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65815ea90 0x7fa658134830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65d200640 1 -- 172.21.15.106:0/4231693849 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa658132ae0 con 0x7fa65815c4e0 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65d200640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65815c4e0 0x7fa6580cfe00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c500 tx=0x7fa64800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa655600640 1 -- 172.21.15.106:0/4231693849 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648016020 con 0x7fa65815c4e0 2024-04-26T21:16:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa655600640 1 -- 172.21.15.106:0/4231693849 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa648005220 con 0x7fa65815c4e0 2024-04-26T21:16:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa655600640 1 -- 172.21.15.106:0/4231693849 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648007030 con 0x7fa65815c4e0 2024-04-26T21:16:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa658132dc0 con 0x7fa65815c4e0 2024-04-26T21:16:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa658133380 con 0x7fa65815c4e0 2024-04-26T21:16:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa658135cc0 con 0x7fa65815c4e0 2024-04-26T21:16:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.511+0000 7fa655600640 1 -- 172.21.15.106:0/4231693849 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6480071f0 con 0x7fa65815c4e0 2024-04-26T21:16:34.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.515+0000 7fa655600640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa6340683b0 0x7fa63406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.515+0000 7fa655600640 1 -- 172.21.15.106:0/4231693849 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa648086720 con 0x7fa65815c4e0 2024-04-26T21:16:34.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.515+0000 7fa64fe00640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa6340683b0 0x7fa63406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.515+0000 7fa64fe00640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa6340683b0 0x7fa63406a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa640000c10 tx=0x7fa6400011b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:34.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.519+0000 7fa655600640 1 -- 172.21.15.106:0/4231693849 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa658135cc0 con 0x7fa65815c4e0 2024-04-26T21:16:34.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa65806fb90 con 0x7fa65815c4e0 2024-04-26T21:16:34.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa655600640 1 -- 172.21.15.106:0/4231693849 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fa648020020 con 0x7fa65815c4e0 2024-04-26T21:16:34.677 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:16:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa6340683b0 msgr2=0x7fa63406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa6340683b0 0x7fa63406a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa640000c10 tx=0x7fa6400011b0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65815c4e0 msgr2=0x7fa6580cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65815c4e0 0x7fa6580cfe00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c500 tx=0x7fa64800c9c0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 shutdown_connections 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65815ea90 0x7fa658134830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa6340683b0 0x7fa63406a870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa65815d080 0x7fa6581342f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 --2- 172.21.15.106:0/4231693849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65815c4e0 0x7fa6580cfe00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 >> 172.21.15.106:0/4231693849 conn(0x7fa6580b2910 msgr2=0x7fa658143f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 shutdown_connections 2024-04-26T21:16:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.675+0000 7fa65fc00640 1 -- 172.21.15.106:0/4231693849 wait complete. 2024-04-26T21:16:34.698 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:16:34.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb3800640 1 Processor -- start 2024-04-26T21:16:34.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb3800640 1 -- start start 2024-04-26T21:16:34.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb3800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 0x7fdeac0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb3800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeac0b44a0 con 0x7fdeac15e020 2024-04-26T21:16:34.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb3800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeac0b4780 con 0x7fdeac0b5260 2024-04-26T21:16:34.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb3800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac0b4a60 con 0x7fdeac15d530 2024-04-26T21:16:34.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb1800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdeac15e020 0x7fdeac166ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34086/0 (socket says 172.21.15.106:34086) 2024-04-26T21:16:34.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb1800640 1 -- 172.21.15.106:0/1432992084 learned_addr learned my addr 172.21.15.106:0/1432992084 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:34.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb0e00640 1 --2- 172.21.15.106:0/1432992084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 0x7fdeac0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeab400640 1 -- 172.21.15.106:0/1432992084 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939763298 0 0) 0x7fdeac0b44a0 con 0x7fdeac15e020 2024-04-26T21:16:34.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeab400640 1 -- 172.21.15.106:0/1432992084 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde90003530 con 0x7fdeac15e020 2024-04-26T21:16:34.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeab400640 1 -- 172.21.15.106:0/1432992084 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589499089 0 0) 0x7fdeac0b4780 con 0x7fdeac0b5260 2024-04-26T21:16:34.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeab400640 1 -- 172.21.15.106:0/1432992084 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeac0b44a0 con 0x7fdeac0b5260 2024-04-26T21:16:34.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb0e00640 1 -- 172.21.15.106:0/1432992084 >> v1:172.21.15.112:6789/0 conn(0x7fdeac0b5260 legacy=0x7fdeac15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeab400640 1 -- 172.21.15.106:0/1432992084 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2250333768 0 0) 0x7fde90003530 con 0x7fdeac15e020 2024-04-26T21:16:34.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb0e00640 1 -- 172.21.15.106:0/1432992084 >> v1:172.21.15.106:6789/0 conn(0x7fdeac15e020 legacy=0x7fdeac166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.835+0000 7fdeb0e00640 1 -- 172.21.15.106:0/1432992084 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac0b4d40 con 0x7fdeac15d530 2024-04-26T21:16:34.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb0e00640 1 --2- 172.21.15.106:0/1432992084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 0x7fdeac0cfe20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0097f0 tx=0x7fde9c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=877e533f4f1fa3bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:34.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeab400640 1 -- 172.21.15.106:0/1432992084 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0b0070 con 0x7fdeac15d530 2024-04-26T21:16:34.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeab400640 1 -- 172.21.15.106:0/1432992084 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c0ab400 con 0x7fdeac15d530 2024-04-26T21:16:34.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeab400640 1 -- 172.21.15.106:0/1432992084 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4001a00 con 0x7fdeac15d530 2024-04-26T21:16:34.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb3800640 1 -- 172.21.15.106:0/1432992084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 msgr2=0x7fdeac0cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb3800640 1 --2- 172.21.15.106:0/1432992084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 0x7fdeac0cfe20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0097f0 tx=0x7fde9c01c400 comp rx=0 tx=0).stop 2024-04-26T21:16:34.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb3800640 1 -- 172.21.15.106:0/1432992084 shutdown_connections 2024-04-26T21:16:34.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb3800640 1 --2- 172.21.15.106:0/1432992084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 0x7fdeac0cfe20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb3800640 1 -- 172.21.15.106:0/1432992084 >> 172.21.15.106:0/1432992084 conn(0x7fdeac0b2910 msgr2=0x7fdeac0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:34.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb3800640 1 -- 172.21.15.106:0/1432992084 shutdown_connections 2024-04-26T21:16:34.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb3800640 1 -- 172.21.15.106:0/1432992084 wait complete. 2024-04-26T21:16:34.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb3800640 1 Processor -- start 2024-04-26T21:16:34.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.839+0000 7fdeb3800640 1 -- start start 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb3800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdeac0b5260 0x7fdeac13aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb3800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 0x7fdeac072e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb3800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac15e020 0x7fdeac1fba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb3800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac16adb0 con 0x7fdeac0b5260 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb3800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac16ac30 con 0x7fdeac15e020 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb3800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac16af30 con 0x7fdeac15d530 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb0e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdeac0b5260 0x7fdeac13aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb0e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdeac0b5260 0x7fdeac13aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46042/0 (socket says 172.21.15.106:46042) 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb0e00640 1 -- 172.21.15.106:0/2243078598 learned_addr learned my addr 172.21.15.106:0/2243078598 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeabe00640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 0x7fdeac072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb1800640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac15e020 0x7fdeac1fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb0e00640 1 -- 172.21.15.106:0/2243078598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 msgr2=0x7fdeac072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb0e00640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 0x7fdeac072e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb0e00640 1 -- 172.21.15.106:0/2243078598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac15e020 msgr2=0x7fdeac1fba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb0e00640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac15e020 0x7fdeac1fba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb0e00640 1 -- 172.21.15.106:0/2243078598 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac1399c0 con 0x7fdeac0b5260 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb0e00640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdeac0b5260 0x7fdeac13aa60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0097f0 tx=0x7fde9c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdea8c00640 1 -- 172.21.15.106:0/2243078598 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0bb020 con 0x7fdeac0b5260 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdea8c00640 1 -- 172.21.15.106:0/2243078598 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c0b1040 con 0x7fdeac0b5260 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdea8c00640 1 -- 172.21.15.106:0/2243078598 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0b0050 con 0x7fdeac0b5260 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeac139ca0 con 0x7fdeac0b5260 2024-04-26T21:16:34.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeac13a260 con 0x7fdeac0b5260 2024-04-26T21:16:34.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.843+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeac069400 con 0x7fdeac0b5260 2024-04-26T21:16:34.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.847+0000 7fdea8c00640 1 -- 172.21.15.106:0/2243078598 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fde9c0be070 con 0x7fdeac0b5260 2024-04-26T21:16:34.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.847+0000 7fdea8c00640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde8c068380 0x7fde8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:34.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.847+0000 7fdea8c00640 1 -- 172.21.15.106:0/2243078598 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fde9c120220 con 0x7fdeac0b5260 2024-04-26T21:16:34.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.847+0000 7fdeabe00640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde8c068380 0x7fde8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:34.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.847+0000 7fdeabe00640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde8c068380 0x7fde8c06a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0b60c0 tx=0x7fde98009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:34.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:34.851+0000 7fdea8c00640 1 -- 172.21.15.106:0/2243078598 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fde9c015ff0 con 0x7fdeac0b5260 2024-04-26T21:16:35.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdeac0b6110 con 0x7fdeac0b5260 2024-04-26T21:16:35.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdea8c00640 1 -- 172.21.15.106:0/2243078598 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fde9c0efe40 con 0x7fdeac0b5260 2024-04-26T21:16:35.009 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:16:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde8c068380 msgr2=0x7fde8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde8c068380 0x7fde8c06a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0b60c0 tx=0x7fde98009040 comp rx=0 tx=0).stop 2024-04-26T21:16:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdeac0b5260 msgr2=0x7fdeac13aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdeac0b5260 0x7fdeac13aa60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0097f0 tx=0x7fde9c01ac40 comp rx=0 tx=0).stop 2024-04-26T21:16:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 shutdown_connections 2024-04-26T21:16:35.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdeac15e020 0x7fdeac1fba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde8c068380 0x7fde8c06a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdeac15d530 0x7fdeac072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 --2- 172.21.15.106:0/2243078598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdeac0b5260 0x7fdeac13aa60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 >> 172.21.15.106:0/2243078598 conn(0x7fdeac0b2910 msgr2=0x7fdeac13b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:35.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 shutdown_connections 2024-04-26T21:16:35.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.007+0000 7fdeb3800640 1 -- 172.21.15.106:0/2243078598 wait complete. 2024-04-26T21:16:35.031 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:16:35.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.163+0000 7f7695400640 1 Processor -- start 2024-04-26T21:16:35.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.163+0000 7f7695400640 1 -- start start 2024-04-26T21:16:35.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f7695400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76900b5260 0x7f769015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f7695400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76900b44a0 con 0x7f769015d530 2024-04-26T21:16:35.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f7695400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76900b4780 con 0x7f769015de50 2024-04-26T21:16:35.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f7695400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f76900b4a60 con 0x7f76900b5260 2024-04-26T21:16:35.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f7685e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76900b5260 0x7f769015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f768e800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f769015d530 0x7f76900cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34094/0 (socket says 172.21.15.106:34094) 2024-04-26T21:16:35.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f768e800640 1 -- 172.21.15.106:0/725467450 learned_addr learned my addr 172.21.15.106:0/725467450 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:35.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f7685e00640 1 -- 172.21.15.106:0/725467450 >> v1:172.21.15.112:6789/0 conn(0x7f769015de50 legacy=0x7f7690166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:35.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f768de00640 1 -- 172.21.15.106:0/725467450 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831044085 0 0) 0x7f76900b44a0 con 0x7f769015d530 2024-04-26T21:16:35.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f7685e00640 1 -- 172.21.15.106:0/725467450 >> v1:172.21.15.106:6789/0 conn(0x7f769015d530 legacy=0x7f76900cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.167+0000 7f7685e00640 1 -- 172.21.15.106:0/725467450 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76900b4d40 con 0x7f76900b5260 2024-04-26T21:16:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7685e00640 1 --2- 172.21.15.106:0/725467450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 0x7f769015d910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f76780097c0 tx=0x7f767801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a800ce5079d18e4a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f768de00640 1 -- 172.21.15.106:0/725467450 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76780ab660 con 0x7f76900b5260 2024-04-26T21:16:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f768de00640 1 -- 172.21.15.106:0/725467450 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76780b0070 con 0x7f76900b5260 2024-04-26T21:16:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f768de00640 1 -- 172.21.15.106:0/725467450 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76780aba20 con 0x7f76900b5260 2024-04-26T21:16:35.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7695400640 1 -- 172.21.15.106:0/725467450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 msgr2=0x7f769015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7695400640 1 --2- 172.21.15.106:0/725467450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 0x7f769015d910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f76780097c0 tx=0x7f767801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7695400640 1 -- 172.21.15.106:0/725467450 shutdown_connections 2024-04-26T21:16:35.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7695400640 1 --2- 172.21.15.106:0/725467450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 0x7f769015d910 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7695400640 1 -- 172.21.15.106:0/725467450 >> 172.21.15.106:0/725467450 conn(0x7f76900b2910 msgr2=0x7f76900b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:35.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7695400640 1 -- 172.21.15.106:0/725467450 shutdown_connections 2024-04-26T21:16:35.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7695400640 1 -- 172.21.15.106:0/725467450 wait complete. 2024-04-26T21:16:35.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7695400640 1 Processor -- start 2024-04-26T21:16:35.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.171+0000 7f7695400640 1 -- start start 2024-04-26T21:16:35.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7695400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 0x7f769015c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7695400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f769015d530 0x7f769015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7695400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f769015de50 0x7f76900ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7695400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f76900d06b0 con 0x7f76900b5260 2024-04-26T21:16:35.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7695400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f76900d0530 con 0x7f769015d530 2024-04-26T21:16:35.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7695400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f769016aa20 con 0x7f769015de50 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 0x7f769015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 0x7f769015c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46056/0 (socket says 172.21.15.106:46056) 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768e800640 1 -- 172.21.15.106:0/2369568965 learned_addr learned my addr 172.21.15.106:0/2369568965 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7685e00640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f769015d530 0x7f769015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768f200640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f769015de50 0x7f76900ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768e800640 1 -- 172.21.15.106:0/2369568965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f769015de50 msgr2=0x7f76900ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768e800640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f769015de50 0x7f76900ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768e800640 1 -- 172.21.15.106:0/2369568965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f769015d530 msgr2=0x7f769015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768e800640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f769015d530 0x7f769015bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768e800640 1 -- 172.21.15.106:0/2369568965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76900d0a40 con 0x7f76900b5260 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7685e00640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f769015d530 0x7f769015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f768e800640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 0x7f769015c200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f768000c4d0 tx=0x7f768000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:35.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7687400640 1 -- 172.21.15.106:0/2369568965 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680018070 con 0x7f76900b5260 2024-04-26T21:16:35.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7687400640 1 -- 172.21.15.106:0/2369568965 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76800074e0 con 0x7f76900b5260 2024-04-26T21:16:35.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7687400640 1 -- 172.21.15.106:0/2369568965 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680004a30 con 0x7f76900b5260 2024-04-26T21:16:35.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7690144b10 con 0x7f76900b5260 2024-04-26T21:16:35.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76901450d0 con 0x7f76900b5260 2024-04-26T21:16:35.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7690069400 con 0x7f76900b5260 2024-04-26T21:16:35.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.175+0000 7f7687400640 1 -- 172.21.15.106:0/2369568965 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f768001b070 con 0x7f76900b5260 2024-04-26T21:16:35.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.179+0000 7f7687400640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f766c068380 0x7f766c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.179+0000 7f7687400640 1 -- 172.21.15.106:0/2369568965 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7680085ff0 con 0x7f76900b5260 2024-04-26T21:16:35.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.179+0000 7f7685e00640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f766c068380 0x7f766c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.179+0000 7f7685e00640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f766c068380 0x7f766c06a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f76780af000 tx=0x7f76780a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:35.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.183+0000 7f7687400640 1 -- 172.21.15.106:0/2369568965 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7680056210 con 0x7f76900b5260 2024-04-26T21:16:35.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.339+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f76900d0040 con 0x7f76900b5260 2024-04-26T21:16:35.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.339+0000 7f7687400640 1 -- 172.21.15.106:0/2369568965 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f7680055b10 con 0x7f76900b5260 2024-04-26T21:16:35.343 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:16:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f766c068380 msgr2=0x7f766c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f766c068380 0x7f766c06a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f76780af000 tx=0x7f76780a7000 comp rx=0 tx=0).stop 2024-04-26T21:16:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 msgr2=0x7f769015c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 0x7f769015c200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f768000c4d0 tx=0x7f768000c990 comp rx=0 tx=0).stop 2024-04-26T21:16:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 shutdown_connections 2024-04-26T21:16:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f769015d530 0x7f769015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f766c068380 0x7f766c06a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f769015de50 0x7f76900ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 --2- 172.21.15.106:0/2369568965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76900b5260 0x7f769015c200 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 >> 172.21.15.106:0/2369568965 conn(0x7f76900b2910 msgr2=0x7f76900d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 shutdown_connections 2024-04-26T21:16:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.343+0000 7f7695400640 1 -- 172.21.15.106:0/2369568965 wait complete. 2024-04-26T21:16:35.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:16:35.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b3200640 1 Processor -- start 2024-04-26T21:16:35.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b3200640 1 -- start start 2024-04-26T21:16:35.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b3200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac15f0c0 0x7fb2ac0cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b3200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2ac0cd160 con 0x7fb2ac0ce900 2024-04-26T21:16:35.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b3200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2ac06e5d0 con 0x7fb2ac0d3560 2024-04-26T21:16:35.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b3200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2ac0d1850 con 0x7fb2ac15f0c0 2024-04-26T21:16:35.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b2800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb2ac0ce900 0x7fb2ac06dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34110/0 (socket says 172.21.15.106:34110) 2024-04-26T21:16:35.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b2800640 1 -- 172.21.15.106:0/2090336265 learned_addr learned my addr 172.21.15.106:0/2090336265 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:35.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b1e00640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac15f0c0 0x7fb2ac0cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382400357 0 0) 0x7fb2ac0cd160 con 0x7fb2ac0ce900 2024-04-26T21:16:35.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb294003530 con 0x7fb2ac0ce900 2024-04-26T21:16:35.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097402862 0 0) 0x7fb2ac06e5d0 con 0x7fb2ac0d3560 2024-04-26T21:16:35.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2ac0cd160 con 0x7fb2ac0d3560 2024-04-26T21:16:35.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3168152332 0 0) 0x7fb294003530 con 0x7fb2ac0ce900 2024-04-26T21:16:35.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac15f0c0 msgr2=0x7fb2ac0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:35.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac15f0c0 0x7fb2ac0cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 >> v1:172.21.15.112:6789/0 conn(0x7fb2ac0d3560 legacy=0x7fb2ac06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac15f4a0 con 0x7fb2ac0ce900 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7fb2a8001a00 con 0x7fb2ac0ce900 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 >> v1:172.21.15.106:6789/0 conn(0x7fb2ac0ce900 legacy=0x7fb2ac06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac15f0c0 0x7fb294003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2940040e0 0x7fb294004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb294004d50 0x7fb2940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac0d1850 con 0x7fb2940040e0 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb29400bab0 con 0x7fb294004d50 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb29400bcb0 con 0x7fb2ac15f0c0 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b1400640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2940040e0 0x7fb294004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b1e00640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac15f0c0 0x7fb294003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.499+0000 7fb2b2800640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb294004d50 0x7fb2940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b1400640 1 -- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac15f0c0 msgr2=0x7fb294003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b1400640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac15f0c0 0x7fb294003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b1400640 1 -- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb294004d50 msgr2=0x7fb2940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:35.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b1400640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb294004d50 0x7fb2940051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b1400640 1 -- 172.21.15.106:0/2090336265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb294003530 con 0x7fb2940040e0 2024-04-26T21:16:35.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b2800640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb294004d50 0x7fb2940051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:35.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b1400640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2940040e0 0x7fb294004810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0018d0 tx=0x7fb29c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e06ccb0c8f1ef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:35.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c001520 con 0x7fb2940040e0 2024-04-26T21:16:35.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c0052f0 con 0x7fb2940040e0 2024-04-26T21:16:35.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b0a00640 1 -- 172.21.15.106:0/2090336265 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0a8950 con 0x7fb2940040e0 2024-04-26T21:16:35.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b3200640 1 -- 172.21.15.106:0/2090336265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2940040e0 msgr2=0x7fb294004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b3200640 1 --2- 172.21.15.106:0/2090336265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2940040e0 0x7fb294004810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0018d0 tx=0x7fb29c01ecf0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b2800640 1 -- 172.21.15.106:0/2090336265 reap_dead start 2024-04-26T21:16:35.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b3200640 1 -- 172.21.15.106:0/2090336265 shutdown_connections 2024-04-26T21:16:35.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b3200640 1 -- 172.21.15.106:0/2090336265 >> 172.21.15.106:0/2090336265 conn(0x7fb2ac0d2a70 msgr2=0x7fb2ac0d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:35.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b3200640 1 -- 172.21.15.106:0/2090336265 shutdown_connections 2024-04-26T21:16:35.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.503+0000 7fb2b3200640 1 -- 172.21.15.106:0/2090336265 wait complete. 2024-04-26T21:16:35.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b3200640 1 Processor -- start 2024-04-26T21:16:35.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b3200640 1 -- start start 2024-04-26T21:16:35.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b3200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2940040e0 0x7fb2ac0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b3200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac1f4d20 0x7fb2ac1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b3200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2ac070b30 0x7fb2ac070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b3200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac0cd3d0 con 0x7fb2ac070b30 2024-04-26T21:16:35.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b3200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac0d1d80 con 0x7fb2940040e0 2024-04-26T21:16:35.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b3200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2ac0d2060 con 0x7fb2ac1f4d20 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2ac070b30 0x7fb2ac070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2ac070b30 0x7fb2ac070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46064/0 (socket says 172.21.15.106:46064) 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b2800640 1 -- 172.21.15.106:0/929458520 learned_addr learned my addr 172.21.15.106:0/929458520 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b1400640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac1f4d20 0x7fb2ac1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b1e00640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2940040e0 0x7fb2ac0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b2800640 1 -- 172.21.15.106:0/929458520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac1f4d20 msgr2=0x7fb2ac1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b2800640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac1f4d20 0x7fb2ac1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b2800640 1 -- 172.21.15.106:0/929458520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2940040e0 msgr2=0x7fb2ac0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b2800640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2940040e0 0x7fb2ac0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b2800640 1 -- 172.21.15.106:0/929458520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac1f5d40 con 0x7fb2ac070b30 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b2800640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2ac070b30 0x7fb2ac070fc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8000f90 tx=0x7fb2a800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2a6000640 1 -- 172.21.15.106:0/929458520 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800eb90 con 0x7fb2ac070b30 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2a6000640 1 -- 172.21.15.106:0/929458520 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a8018070 con 0x7fb2ac070b30 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2a6000640 1 -- 172.21.15.106:0/929458520 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8013420 con 0x7fb2ac070b30 2024-04-26T21:16:35.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.507+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac1f51c0 con 0x7fb2ac070b30 2024-04-26T21:16:35.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.511+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac1f5780 con 0x7fb2ac070b30 2024-04-26T21:16:35.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.511+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ac069400 con 0x7fb2ac070b30 2024-04-26T21:16:35.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.511+0000 7fb2a6000640 1 -- 172.21.15.106:0/929458520 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb2a80135c0 con 0x7fb2ac070b30 2024-04-26T21:16:35.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.511+0000 7fb2a6000640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb2900683b0 0x7fb29006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:35.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.511+0000 7fb2a6000640 1 -- 172.21.15.106:0/929458520 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb2a8086fd0 con 0x7fb2ac070b30 2024-04-26T21:16:35.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.511+0000 7fb2b1e00640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb2900683b0 0x7fb29006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:35.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.511+0000 7fb2b1e00640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb2900683b0 0x7fb29006a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009b00 tx=0x7fb2a0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.515+0000 7fb2a6000640 1 -- 172.21.15.106:0/929458520 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb2a80571b0 con 0x7fb2ac070b30 2024-04-26T21:16:35.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb2ac0b53e0 con 0x7fb2ac070b30 2024-04-26T21:16:35.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2a6000640 1 -- 172.21.15.106:0/929458520 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fb2a8056ab0 con 0x7fb2ac070b30 2024-04-26T21:16:35.686 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb2900683b0 msgr2=0x7fb29006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb2900683b0 0x7fb29006a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009b00 tx=0x7fb2a0009190 comp rx=0 tx=0).stop 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2ac070b30 msgr2=0x7fb2ac070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2ac070b30 0x7fb2ac070fc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8000f90 tx=0x7fb2a800e530 comp rx=0 tx=0).stop 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 shutdown_connections 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb2900683b0 0x7fb29006a870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2ac070b30 0x7fb2ac070fc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2ac1f4d20 0x7fb2ac1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 --2- 172.21.15.106:0/929458520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2940040e0 0x7fb2ac0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 >> 172.21.15.106:0/929458520 conn(0x7fb2ac0d2a70 msgr2=0x7fb2ac06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 shutdown_connections 2024-04-26T21:16:35.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.683+0000 7fb2b3200640 1 -- 172.21.15.106:0/929458520 wait complete. 2024-04-26T21:16:35.706 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi106.front.sepia.ceph.com... 2024-04-26T21:16:35.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:35.706 DEBUG:teuthology.orchestra.run.smithi106:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-26T21:16:35.737 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi106.stderr:ceph-fuse[33454]: fuse finished with error 0 and tester_r 0 2024-04-26T21:16:35.740 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:16:35.768 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:16:35.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:35.769 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-26T21:16:35.823 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:36.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc173800640 1 Processor -- start 2024-04-26T21:16:36.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc173800640 1 -- start start 2024-04-26T21:16:36.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc173800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146490 0x7fc16c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc173800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc16c160ac0 0x7fc16c0cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc173800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16c0cf730 con 0x7fc16c146870 2024-04-26T21:16:36.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc173800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc16c0b3da0 con 0x7fc16c160ac0 2024-04-26T21:16:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc173800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc16c160fa0 con 0x7fc16c146490 2024-04-26T21:16:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc16be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc16c160ac0 0x7fc16c0cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc16be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc16c160ac0 0x7fc16c0cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46080/0 (socket says 172.21.15.106:46080) 2024-04-26T21:16:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc16be00640 1 -- 172.21.15.106:0/3044066214 learned_addr learned my addr 172.21.15.106:0/3044066214 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc170e00640 1 --2- 172.21.15.106:0/3044066214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146490 0x7fc16c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc16be00640 1 -- 172.21.15.106:0/3044066214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146490 msgr2=0x7fc16c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:35.999+0000 7fc16be00640 1 --2- 172.21.15.106:0/3044066214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146490 0x7fc16c15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc16be00640 1 -- 172.21.15.106:0/3044066214 >> v1:172.21.15.112:6789/0 conn(0x7fc16c146870 legacy=0x7fc16c0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc16be00640 1 -- 172.21.15.106:0/3044066214 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16c161280 con 0x7fc16c160ac0 2024-04-26T21:16:36.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc16be00640 1 --2- 172.21.15.106:0/3044066214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c160ac0 0x7fc16c0cf1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc158009870 tx=0x7fc15801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a9830f35144f19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:36.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc16b400640 1 -- 172.21.15.106:0/3044066214 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1580ab650 con 0x7fc16c160ac0 2024-04-26T21:16:36.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc16b400640 1 -- 172.21.15.106:0/3044066214 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1580b0070 con 0x7fc16c160ac0 2024-04-26T21:16:36.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc16b400640 1 -- 172.21.15.106:0/3044066214 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1580aba10 con 0x7fc16c160ac0 2024-04-26T21:16:36.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc173800640 1 -- 172.21.15.106:0/3044066214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c160ac0 msgr2=0x7fc16c0cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc173800640 1 --2- 172.21.15.106:0/3044066214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c160ac0 0x7fc16c0cf1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc158009870 tx=0x7fc15801c560 comp rx=0 tx=0).stop 2024-04-26T21:16:36.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc173800640 1 -- 172.21.15.106:0/3044066214 shutdown_connections 2024-04-26T21:16:36.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc173800640 1 --2- 172.21.15.106:0/3044066214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c160ac0 0x7fc16c0cf1f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc173800640 1 --2- 172.21.15.106:0/3044066214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146490 0x7fc16c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc173800640 1 -- 172.21.15.106:0/3044066214 >> 172.21.15.106:0/3044066214 conn(0x7fc16c068340 msgr2=0x7fc16c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:36.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc173800640 1 -- 172.21.15.106:0/3044066214 shutdown_connections 2024-04-26T21:16:36.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.003+0000 7fc173800640 1 -- 172.21.15.106:0/3044066214 wait complete. 2024-04-26T21:16:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 Processor -- start 2024-04-26T21:16:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 -- start start 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c146490 0x7fc16c140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146870 0x7fc16c1625e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c160ac0 0x7fc16c13ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c0d1630 con 0x7fc16c146490 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c0d14b0 con 0x7fc16c160ac0 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc16c0b4dc0 con 0x7fc16c146870 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc170e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c146490 0x7fc16c140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc170e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c146490 0x7fc16c140270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46094/0 (socket says 172.21.15.106:46094) 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc170e00640 1 -- 172.21.15.106:0/168373746 learned_addr learned my addr 172.21.15.106:0/168373746 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:36.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc16be00640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146870 0x7fc16c1625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc171800640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c160ac0 0x7fc16c13ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc170e00640 1 -- 172.21.15.106:0/168373746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146870 msgr2=0x7fc16c1625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc170e00640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146870 0x7fc16c1625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc170e00640 1 -- 172.21.15.106:0/168373746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c160ac0 msgr2=0x7fc16c13ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc170e00640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c160ac0 0x7fc16c13ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc170e00640 1 -- 172.21.15.106:0/168373746 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16c140850 con 0x7fc16c146490 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc171800640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c160ac0 0x7fc16c13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc170e00640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c146490 0x7fc16c140270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00efc0 tx=0x7fc15c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc168c00640 1 -- 172.21.15.106:0/168373746 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c018020 con 0x7fc16c146490 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc168c00640 1 -- 172.21.15.106:0/168373746 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c014480 con 0x7fc16c146490 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc168c00640 1 -- 172.21.15.106:0/168373746 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c014850 con 0x7fc16c146490 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16c140b30 con 0x7fc16c146490 2024-04-26T21:16:36.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.007+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16c1410f0 con 0x7fc16c146490 2024-04-26T21:16:36.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.011+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16c069400 con 0x7fc16c146490 2024-04-26T21:16:36.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.011+0000 7fc168c00640 1 -- 172.21.15.106:0/168373746 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc15c01b020 con 0x7fc16c146490 2024-04-26T21:16:36.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.011+0000 7fc168c00640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc14c068380 0x7fc14c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.011+0000 7fc168c00640 1 -- 172.21.15.106:0/168373746 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc15c0877f0 con 0x7fc16c146490 2024-04-26T21:16:36.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.011+0000 7fc16be00640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc14c068380 0x7fc14c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.011+0000 7fc16be00640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc14c068380 0x7fc14c06a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1580af000 tx=0x7fc1580a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:36.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.015+0000 7fc168c00640 1 -- 172.21.15.106:0/168373746 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc15c022070 con 0x7fc16c146490 2024-04-26T21:16:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.171+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc16c073d70 con 0x7fc16c146490 2024-04-26T21:16:36.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc168c00640 1 -- 172.21.15.106:0/168373746 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7fc15c010040 con 0x7fc16c146490 2024-04-26T21:16:36.177 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:36.177 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:36.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc14c068380 msgr2=0x7fc14c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc14c068380 0x7fc14c06a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1580af000 tx=0x7fc1580a7000 comp rx=0 tx=0).stop 2024-04-26T21:16:36.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c146490 msgr2=0x7fc16c140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c146490 0x7fc16c140270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00efc0 tx=0x7fc15c00c490 comp rx=0 tx=0).stop 2024-04-26T21:16:36.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 shutdown_connections 2024-04-26T21:16:36.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c160ac0 0x7fc16c13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc14c068380 0x7fc14c06a840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc16c146870 0x7fc16c1625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 --2- 172.21.15.106:0/168373746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc16c146490 0x7fc16c140270 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 >> 172.21.15.106:0/168373746 conn(0x7fc16c068340 msgr2=0x7fc16c0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:36.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 shutdown_connections 2024-04-26T21:16:36.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.175+0000 7fc173800640 1 -- 172.21.15.106:0/168373746 wait complete. 2024-04-26T21:16:36.199 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:36.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.331+0000 7f28bb000640 1 Processor -- start 2024-04-26T21:16:36.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.331+0000 7f28bb000640 1 -- start start 2024-04-26T21:16:36.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28bb000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28b413ed60 0x7f28b415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28bb000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28b406eb70 0x7f28b40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28bb000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28b40b3d10 con 0x7f28b413f140 2024-04-26T21:16:36.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28bb000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f28b40b3ac0 con 0x7f28b413ed60 2024-04-26T21:16:36.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28bb000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f28b40b4920 con 0x7f28b406eb70 2024-04-26T21:16:36.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28b3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28b413ed60 0x7f28b415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28ab400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f28b413f140 0x7f28b40b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34118/0 (socket says 172.21.15.106:34118) 2024-04-26T21:16:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28ab400640 1 -- 172.21.15.106:0/3686814580 learned_addr learned my addr 172.21.15.106:0/3686814580 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28b9000640 1 --2- 172.21.15.106:0/3686814580 >> v2:172.21.15.112:3300/0 conn(0x7f28b406eb70 0x7f28b40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28b3e00640 1 -- 172.21.15.106:0/3686814580 >> v2:172.21.15.112:3300/0 conn(0x7f28b406eb70 msgr2=0x7f28b40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28b3e00640 1 --2- 172.21.15.106:0/3686814580 >> v2:172.21.15.112:3300/0 conn(0x7f28b406eb70 0x7f28b40d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28b3e00640 1 -- 172.21.15.106:0/3686814580 >> v1:172.21.15.106:6789/0 conn(0x7f28b413f140 legacy=0x7f28b40b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.335+0000 7f28b3e00640 1 -- 172.21.15.106:0/3686814580 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b40b3ff0 con 0x7f28b413ed60 2024-04-26T21:16:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28b3e00640 1 --2- 172.21.15.106:0/3686814580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413ed60 0x7f28b415c3e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f28b40cdcb0 tx=0x7f28a401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0aa7dd90fb1d241 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28b3400640 1 -- 172.21.15.106:0/3686814580 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a40b0070 con 0x7f28b413ed60 2024-04-26T21:16:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28b3400640 1 -- 172.21.15.106:0/3686814580 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a40ab600 con 0x7f28b413ed60 2024-04-26T21:16:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28b3400640 1 -- 172.21.15.106:0/3686814580 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a40ab9d0 con 0x7f28b413ed60 2024-04-26T21:16:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 -- 172.21.15.106:0/3686814580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413ed60 msgr2=0x7f28b415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 --2- 172.21.15.106:0/3686814580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413ed60 0x7f28b415c3e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f28b40cdcb0 tx=0x7f28a401c360 comp rx=0 tx=0).stop 2024-04-26T21:16:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 -- 172.21.15.106:0/3686814580 shutdown_connections 2024-04-26T21:16:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 --2- 172.21.15.106:0/3686814580 >> v2:172.21.15.112:3300/0 conn(0x7f28b406eb70 0x7f28b40d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 --2- 172.21.15.106:0/3686814580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413ed60 0x7f28b415c3e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 -- 172.21.15.106:0/3686814580 >> 172.21.15.106:0/3686814580 conn(0x7f28b4068340 msgr2=0x7f28b4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 -- 172.21.15.106:0/3686814580 shutdown_connections 2024-04-26T21:16:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 -- 172.21.15.106:0/3686814580 wait complete. 2024-04-26T21:16:36.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 Processor -- start 2024-04-26T21:16:36.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 -- start start 2024-04-26T21:16:36.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28b413ed60 0x7f28b4165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413b1a0 0x7f28b413d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28b413b620 0x7f28b413dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f28b41607b0 con 0x7f28b413b1a0 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f28b4160630 con 0x7f28b413ed60 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28bb000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f28b4168b60 con 0x7f28b413b620 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28ab400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413b1a0 0x7f28b413d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28ab400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413b1a0 0x7f28b413d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46122/0 (socket says 172.21.15.106:46122) 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.339+0000 7f28ab400640 1 -- 172.21.15.106:0/2754335828 learned_addr learned my addr 172.21.15.106:0/2754335828 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28b3e00640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28b413ed60 0x7f28b4165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28b9000640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28b413b620 0x7f28b413dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28ab400640 1 -- 172.21.15.106:0/2754335828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28b413b620 msgr2=0x7f28b413dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28ab400640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28b413b620 0x7f28b413dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28ab400640 1 -- 172.21.15.106:0/2754335828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28b413ed60 msgr2=0x7f28b4165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28ab400640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28b413ed60 0x7f28b4165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28ab400640 1 -- 172.21.15.106:0/2754335828 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b413bbf0 con 0x7f28b413b1a0 2024-04-26T21:16:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28ab400640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413b1a0 0x7f28b413d7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c3a0 tx=0x7f289c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28b0c00640 1 -- 172.21.15.106:0/2754335828 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c017070 con 0x7f28b413b1a0 2024-04-26T21:16:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28b0c00640 1 -- 172.21.15.106:0/2754335828 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c005cf0 con 0x7f28b413b1a0 2024-04-26T21:16:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b413bed0 con 0x7f28b413b1a0 2024-04-26T21:16:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28b0c00640 1 -- 172.21.15.106:0/2754335828 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c0072f0 con 0x7f28b413b1a0 2024-04-26T21:16:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b40b13e0 con 0x7f28b413b1a0 2024-04-26T21:16:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b4069400 con 0x7f28b413b1a0 2024-04-26T21:16:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.343+0000 7f28b0c00640 1 -- 172.21.15.106:0/2754335828 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f289c01a070 con 0x7f28b413b1a0 2024-04-26T21:16:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.347+0000 7f28b0c00640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f28900683b0 0x7f289006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.347+0000 7f28b0c00640 1 -- 172.21.15.106:0/2754335828 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f289c085fe0 con 0x7f28b413b1a0 2024-04-26T21:16:36.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.347+0000 7f28b3e00640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f28900683b0 0x7f289006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.347+0000 7f28b3e00640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f28900683b0 0x7f289006a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28a40ad000 tx=0x7f28a40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:36.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.351+0000 7f28b0c00640 1 -- 172.21.15.106:0/2754335828 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f289c0562b0 con 0x7f28b413b1a0 2024-04-26T21:16:36.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.515+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28b40b0840 con 0x7f28b413b1a0 2024-04-26T21:16:36.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.515+0000 7f28b0c00640 1 -- 172.21.15.106:0/2754335828 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7f289c055bb0 con 0x7f28b413b1a0 2024-04-26T21:16:36.519 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:36.519 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f28900683b0 msgr2=0x7f289006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f28900683b0 0x7f289006a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28a40ad000 tx=0x7f28a40a6000 comp rx=0 tx=0).stop 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413b1a0 msgr2=0x7f28b413d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413b1a0 0x7f28b413d7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c3a0 tx=0x7f289c00c860 comp rx=0 tx=0).stop 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 shutdown_connections 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f28900683b0 0x7f289006a870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f28b413b620 0x7f28b413dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b413b1a0 0x7f28b413d7e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 --2- 172.21.15.106:0/2754335828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28b413ed60 0x7f28b4165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 >> 172.21.15.106:0/2754335828 conn(0x7f28b4068340 msgr2=0x7f28b4071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:36.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 shutdown_connections 2024-04-26T21:16:36.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.519+0000 7f28bb000640 1 -- 172.21.15.106:0/2754335828 wait complete. 2024-04-26T21:16:36.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T21:16:36.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aaac00640 1 Processor -- start 2024-04-26T21:16:36.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aaac00640 1 -- start start 2024-04-26T21:16:36.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aaac00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1aa415c4e0 0x7f1aa415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aaac00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415d080 0x7f1aa40b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aaac00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa415ce00 con 0x7f1aa415fa20 2024-04-26T21:16:36.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aaac00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa415d5f0 con 0x7f1aa415c4e0 2024-04-26T21:16:36.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aaac00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa40b4f00 con 0x7f1aa415d080 2024-04-26T21:16:36.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aa8c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1aa415fa20 0x7f1aa415feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34124/0 (socket says 172.21.15.106:34124) 2024-04-26T21:16:36.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aa8c00640 1 -- 172.21.15.106:0/271641529 learned_addr learned my addr 172.21.15.106:0/271641529 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:36.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aa3e00640 1 --2- 172.21.15.106:0/271641529 >> v2:172.21.15.112:3300/0 conn(0x7f1aa415c4e0 0x7f1aa415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1a9b400640 1 --2- 172.21.15.106:0/271641529 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415d080 0x7f1aa40b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aa3400640 1 -- 172.21.15.106:0/271641529 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513001711 0 0) 0x7f1aa415ce00 con 0x7f1aa415fa20 2024-04-26T21:16:36.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aa3400640 1 -- 172.21.15.106:0/271641529 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a88003530 con 0x7f1aa415fa20 2024-04-26T21:16:36.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aa3e00640 1 -- 172.21.15.106:0/271641529 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415d080 msgr2=0x7f1aa40b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:36.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aa3e00640 1 --2- 172.21.15.106:0/271641529 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415d080 0x7f1aa40b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aa3e00640 1 -- 172.21.15.106:0/271641529 >> v1:172.21.15.106:6789/0 conn(0x7f1aa415fa20 legacy=0x7f1aa415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1aa3e00640 1 -- 172.21.15.106:0/271641529 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa40b51e0 con 0x7f1aa415c4e0 2024-04-26T21:16:36.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.675+0000 7f1a9b400640 1 --2- 172.21.15.106:0/271641529 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415d080 0x7f1aa40b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:36.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aa3e00640 1 --2- 172.21.15.106:0/271641529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415c4e0 0x7f1aa415c8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a940097c0 tx=0x7f1a9401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e8a2b0e47faa7bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:36.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aa3400640 1 -- 172.21.15.106:0/271641529 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940a7070 con 0x7f1aa415c4e0 2024-04-26T21:16:36.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aa3400640 1 -- 172.21.15.106:0/271641529 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a940b0070 con 0x7f1aa415c4e0 2024-04-26T21:16:36.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aa3400640 1 -- 172.21.15.106:0/271641529 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940ab890 con 0x7f1aa415c4e0 2024-04-26T21:16:36.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aaac00640 1 -- 172.21.15.106:0/271641529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415c4e0 msgr2=0x7f1aa415c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aaac00640 1 --2- 172.21.15.106:0/271641529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415c4e0 0x7f1aa415c8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a940097c0 tx=0x7f1a9401c470 comp rx=0 tx=0).stop 2024-04-26T21:16:36.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aaac00640 1 -- 172.21.15.106:0/271641529 shutdown_connections 2024-04-26T21:16:36.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aaac00640 1 --2- 172.21.15.106:0/271641529 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415d080 0x7f1aa40b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aaac00640 1 --2- 172.21.15.106:0/271641529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415c4e0 0x7f1aa415c8c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aaac00640 1 -- 172.21.15.106:0/271641529 >> 172.21.15.106:0/271641529 conn(0x7f1aa40b2910 msgr2=0x7f1aa40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:36.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aaac00640 1 -- 172.21.15.106:0/271641529 shutdown_connections 2024-04-26T21:16:36.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.679+0000 7f1aaac00640 1 -- 172.21.15.106:0/271641529 wait complete. 2024-04-26T21:16:36.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 Processor -- start 2024-04-26T21:16:36.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 -- start start 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415c4e0 0x7f1aa41586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415d080 0x7f1aa40d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1aa415fa20 0x7f1aa413bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa40b4ce0 con 0x7f1aa415fa20 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa40b4b60 con 0x7f1aa415d080 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa41675c0 con 0x7f1aa415c4e0 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1aa415fa20 0x7f1aa413bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1aa415fa20 0x7f1aa413bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:46130/0 (socket says 172.21.15.106:46130) 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa8c00640 1 -- 172.21.15.106:0/3142030471 learned_addr learned my addr 172.21.15.106:0/3142030471 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa3e00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415c4e0 0x7f1aa41586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1a9b400640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415d080 0x7f1aa40d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa8c00640 1 -- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415c4e0 msgr2=0x7f1aa41586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa8c00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415c4e0 0x7f1aa41586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa8c00640 1 -- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415d080 msgr2=0x7f1aa40d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa8c00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415d080 0x7f1aa40d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa8c00640 1 -- 172.21.15.106:0/3142030471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa40d1090 con 0x7f1aa415fa20 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa3e00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415c4e0 0x7f1aa41586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1a9b400640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415d080 0x7f1aa40d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa8c00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1aa415fa20 0x7f1aa413bff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00ca20 tx=0x7f1a9c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa0c00640 1 -- 172.21.15.106:0/3142030471 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c017070 con 0x7f1aa415fa20 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa0c00640 1 -- 172.21.15.106:0/3142030471 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a9c00abd0 con 0x7f1aa415fa20 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa41f6850 con 0x7f1aa415fa20 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aa0c00640 1 -- 172.21.15.106:0/3142030471 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c012400 con 0x7f1aa415fa20 2024-04-26T21:16:36.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.683+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa41f6550 con 0x7f1aa415fa20 2024-04-26T21:16:36.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.687+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa4069400 con 0x7f1aa415fa20 2024-04-26T21:16:36.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.687+0000 7f1aa0c00640 1 -- 172.21.15.106:0/3142030471 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a9c01a070 con 0x7f1aa415fa20 2024-04-26T21:16:36.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.687+0000 7f1aa0c00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1a800683b0 0x7f1a8006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:36.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.687+0000 7f1aa0c00640 1 -- 172.21.15.106:0/3142030471 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1a9c0869e0 con 0x7f1aa415fa20 2024-04-26T21:16:36.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.687+0000 7f1aa3e00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1a800683b0 0x7f1a8006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:36.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.687+0000 7f1aa3e00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1a800683b0 0x7f1a8006a870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a940af000 tx=0x7f1a94008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:36.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.691+0000 7f1aa0c00640 1 -- 172.21.15.106:0/3142030471 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1a9c056c50 con 0x7f1aa415fa20 2024-04-26T21:16:36.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:36.879+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1aa40b43a0 con 0x7f1aa415fa20 2024-04-26T21:16:37.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aa0c00640 1 -- 172.21.15.106:0/3142030471 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f1a9c056550 con 0x7f1aa415fa20 2024-04-26T21:16:37.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1a800683b0 msgr2=0x7f1a8006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:37.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1a800683b0 0x7f1a8006a870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a940af000 tx=0x7f1a94008040 comp rx=0 tx=0).stop 2024-04-26T21:16:37.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1aa415fa20 msgr2=0x7f1aa413bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:37.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1aa415fa20 0x7f1aa413bff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00ca20 tx=0x7f1a9c00cee0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 shutdown_connections 2024-04-26T21:16:37.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aa415d080 0x7f1aa40d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1a800683b0 0x7f1a8006a870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1aa415fa20 0x7f1aa413bff0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 --2- 172.21.15.106:0/3142030471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1aa415c4e0 0x7f1aa41586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 >> 172.21.15.106:0/3142030471 conn(0x7f1aa40b2910 msgr2=0x7f1aa40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:37.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 shutdown_connections 2024-04-26T21:16:37.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.483+0000 7f1aaac00640 1 -- 172.21.15.106:0/3142030471 wait complete. 2024-04-26T21:16:37.509 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-26T21:16:37.509 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T21:16:37.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.643+0000 7f4fe8600640 1 Processor -- start 2024-04-26T21:16:37.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.643+0000 7f4fe8600640 1 -- start start 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe8600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4fe0162bf0 0x7f4fe006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe8600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4fe00d1e50 0x7f4fe0162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe8600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 0x7f4fe015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe8600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4fe006eaf0 con 0x7f4fe00d1e50 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe8600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4fe006dc60 con 0x7f4fe0162bf0 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe8600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe0163510 con 0x7f4fe015e8c0 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe5200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4fe00d1e50 0x7f4fe0162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe5200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4fe00d1e50 0x7f4fe0162fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40764/0 (socket says 172.21.15.106:40764) 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe5200640 1 -- 172.21.15.106:0/3624425361 learned_addr learned my addr 172.21.15.106:0/3624425361 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:37.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe5c00640 1 --2- 172.21.15.106:0/3624425361 >> v2:172.21.15.112:3300/0 conn(0x7f4fe0162bf0 0x7f4fe006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe6600640 1 --2- 172.21.15.106:0/3624425361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 0x7f4fe015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe5200640 1 -- 172.21.15.106:0/3624425361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 msgr2=0x7f4fe015ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe5200640 1 --2- 172.21.15.106:0/3624425361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 0x7f4fe015ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe5200640 1 -- 172.21.15.106:0/3624425361 >> v2:172.21.15.112:3300/0 conn(0x7f4fe0162bf0 msgr2=0x7f4fe006d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe5200640 1 --2- 172.21.15.106:0/3624425361 >> v2:172.21.15.112:3300/0 conn(0x7f4fe0162bf0 0x7f4fe006d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe5200640 1 -- 172.21.15.106:0/3624425361 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe006dee0 con 0x7f4fe00d1e50 2024-04-26T21:16:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.647+0000 7f4fe6600640 1 --2- 172.21.15.106:0/3624425361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 0x7f4fe015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:37.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe5200640 1 --2- 172.21.15.106:0/3624425361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe00d1e50 0x7f4fe0162fd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0073310 tx=0x7f4fd401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b702a8b3431b674d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:37.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fdfe00640 1 -- 172.21.15.106:0/3624425361 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd40aa610 con 0x7f4fe00d1e50 2024-04-26T21:16:37.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fdfe00640 1 -- 172.21.15.106:0/3624425361 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd40af070 con 0x7f4fe00d1e50 2024-04-26T21:16:37.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fdfe00640 1 -- 172.21.15.106:0/3624425361 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd40aa9d0 con 0x7f4fe00d1e50 2024-04-26T21:16:37.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 -- 172.21.15.106:0/3624425361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe00d1e50 msgr2=0x7f4fe0162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:37.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 --2- 172.21.15.106:0/3624425361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe00d1e50 0x7f4fe0162fd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0073310 tx=0x7f4fd401c4f0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 -- 172.21.15.106:0/3624425361 shutdown_connections 2024-04-26T21:16:37.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 --2- 172.21.15.106:0/3624425361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 0x7f4fe015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 --2- 172.21.15.106:0/3624425361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe00d1e50 0x7f4fe0162fd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 --2- 172.21.15.106:0/3624425361 >> v2:172.21.15.112:3300/0 conn(0x7f4fe0162bf0 0x7f4fe006d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 -- 172.21.15.106:0/3624425361 >> 172.21.15.106:0/3624425361 conn(0x7f4fe00d2c50 msgr2=0x7f4fe00d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:37.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 -- 172.21.15.106:0/3624425361 shutdown_connections 2024-04-26T21:16:37.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 -- 172.21.15.106:0/3624425361 wait complete. 2024-04-26T21:16:37.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 Processor -- start 2024-04-26T21:16:37.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 -- start start 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fe00d1e50 0x7f4fe00af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 0x7f4fe00b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe0162bf0 0x7f4fe00ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00cfce0 con 0x7f4fe0162bf0 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00d22c0 con 0x7f4fe00d1e50 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.651+0000 7f4fe8600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe00cfe60 con 0x7f4fe015e8c0 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe6600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe0162bf0 0x7f4fe00ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe6600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe0162bf0 0x7f4fe00ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40770/0 (socket says 172.21.15.106:40770) 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe6600640 1 -- 172.21.15.106:0/1246763427 learned_addr learned my addr 172.21.15.106:0/1246763427 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe5200640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 0x7f4fe00b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe5c00640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fe00d1e50 0x7f4fe00af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe6600640 1 -- 172.21.15.106:0/1246763427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 msgr2=0x7f4fe00b7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe6600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 0x7f4fe00b7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe6600640 1 -- 172.21.15.106:0/1246763427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fe00d1e50 msgr2=0x7f4fe00af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe6600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fe00d1e50 0x7f4fe00af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe6600640 1 -- 172.21.15.106:0/1246763427 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe0071b60 con 0x7f4fe0162bf0 2024-04-26T21:16:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe6600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe0162bf0 0x7f4fe00ce240 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800cef0 tx=0x7f4fd800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fdd600640 1 -- 172.21.15.106:0/1246763427 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd801a070 con 0x7f4fe0162bf0 2024-04-26T21:16:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fdd600640 1 -- 172.21.15.106:0/1246763427 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd800d840 con 0x7f4fe0162bf0 2024-04-26T21:16:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe0157f80 con 0x7f4fe0162bf0 2024-04-26T21:16:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fdd600640 1 -- 172.21.15.106:0/1246763427 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800dc30 con 0x7f4fe0162bf0 2024-04-26T21:16:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe00cd480 con 0x7f4fe0162bf0 2024-04-26T21:16:37.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe0069400 con 0x7f4fe0162bf0 2024-04-26T21:16:37.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fdd600640 1 -- 172.21.15.106:0/1246763427 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4fd801d070 con 0x7f4fe0162bf0 2024-04-26T21:16:37.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.655+0000 7f4fdd600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fc4068380 0x7f4fc406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:37.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.659+0000 7f4fdd600640 1 -- 172.21.15.106:0/1246763427 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4fd8087530 con 0x7f4fe0162bf0 2024-04-26T21:16:37.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.659+0000 7f4fe5c00640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fc4068380 0x7f4fc406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:37.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.659+0000 7f4fe5c00640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fc4068380 0x7f4fc406a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00b13b0 tx=0x7f4fd0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.663+0000 7f4fdd600640 1 -- 172.21.15.106:0/1246763427 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4fd80570c0 con 0x7f4fe0162bf0 2024-04-26T21:16:37.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:37.851+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4fe00afda0 con 0x7f4fe0162bf0 2024-04-26T21:16:38.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.487+0000 7f4fdd600640 1 -- 172.21.15.106:0/1246763427 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f4fd805b3c0 con 0x7f4fe0162bf0 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fc4068380 msgr2=0x7f4fc406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fc4068380 0x7f4fc406a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00b13b0 tx=0x7f4fd0008040 comp rx=0 tx=0).stop 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe0162bf0 msgr2=0x7f4fe00ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe0162bf0 0x7f4fe00ce240 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800cef0 tx=0x7f4fd800a710 comp rx=0 tx=0).stop 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 shutdown_connections 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4fc4068380 0x7f4fc406a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fe0162bf0 0x7f4fe00ce240 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4fe015e8c0 0x7f4fe00b7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 --2- 172.21.15.106:0/1246763427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4fe00d1e50 0x7f4fe00af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 >> 172.21.15.106:0/1246763427 conn(0x7f4fe00d2c50 msgr2=0x7f4fe00d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:38.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 shutdown_connections 2024-04-26T21:16:38.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.491+0000 7f4fe8600640 1 -- 172.21.15.106:0/1246763427 wait complete. 2024-04-26T21:16:38.515 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T21:16:38.515 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:16:38.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.647+0000 7f89d1800640 1 Processor -- start 2024-04-26T21:16:38.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.647+0000 7f89d1800640 1 -- start start 2024-04-26T21:16:38.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.647+0000 7f89d1800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89cc13ed60 0x7f89cc15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:38.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.647+0000 7f89d1800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f89cc13f140 0x7f89cc0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:38.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.647+0000 7f89d1800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc0b3d10 con 0x7f89cc06eb70 2024-04-26T21:16:38.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.647+0000 7f89d1800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f89cc0b3ac0 con 0x7f89cc13ed60 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.647+0000 7f89d1800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f89cc0b4920 con 0x7f89cc13f140 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89caa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89cc13ed60 0x7f89cc15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89caa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89cc13ed60 0x7f89cc15c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40782/0 (socket says 172.21.15.106:40782) 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89cb400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f89cc06eb70 0x7f89cc0d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34800/0 (socket says 172.21.15.106:34800) 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89caa00640 1 -- 172.21.15.106:0/531380635 learned_addr learned my addr 172.21.15.106:0/531380635 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89ca000640 1 --2- 172.21.15.106:0/531380635 >> v2:172.21.15.112:3300/0 conn(0x7f89cc13f140 0x7f89cc0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89caa00640 1 -- 172.21.15.106:0/531380635 >> v2:172.21.15.112:3300/0 conn(0x7f89cc13f140 msgr2=0x7f89cc0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89caa00640 1 --2- 172.21.15.106:0/531380635 >> v2:172.21.15.112:3300/0 conn(0x7f89cc13f140 0x7f89cc0b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89caa00640 1 -- 172.21.15.106:0/531380635 >> v1:172.21.15.106:6789/0 conn(0x7f89cc06eb70 legacy=0x7f89cc0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89caa00640 1 -- 172.21.15.106:0/531380635 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc0b3ff0 con 0x7f89cc13ed60 2024-04-26T21:16:38.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89ca000640 1 --2- 172.21.15.106:0/531380635 >> v2:172.21.15.112:3300/0 conn(0x7f89cc13f140 0x7f89cc0b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:38.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89caa00640 1 --2- 172.21.15.106:0/531380635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 0x7f89cc15c3e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89cc15f930 tx=0x7f89bc01ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fd6304a2ecf964 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:38.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89c9600640 1 -- 172.21.15.106:0/531380635 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0b4070 con 0x7f89cc13ed60 2024-04-26T21:16:38.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89c9600640 1 -- 172.21.15.106:0/531380635 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc0a7ba0 con 0x7f89cc13ed60 2024-04-26T21:16:38.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.651+0000 7f89c9600640 1 -- 172.21.15.106:0/531380635 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0af440 con 0x7f89cc13ed60 2024-04-26T21:16:38.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 -- 172.21.15.106:0/531380635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 msgr2=0x7f89cc15c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:38.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 --2- 172.21.15.106:0/531380635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 0x7f89cc15c3e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89cc15f930 tx=0x7f89bc01ead0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 -- 172.21.15.106:0/531380635 shutdown_connections 2024-04-26T21:16:38.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 --2- 172.21.15.106:0/531380635 >> v2:172.21.15.112:3300/0 conn(0x7f89cc13f140 0x7f89cc0b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 --2- 172.21.15.106:0/531380635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 0x7f89cc15c3e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 -- 172.21.15.106:0/531380635 >> 172.21.15.106:0/531380635 conn(0x7f89cc068340 msgr2=0x7f89cc068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:38.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 -- 172.21.15.106:0/531380635 shutdown_connections 2024-04-26T21:16:38.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 -- 172.21.15.106:0/531380635 wait complete. 2024-04-26T21:16:38.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 Processor -- start 2024-04-26T21:16:38.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 -- start start 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 0x7f89cc0aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89cc13d180 0x7f89cc15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89cc0b2e70 0x7f89cc13c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc0d1680 con 0x7f89cc13ed60 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc0d1500 con 0x7f89cc13d180 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89d1800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc160420 con 0x7f89cc0b2e70 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89caa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 0x7f89cc0aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89caa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 0x7f89cc0aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40794/0 (socket says 172.21.15.106:40794) 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89caa00640 1 -- 172.21.15.106:0/3019717866 learned_addr learned my addr 172.21.15.106:0/3019717866 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89ca000640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89cc13d180 0x7f89cc15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89cb400640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89cc0b2e70 0x7f89cc13c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89caa00640 1 -- 172.21.15.106:0/3019717866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89cc0b2e70 msgr2=0x7f89cc13c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:38.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89caa00640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89cc0b2e70 0x7f89cc13c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89caa00640 1 -- 172.21.15.106:0/3019717866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89cc13d180 msgr2=0x7f89cc15eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89caa00640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89cc13d180 0x7f89cc15eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89caa00640 1 -- 172.21.15.106:0/3019717866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc0b20f0 con 0x7f89cc13ed60 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89cb400640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89cc0b2e70 0x7f89cc13c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.655+0000 7f89caa00640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 0x7f89cc0aad20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00b2c0 tx=0x7f89bc01d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89c2a00640 1 -- 172.21.15.106:0/3019717866 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0bf070 con 0x7f89cc13ed60 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89c2a00640 1 -- 172.21.15.106:0/3019717866 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc0ba440 con 0x7f89cc13ed60 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89c2a00640 1 -- 172.21.15.106:0/3019717866 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0b4070 con 0x7f89cc13ed60 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc0b2390 con 0x7f89cc13ed60 2024-04-26T21:16:38.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc0b2950 con 0x7f89cc13ed60 2024-04-26T21:16:38.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc069400 con 0x7f89cc13ed60 2024-04-26T21:16:38.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89c2a00640 1 -- 172.21.15.106:0/3019717866 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f89bc0b93e0 con 0x7f89cc13ed60 2024-04-26T21:16:38.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89c2a00640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f89ac0683b0 0x7f89ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:38.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89c2a00640 1 -- 172.21.15.106:0/3019717866 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f89bc121460 con 0x7f89cc13ed60 2024-04-26T21:16:38.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89ca000640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f89ac0683b0 0x7f89ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:38.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.659+0000 7f89ca000640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f89ac0683b0 0x7f89ac06a870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0aa570 tx=0x7f89b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.663+0000 7f89c2a00640 1 -- 172.21.15.106:0/3019717866 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f89bc0187e0 con 0x7f89cc13ed60 2024-04-26T21:16:38.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.851+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89cc165160 con 0x7f89cc13ed60 2024-04-26T21:16:38.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.851+0000 7f89c2a00640 1 -- 172.21.15.106:0/3019717866 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f89bc0f1760 con 0x7f89cc13ed60 2024-04-26T21:16:38.856 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:38.856 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:37.854892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:16:38.856 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 9 2024-04-26T21:16:38.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f89ac0683b0 msgr2=0x7f89ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:38.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f89ac0683b0 0x7f89ac06a870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0aa570 tx=0x7f89b8008040 comp rx=0 tx=0).stop 2024-04-26T21:16:38.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 msgr2=0x7f89cc0aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:38.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 0x7f89cc0aad20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00b2c0 tx=0x7f89bc01d310 comp rx=0 tx=0).stop 2024-04-26T21:16:38.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 shutdown_connections 2024-04-26T21:16:38.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89cc13d180 0x7f89cc15eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f89ac0683b0 0x7f89ac06a870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f89cc0b2e70 0x7f89cc13c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 --2- 172.21.15.106:0/3019717866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89cc13ed60 0x7f89cc0aad20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:38.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 >> 172.21.15.106:0/3019717866 conn(0x7f89cc068340 msgr2=0x7f89cc0ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:38.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 shutdown_connections 2024-04-26T21:16:38.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:38.855+0000 7f89d1800640 1 -- 172.21.15.106:0/3019717866 wait complete. 2024-04-26T21:16:38.877 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:39.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02fde00640 1 Processor -- start 2024-04-26T21:16:39.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02fde00640 1 -- start start 2024-04-26T21:16:39.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02fde00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02f80b39f0 0x7f02f8169c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02fde00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f80b55e0 con 0x7f02f81624a0 2024-04-26T21:16:39.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02fde00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f80b58c0 con 0x7f02f80aeae0 2024-04-26T21:16:39.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02fde00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f02f80b5ba0 con 0x7f02f80b39f0 2024-04-26T21:16:39.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02f6a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f02f81624a0 0x7f02f80b4d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34806/0 (socket says 172.21.15.106:34806) 2024-04-26T21:16:39.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02f6a00640 1 -- 172.21.15.106:0/2261188965 learned_addr learned my addr 172.21.15.106:0/2261188965 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:39.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02f7400640 1 --2- 172.21.15.106:0/2261188965 >> v2:172.21.15.112:3300/0 conn(0x7f02f80b39f0 0x7f02f8169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354767309 0 0) 0x7f02f80b55e0 con 0x7f02f81624a0 2024-04-26T21:16:39.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.007+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02dc003530 con 0x7f02f81624a0 2024-04-26T21:16:39.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3935630361 0 0) 0x7f02dc003530 con 0x7f02f81624a0 2024-04-26T21:16:39.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 >> v2:172.21.15.112:3300/0 conn(0x7f02f80b39f0 msgr2=0x7f02f8169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:39.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 --2- 172.21.15.106:0/2261188965 >> v2:172.21.15.112:3300/0 conn(0x7f02f80b39f0 0x7f02f8169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 >> v1:172.21.15.112:6789/0 conn(0x7f02f80aeae0 legacy=0x7f02f80b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f806e810 con 0x7f02f81624a0 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f02e8001a00 con 0x7f02f81624a0 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 >> v1:172.21.15.106:6789/0 conn(0x7f02f81624a0 legacy=0x7f02f80b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02dc0039c0 0x7f02dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02dc0051d0 0x7f02dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f02f80b5ba0 con 0x7f02dc004810 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc00c070 con 0x7f02dc0039c0 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f02dc00c270 con 0x7f02dc0051d0 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f6000640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f6a00640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02dc0039c0 0x7f02dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f7400640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02dc0051d0 0x7f02dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f6000640 1 -- 172.21.15.106:0/2261188965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02dc0051d0 msgr2=0x7f02dc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:39.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f6000640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02dc0051d0 0x7f02dc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f6000640 1 -- 172.21.15.106:0/2261188965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02dc0039c0 msgr2=0x7f02dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:39.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f6000640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02dc0039c0 0x7f02dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f6000640 1 -- 172.21.15.106:0/2261188965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc003530 con 0x7f02dc004810 2024-04-26T21:16:39.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f7400640 1 -- 172.21.15.106:0/2261188965 reap_dead start 2024-04-26T21:16:39.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f6000640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02dc004c90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02e4001780 tx=0x7f02e401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbafdfaa807fd6d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:39.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e40013a0 con 0x7f02dc004810 2024-04-26T21:16:39.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e40052f0 con 0x7f02dc004810 2024-04-26T21:16:39.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.011+0000 7f02f5600640 1 -- 172.21.15.106:0/2261188965 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4003840 con 0x7f02dc004810 2024-04-26T21:16:39.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 -- 172.21.15.106:0/2261188965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 msgr2=0x7f02dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02dc004c90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02e4001780 tx=0x7f02e401c400 comp rx=0 tx=0).stop 2024-04-26T21:16:39.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 -- 172.21.15.106:0/2261188965 shutdown_connections 2024-04-26T21:16:39.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 --2- 172.21.15.106:0/2261188965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02dc004c90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 -- 172.21.15.106:0/2261188965 >> 172.21.15.106:0/2261188965 conn(0x7f02f806c5d0 msgr2=0x7f02f806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:39.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 -- 172.21.15.106:0/2261188965 shutdown_connections 2024-04-26T21:16:39.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 -- 172.21.15.106:0/2261188965 wait complete. 2024-04-26T21:16:39.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 Processor -- start 2024-04-26T21:16:39.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 -- start start 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02f8151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02f815c8b0 0x7f02f815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02f8153140 0x7f02f81535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f02f80b32e0 con 0x7f02dc004810 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8162880 con 0x7f02f8153140 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02fde00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f02f80b3460 con 0x7f02f815c8b0 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02f6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02f8151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02f6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02f8151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40808/0 (socket says 172.21.15.106:40808) 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02f6a00640 1 -- 172.21.15.106:0/621680605 learned_addr learned my addr 172.21.15.106:0/621680605 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02f6a00640 1 -- 172.21.15.106:0/621680605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02f815c8b0 msgr2=0x7f02f815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02f6a00640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02f815c8b0 0x7f02f815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02f6a00640 1 -- 172.21.15.106:0/621680605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02f8153140 msgr2=0x7f02f81535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02f6a00640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02f8153140 0x7f02f81535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.015+0000 7f02f6a00640 1 -- 172.21.15.106:0/621680605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f815d350 con 0x7f02dc004810 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.019+0000 7f02f6a00640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02f8151800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f02e80076f0 tx=0x7f02e8007bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.019+0000 7f02ef400640 1 -- 172.21.15.106:0/621680605 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e801c070 con 0x7f02dc004810 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.019+0000 7f02ef400640 1 -- 172.21.15.106:0/621680605 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e8011950 con 0x7f02dc004810 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.019+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f815d630 con 0x7f02dc004810 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.019+0000 7f02ef400640 1 -- 172.21.15.106:0/621680605 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8010040 con 0x7f02dc004810 2024-04-26T21:16:39.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.019+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f815dbf0 con 0x7f02dc004810 2024-04-26T21:16:39.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.019+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f8069400 con 0x7f02dc004810 2024-04-26T21:16:39.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.019+0000 7f02ef400640 1 -- 172.21.15.106:0/621680605 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f02e801f070 con 0x7f02dc004810 2024-04-26T21:16:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.023+0000 7f02ef400640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f02d80683b0 0x7f02d806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.023+0000 7f02ef400640 1 -- 172.21.15.106:0/621680605 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f02e8089c10 con 0x7f02dc004810 2024-04-26T21:16:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.023+0000 7f02f6000640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f02d80683b0 0x7f02d806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.023+0000 7f02f6000640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f02d80683b0 0x7f02d806a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02e4004000 tx=0x7f02e4001130 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:39.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.027+0000 7f02ef400640 1 -- 172.21.15.106:0/621680605 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f02e8059e90 con 0x7f02dc004810 2024-04-26T21:16:39.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.183+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02f80d20d0 con 0x7f02dc004810 2024-04-26T21:16:39.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.183+0000 7f02ef400640 1 -- 172.21.15.106:0/621680605 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7f02e8059790 con 0x7f02dc004810 2024-04-26T21:16:39.187 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:39.187 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.183+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f02d80683b0 msgr2=0x7f02d806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.183+0000 7f02fde00640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f02d80683b0 0x7f02d806a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02e4004000 tx=0x7f02e4001130 comp rx=0 tx=0).stop 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.183+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 msgr2=0x7f02f8151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.183+0000 7f02fde00640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02f8151800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f02e80076f0 tx=0x7f02e8007bb0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.187+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 shutdown_connections 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.187+0000 7f02fde00640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02f8153140 0x7f02f81535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.187+0000 7f02fde00640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f02d80683b0 0x7f02d806a870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.187+0000 7f02fde00640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f02f815c8b0 0x7f02f815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.187+0000 7f02fde00640 1 --2- 172.21.15.106:0/621680605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02dc004810 0x7f02f8151800 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.187+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 >> 172.21.15.106:0/621680605 conn(0x7f02f806c5d0 msgr2=0x7f02f80d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.187+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 shutdown_connections 2024-04-26T21:16:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.187+0000 7f02fde00640 1 -- 172.21.15.106:0/621680605 wait complete. 2024-04-26T21:16:39.208 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T21:16:39.209 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:16:39.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.339+0000 7fc799200640 1 Processor -- start 2024-04-26T21:16:39.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.339+0000 7fc799200640 1 -- start start 2024-04-26T21:16:39.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc799200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc794148a90 0x7fc7940724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc799200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc794072b00 con 0x7fc794070120 2024-04-26T21:16:39.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc799200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc794072de0 con 0x7fc7940af640 2024-04-26T21:16:39.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc799200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc7940af1b0 con 0x7fc794148a90 2024-04-26T21:16:39.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc791e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc794148a90 0x7fc7940724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc791e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc794148a90 0x7fc7940724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40818/0 (socket says 172.21.15.106:40818) 2024-04-26T21:16:39.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc791400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc794070120 0x7fc7940b3ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34808/0 (socket says 172.21.15.106:34808) 2024-04-26T21:16:39.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc791e00640 1 -- 172.21.15.106:0/2931503475 learned_addr learned my addr 172.21.15.106:0/2931503475 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:39.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc791e00640 1 -- 172.21.15.106:0/2931503475 >> v1:172.21.15.112:6789/0 conn(0x7fc7940af640 legacy=0x7fc7940d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc791e00640 1 -- 172.21.15.106:0/2931503475 >> v1:172.21.15.106:6789/0 conn(0x7fc794070120 legacy=0x7fc7940b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc790a00640 1 -- 172.21.15.106:0/2931503475 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521086814 0 0) 0x7fc794072b00 con 0x7fc794070120 2024-04-26T21:16:39.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.343+0000 7fc791e00640 1 -- 172.21.15.106:0/2931503475 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7940aee40 con 0x7fc794148a90 2024-04-26T21:16:39.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc791e00640 1 --2- 172.21.15.106:0/2931503475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794148a90 0x7fc7940724d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7940af330 tx=0x7fc77c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be674baee5993e15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:39.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc790a00640 1 -- 172.21.15.106:0/2931503475 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0b1070 con 0x7fc794148a90 2024-04-26T21:16:39.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc790a00640 1 -- 172.21.15.106:0/2931503475 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77c0ac620 con 0x7fc794148a90 2024-04-26T21:16:39.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc790a00640 1 -- 172.21.15.106:0/2931503475 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0ac9f0 con 0x7fc794148a90 2024-04-26T21:16:39.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc799200640 1 -- 172.21.15.106:0/2931503475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794148a90 msgr2=0x7fc7940724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc799200640 1 --2- 172.21.15.106:0/2931503475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794148a90 0x7fc7940724d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7940af330 tx=0x7fc77c01c4b0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc799200640 1 -- 172.21.15.106:0/2931503475 shutdown_connections 2024-04-26T21:16:39.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc799200640 1 --2- 172.21.15.106:0/2931503475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794148a90 0x7fc7940724d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc799200640 1 -- 172.21.15.106:0/2931503475 >> 172.21.15.106:0/2931503475 conn(0x7fc79406e440 msgr2=0x7fc79406e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:39.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc799200640 1 -- 172.21.15.106:0/2931503475 shutdown_connections 2024-04-26T21:16:39.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc799200640 1 -- 172.21.15.106:0/2931503475 wait complete. 2024-04-26T21:16:39.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc799200640 1 Processor -- start 2024-04-26T21:16:39.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.347+0000 7fc799200640 1 -- start start 2024-04-26T21:16:39.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc799200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794070120 0x7fc79413fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc799200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7940af640 0x7fc794146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc799200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc794148a90 0x7fc794146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc799200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940d1630 con 0x7fc794070120 2024-04-26T21:16:39.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc799200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940d14b0 con 0x7fc794148a90 2024-04-26T21:16:39.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc799200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc7940afa50 con 0x7fc7940af640 2024-04-26T21:16:39.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794070120 0x7fc79413fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794070120 0x7fc79413fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40822/0 (socket says 172.21.15.106:40822) 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791e00640 1 -- 172.21.15.106:0/926802389 learned_addr learned my addr 172.21.15.106:0/926802389 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791400640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7940af640 0x7fc794146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc792800640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc794148a90 0x7fc794146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791e00640 1 -- 172.21.15.106:0/926802389 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7940af640 msgr2=0x7fc794146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791e00640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7940af640 0x7fc794146140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791e00640 1 -- 172.21.15.106:0/926802389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc794148a90 msgr2=0x7fc794146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791e00640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc794148a90 0x7fc794146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791e00640 1 -- 172.21.15.106:0/926802389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc794169bc0 con 0x7fc794070120 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc792800640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc794148a90 0x7fc794146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc791e00640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794070120 0x7fc79413fb20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0af040 tx=0x7fc77c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc78a000640 1 -- 172.21.15.106:0/926802389 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0bb020 con 0x7fc794070120 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc78a000640 1 -- 172.21.15.106:0/926802389 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77c0b7640 con 0x7fc794070120 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc78a000640 1 -- 172.21.15.106:0/926802389 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0b1040 con 0x7fc794070120 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc794146cb0 con 0x7fc794070120 2024-04-26T21:16:39.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc794147270 con 0x7fc794070120 2024-04-26T21:16:39.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc794069400 con 0x7fc794070120 2024-04-26T21:16:39.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.351+0000 7fc78a000640 1 -- 172.21.15.106:0/926802389 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc77c0be020 con 0x7fc794070120 2024-04-26T21:16:39.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.355+0000 7fc78a000640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc770068380 0x7fc77006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.355+0000 7fc78a000640 1 -- 172.21.15.106:0/926802389 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc77c120cd0 con 0x7fc794070120 2024-04-26T21:16:39.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.355+0000 7fc791400640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc770068380 0x7fc77006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.355+0000 7fc791400640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc770068380 0x7fc77006a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc79416a650 tx=0x7fc784007240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:39.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.359+0000 7fc78a000640 1 -- 172.21.15.106:0/926802389 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc77c0c5070 con 0x7fc794070120 2024-04-26T21:16:39.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.515+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7940734d0 con 0x7fc770068380 2024-04-26T21:16:39.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.523+0000 7fc78a000640 1 -- 172.21.15.106:0/926802389 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332562 (secure 0 0 0) 0x7fc7940734d0 con 0x7fc770068380 2024-04-26T21:16:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:39.532 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:16:39.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc770068380 msgr2=0x7fc77006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc770068380 0x7fc77006a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc79416a650 tx=0x7fc784007240 comp rx=0 tx=0).stop 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794070120 msgr2=0x7fc79413fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794070120 0x7fc79413fb20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0af040 tx=0x7fc77c01acf0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 shutdown_connections 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc794148a90 0x7fc794146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc770068380 0x7fc77006a840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc7940af640 0x7fc794146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 --2- 172.21.15.106:0/926802389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc794070120 0x7fc79413fb20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 >> 172.21.15.106:0/926802389 conn(0x7fc79406e440 msgr2=0x7fc79406f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 shutdown_connections 2024-04-26T21:16:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.527+0000 7fc799200640 1 -- 172.21.15.106:0/926802389 wait complete. 2024-04-26T21:16:39.551 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-26T21:16:38.293824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219604,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755116,"statfs":{"total":773094113280,"available":772869238784,"internally_reserved":0,"allocated":3514368,"data_stored":2074472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002888"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817484+0000","last_change":"2024-04-26T21:16:19.412305+0000","last_active":"2024-04-26T21:16:25.817484+0000","last_peered":"2024-04-26T21:16:25.817484+0000","last_clean":"2024-04-26T21:16:25.817484+0000","last_became_active":"2024-04-26T21:16:19.411559+0000","last_became_peered":"2024-04-26T21:16:19.411559+0000","last_unstale":"2024-04-26T21:16:25.817484+0000","last_undegraded":"2024-04-26T21:16:25.817484+0000","last_fullsized":"2024-04-26T21:16:25.817484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:31.811132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815514+0000","last_change":"2024-04-26T21:16:20.411882+0000","last_active":"2024-04-26T21:16:25.815514+0000","last_peered":"2024-04-26T21:16:25.815514+0000","last_clean":"2024-04-26T21:16:25.815514+0000","last_became_active":"2024-04-26T21:16:20.411587+0000","last_became_peered":"2024-04-26T21:16:20.411587+0000","last_unstale":"2024-04-26T21:16:25.815514+0000","last_undegraded":"2024-04-26T21:16:25.815514+0000","last_fullsized":"2024-04-26T21:16:25.815514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814423+0000","last_change":"2024-04-26T21:16:24.448323+0000","last_active":"2024-04-26T21:16:25.814423+0000","last_peered":"2024-04-26T21:16:25.814423+0000","last_clean":"2024-04-26T21:16:25.814423+0000","last_became_active":"2024-04-26T21:16:24.447718+0000","last_became_peered":"2024-04-26T21:16:24.447718+0000","last_unstale":"2024-04-26T21:16:25.814423+0000","last_undegraded":"2024-04-26T21:16:25.814423+0000","last_fullsized":"2024-04-26T21:16:25.814423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:58.709336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815628+0000","last_change":"2024-04-26T21:16:19.413460+0000","last_active":"2024-04-26T21:16:25.815628+0000","last_peered":"2024-04-26T21:16:25.815628+0000","last_clean":"2024-04-26T21:16:25.815628+0000","last_became_active":"2024-04-26T21:16:19.413146+0000","last_became_peered":"2024-04-26T21:16:19.413146+0000","last_unstale":"2024-04-26T21:16:25.815628+0000","last_undegraded":"2024-04-26T21:16:25.815628+0000","last_fullsized":"2024-04-26T21:16:25.815628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817398+0000","last_change":"2024-04-26T21:16:20.424236+0000","last_active":"2024-04-26T21:16:25.817398+0000","last_peered":"2024-04-26T21:16:25.817398+0000","last_clean":"2024-04-26T21:16:25.817398+0000","last_became_active":"2024-04-26T21:16:20.423996+0000","last_became_peered":"2024-04-26T21:16:20.423996+0000","last_unstale":"2024-04-26T21:16:25.817398+0000","last_undegraded":"2024-04-26T21:16:25.817398+0000","last_fullsized":"2024-04-26T21:16:25.817398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434335+0000","last_change":"2024-04-26T21:16:24.463491+0000","last_active":"2024-04-26T21:16:25.434335+0000","last_peered":"2024-04-26T21:16:25.434335+0000","last_clean":"2024-04-26T21:16:25.434335+0000","last_became_active":"2024-04-26T21:16:24.463053+0000","last_became_peered":"2024-04-26T21:16:24.463053+0000","last_unstale":"2024-04-26T21:16:25.434335+0000","last_undegraded":"2024-04-26T21:16:25.434335+0000","last_fullsized":"2024-04-26T21:16:25.434335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:29.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436569+0000","last_change":"2024-04-26T21:16:19.411595+0000","last_active":"2024-04-26T21:16:25.436569+0000","last_peered":"2024-04-26T21:16:25.436569+0000","last_clean":"2024-04-26T21:16:25.436569+0000","last_became_active":"2024-04-26T21:16:19.411220+0000","last_became_peered":"2024-04-26T21:16:19.411220+0000","last_unstale":"2024-04-26T21:16:25.436569+0000","last_undegraded":"2024-04-26T21:16:25.436569+0000","last_fullsized":"2024-04-26T21:16:25.436569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816434+0000","last_change":"2024-04-26T21:16:20.426594+0000","last_active":"2024-04-26T21:16:25.816434+0000","last_peered":"2024-04-26T21:16:25.816434+0000","last_clean":"2024-04-26T21:16:25.816434+0000","last_became_active":"2024-04-26T21:16:20.426300+0000","last_became_peered":"2024-04-26T21:16:20.426300+0000","last_unstale":"2024-04-26T21:16:25.816434+0000","last_undegraded":"2024-04-26T21:16:25.816434+0000","last_fullsized":"2024-04-26T21:16:25.816434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435135+0000","last_change":"2024-04-26T21:16:24.461980+0000","last_active":"2024-04-26T21:16:25.435135+0000","last_peered":"2024-04-26T21:16:25.435135+0000","last_clean":"2024-04-26T21:16:25.435135+0000","last_became_active":"2024-04-26T21:16:24.461244+0000","last_became_peered":"2024-04-26T21:16:24.461244+0000","last_unstale":"2024-04-26T21:16:25.435135+0000","last_undegraded":"2024-04-26T21:16:25.435135+0000","last_fullsized":"2024-04-26T21:16:25.435135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:49.007056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436320+0000","last_change":"2024-04-26T21:16:19.413076+0000","last_active":"2024-04-26T21:16:25.436320+0000","last_peered":"2024-04-26T21:16:25.436320+0000","last_clean":"2024-04-26T21:16:25.436320+0000","last_became_active":"2024-04-26T21:16:19.412710+0000","last_became_peered":"2024-04-26T21:16:19.412710+0000","last_unstale":"2024-04-26T21:16:25.436320+0000","last_undegraded":"2024-04-26T21:16:25.436320+0000","last_fullsized":"2024-04-26T21:16:25.436320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:56.575835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816409+0000","last_change":"2024-04-26T21:16:20.421335+0000","last_active":"2024-04-26T21:16:25.816409+0000","last_peered":"2024-04-26T21:16:25.816409+0000","last_clean":"2024-04-26T21:16:25.816409+0000","last_became_active":"2024-04-26T21:16:20.420893+0000","last_became_peered":"2024-04-26T21:16:20.420893+0000","last_unstale":"2024-04-26T21:16:25.816409+0000","last_undegraded":"2024-04-26T21:16:25.816409+0000","last_fullsized":"2024-04-26T21:16:25.816409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:09.604970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434983+0000","last_change":"2024-04-26T21:16:24.457306+0000","last_active":"2024-04-26T21:16:25.434983+0000","last_peered":"2024-04-26T21:16:25.434983+0000","last_clean":"2024-04-26T21:16:25.434983+0000","last_became_active":"2024-04-26T21:16:24.456786+0000","last_became_peered":"2024-04-26T21:16:24.456786+0000","last_unstale":"2024-04-26T21:16:25.434983+0000","last_undegraded":"2024-04-26T21:16:25.434983+0000","last_fullsized":"2024-04-26T21:16:25.434983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:07.354698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433876+0000","last_change":"2024-04-26T21:16:20.407919+0000","last_active":"2024-04-26T21:16:25.433876+0000","last_peered":"2024-04-26T21:16:25.433876+0000","last_clean":"2024-04-26T21:16:25.433876+0000","last_became_active":"2024-04-26T21:16:20.405803+0000","last_became_peered":"2024-04-26T21:16:20.405803+0000","last_unstale":"2024-04-26T21:16:25.433876+0000","last_undegraded":"2024-04-26T21:16:25.433876+0000","last_fullsized":"2024-04-26T21:16:25.433876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436225+0000","last_change":"2024-04-26T21:16:19.408886+0000","last_active":"2024-04-26T21:16:25.436225+0000","last_peered":"2024-04-26T21:16:25.436225+0000","last_clean":"2024-04-26T21:16:25.436225+0000","last_became_active":"2024-04-26T21:16:19.408563+0000","last_became_peered":"2024-04-26T21:16:19.408563+0000","last_unstale":"2024-04-26T21:16:25.436225+0000","last_undegraded":"2024-04-26T21:16:25.436225+0000","last_fullsized":"2024-04-26T21:16:25.436225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436044+0000","last_change":"2024-04-26T21:16:24.463322+0000","last_active":"2024-04-26T21:16:25.436044+0000","last_peered":"2024-04-26T21:16:25.436044+0000","last_clean":"2024-04-26T21:16:25.436044+0000","last_became_active":"2024-04-26T21:16:24.462885+0000","last_became_peered":"2024-04-26T21:16:24.462885+0000","last_unstale":"2024-04-26T21:16:25.436044+0000","last_undegraded":"2024-04-26T21:16:25.436044+0000","last_fullsized":"2024-04-26T21:16:25.436044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814971+0000","last_change":"2024-04-26T21:16:20.417586+0000","last_active":"2024-04-26T21:16:25.814971+0000","last_peered":"2024-04-26T21:16:25.814971+0000","last_clean":"2024-04-26T21:16:25.814971+0000","last_became_active":"2024-04-26T21:16:20.417195+0000","last_became_peered":"2024-04-26T21:16:20.417195+0000","last_unstale":"2024-04-26T21:16:25.814971+0000","last_undegraded":"2024-04-26T21:16:25.814971+0000","last_fullsized":"2024-04-26T21:16:25.814971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801200+0000","last_change":"2024-04-26T21:16:19.402526+0000","last_active":"2024-04-26T21:16:25.801200+0000","last_peered":"2024-04-26T21:16:25.801200+0000","last_clean":"2024-04-26T21:16:25.801200+0000","last_became_active":"2024-04-26T21:16:19.399544+0000","last_became_peered":"2024-04-26T21:16:19.399544+0000","last_unstale":"2024-04-26T21:16:25.801200+0000","last_undegraded":"2024-04-26T21:16:25.801200+0000","last_fullsized":"2024-04-26T21:16:25.801200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434800+0000","last_change":"2024-04-26T21:16:24.462467+0000","last_active":"2024-04-26T21:16:25.434800+0000","last_peered":"2024-04-26T21:16:25.434800+0000","last_clean":"2024-04-26T21:16:25.434800+0000","last_became_active":"2024-04-26T21:16:24.461966+0000","last_became_peered":"2024-04-26T21:16:24.461966+0000","last_unstale":"2024-04-26T21:16:25.434800+0000","last_undegraded":"2024-04-26T21:16:25.434800+0000","last_fullsized":"2024-04-26T21:16:25.434800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:44.228248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814368+0000","last_change":"2024-04-26T21:16:20.404811+0000","last_active":"2024-04-26T21:16:25.814368+0000","last_peered":"2024-04-26T21:16:25.814368+0000","last_clean":"2024-04-26T21:16:25.814368+0000","last_became_active":"2024-04-26T21:16:20.403360+0000","last_became_peered":"2024-04-26T21:16:20.403360+0000","last_unstale":"2024-04-26T21:16:25.814368+0000","last_undegraded":"2024-04-26T21:16:25.814368+0000","last_fullsized":"2024-04-26T21:16:25.814368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800884+0000","last_change":"2024-04-26T21:16:19.400626+0000","last_active":"2024-04-26T21:16:25.800884+0000","last_peered":"2024-04-26T21:16:25.800884+0000","last_clean":"2024-04-26T21:16:25.800884+0000","last_became_active":"2024-04-26T21:16:19.400194+0000","last_became_peered":"2024-04-26T21:16:19.400194+0000","last_unstale":"2024-04-26T21:16:25.800884+0000","last_undegraded":"2024-04-26T21:16:25.800884+0000","last_fullsized":"2024-04-26T21:16:25.800884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801658+0000","last_change":"2024-04-26T21:16:24.461234+0000","last_active":"2024-04-26T21:16:25.801658+0000","last_peered":"2024-04-26T21:16:25.801658+0000","last_clean":"2024-04-26T21:16:25.801658+0000","last_became_active":"2024-04-26T21:16:24.460911+0000","last_became_peered":"2024-04-26T21:16:24.460911+0000","last_unstale":"2024-04-26T21:16:25.801658+0000","last_undegraded":"2024-04-26T21:16:25.801658+0000","last_fullsized":"2024-04-26T21:16:25.801658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:45.803476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434606+0000","last_change":"2024-04-26T21:16:20.418241+0000","last_active":"2024-04-26T21:16:25.434606+0000","last_peered":"2024-04-26T21:16:25.434606+0000","last_clean":"2024-04-26T21:16:25.434606+0000","last_became_active":"2024-04-26T21:16:20.417710+0000","last_became_peered":"2024-04-26T21:16:20.417710+0000","last_unstale":"2024-04-26T21:16:25.434606+0000","last_undegraded":"2024-04-26T21:16:25.434606+0000","last_fullsized":"2024-04-26T21:16:25.434606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:46.750974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435669+0000","last_change":"2024-04-26T21:16:19.417003+0000","last_active":"2024-04-26T21:16:25.435669+0000","last_peered":"2024-04-26T21:16:25.435669+0000","last_clean":"2024-04-26T21:16:25.435669+0000","last_became_active":"2024-04-26T21:16:19.416648+0000","last_became_peered":"2024-04-26T21:16:19.416648+0000","last_unstale":"2024-04-26T21:16:25.435669+0000","last_undegraded":"2024-04-26T21:16:25.435669+0000","last_fullsized":"2024-04-26T21:16:25.435669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434863+0000","last_change":"2024-04-26T21:16:24.462876+0000","last_active":"2024-04-26T21:16:25.434863+0000","last_peered":"2024-04-26T21:16:25.434863+0000","last_clean":"2024-04-26T21:16:25.434863+0000","last_became_active":"2024-04-26T21:16:24.462460+0000","last_became_peered":"2024-04-26T21:16:24.462460+0000","last_unstale":"2024-04-26T21:16:25.434863+0000","last_undegraded":"2024-04-26T21:16:25.434863+0000","last_fullsized":"2024-04-26T21:16:25.434863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:21.311855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817334+0000","last_change":"2024-04-26T21:16:20.408076+0000","last_active":"2024-04-26T21:16:25.817334+0000","last_peered":"2024-04-26T21:16:25.817334+0000","last_clean":"2024-04-26T21:16:25.817334+0000","last_became_active":"2024-04-26T21:16:20.407656+0000","last_became_peered":"2024-04-26T21:16:20.407656+0000","last_unstale":"2024-04-26T21:16:25.817334+0000","last_undegraded":"2024-04-26T21:16:25.817334+0000","last_fullsized":"2024-04-26T21:16:25.817334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435249+0000","last_change":"2024-04-26T21:16:19.411480+0000","last_active":"2024-04-26T21:16:25.435249+0000","last_peered":"2024-04-26T21:16:25.435249+0000","last_clean":"2024-04-26T21:16:25.435249+0000","last_became_active":"2024-04-26T21:16:19.410829+0000","last_became_peered":"2024-04-26T21:16:19.410829+0000","last_unstale":"2024-04-26T21:16:25.435249+0000","last_undegraded":"2024-04-26T21:16:25.435249+0000","last_fullsized":"2024-04-26T21:16:25.435249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434466+0000","last_change":"2024-04-26T21:16:24.456850+0000","last_active":"2024-04-26T21:16:25.434466+0000","last_peered":"2024-04-26T21:16:25.434466+0000","last_clean":"2024-04-26T21:16:25.434466+0000","last_became_active":"2024-04-26T21:16:24.456404+0000","last_became_peered":"2024-04-26T21:16:24.456404+0000","last_unstale":"2024-04-26T21:16:25.434466+0000","last_undegraded":"2024-04-26T21:16:25.434466+0000","last_fullsized":"2024-04-26T21:16:25.434466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:35.587426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815768+0000","last_change":"2024-04-26T21:16:20.427731+0000","last_active":"2024-04-26T21:16:25.815768+0000","last_peered":"2024-04-26T21:16:25.815768+0000","last_clean":"2024-04-26T21:16:25.815768+0000","last_became_active":"2024-04-26T21:16:20.427425+0000","last_became_peered":"2024-04-26T21:16:20.427425+0000","last_unstale":"2024-04-26T21:16:25.815768+0000","last_undegraded":"2024-04-26T21:16:25.815768+0000","last_fullsized":"2024-04-26T21:16:25.815768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801527+0000","last_change":"2024-04-26T21:16:19.406450+0000","last_active":"2024-04-26T21:16:25.801527+0000","last_peered":"2024-04-26T21:16:25.801527+0000","last_clean":"2024-04-26T21:16:25.801527+0000","last_became_active":"2024-04-26T21:16:19.405911+0000","last_became_peered":"2024-04-26T21:16:19.405911+0000","last_unstale":"2024-04-26T21:16:25.801527+0000","last_undegraded":"2024-04-26T21:16:25.801527+0000","last_fullsized":"2024-04-26T21:16:25.801527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814203+0000","last_change":"2024-04-26T21:16:24.458420+0000","last_active":"2024-04-26T21:16:25.814203+0000","last_peered":"2024-04-26T21:16:25.814203+0000","last_clean":"2024-04-26T21:16:25.814203+0000","last_became_active":"2024-04-26T21:16:24.458033+0000","last_became_peered":"2024-04-26T21:16:24.458033+0000","last_unstale":"2024-04-26T21:16:25.814203+0000","last_undegraded":"2024-04-26T21:16:25.814203+0000","last_fullsized":"2024-04-26T21:16:25.814203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:45.881928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801205+0000","last_change":"2024-04-26T21:16:20.410112+0000","last_active":"2024-04-26T21:16:25.801205+0000","last_peered":"2024-04-26T21:16:25.801205+0000","last_clean":"2024-04-26T21:16:25.801205+0000","last_became_active":"2024-04-26T21:16:20.406760+0000","last_became_peered":"2024-04-26T21:16:20.406760+0000","last_unstale":"2024-04-26T21:16:25.801205+0000","last_undegraded":"2024-04-26T21:16:25.801205+0000","last_fullsized":"2024-04-26T21:16:25.801205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436719+0000","last_change":"2024-04-26T21:16:19.415298+0000","last_active":"2024-04-26T21:16:25.436719+0000","last_peered":"2024-04-26T21:16:25.436719+0000","last_clean":"2024-04-26T21:16:25.436719+0000","last_became_active":"2024-04-26T21:16:19.414712+0000","last_became_peered":"2024-04-26T21:16:19.414712+0000","last_unstale":"2024-04-26T21:16:25.436719+0000","last_undegraded":"2024-04-26T21:16:25.436719+0000","last_fullsized":"2024-04-26T21:16:25.436719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:38.445207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816864+0000","last_change":"2024-04-26T21:16:24.454307+0000","last_active":"2024-04-26T21:16:25.816864+0000","last_peered":"2024-04-26T21:16:25.816864+0000","last_clean":"2024-04-26T21:16:25.816864+0000","last_became_active":"2024-04-26T21:16:24.453880+0000","last_became_peered":"2024-04-26T21:16:24.453880+0000","last_unstale":"2024-04-26T21:16:25.816864+0000","last_undegraded":"2024-04-26T21:16:25.816864+0000","last_fullsized":"2024-04-26T21:16:25.816864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:02.451831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816509+0000","last_change":"2024-04-26T21:16:20.421987+0000","last_active":"2024-04-26T21:16:25.816509+0000","last_peered":"2024-04-26T21:16:25.816509+0000","last_clean":"2024-04-26T21:16:25.816509+0000","last_became_active":"2024-04-26T21:16:20.421708+0000","last_became_peered":"2024-04-26T21:16:20.421708+0000","last_unstale":"2024-04-26T21:16:25.816509+0000","last_undegraded":"2024-04-26T21:16:25.816509+0000","last_fullsized":"2024-04-26T21:16:25.816509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:03.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801261+0000","last_change":"2024-04-26T21:16:19.411246+0000","last_active":"2024-04-26T21:16:25.801261+0000","last_peered":"2024-04-26T21:16:25.801261+0000","last_clean":"2024-04-26T21:16:25.801261+0000","last_became_active":"2024-04-26T21:16:19.410899+0000","last_became_peered":"2024-04-26T21:16:19.410899+0000","last_unstale":"2024-04-26T21:16:25.801261+0000","last_undegraded":"2024-04-26T21:16:25.801261+0000","last_fullsized":"2024-04-26T21:16:25.801261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:38.445207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800985+0000","last_change":"2024-04-26T21:16:24.460849+0000","last_active":"2024-04-26T21:16:25.800985+0000","last_peered":"2024-04-26T21:16:25.800985+0000","last_clean":"2024-04-26T21:16:25.800985+0000","last_became_active":"2024-04-26T21:16:24.460317+0000","last_became_peered":"2024-04-26T21:16:24.460317+0000","last_unstale":"2024-04-26T21:16:25.800985+0000","last_undegraded":"2024-04-26T21:16:25.800985+0000","last_fullsized":"2024-04-26T21:16:25.800985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435239+0000","last_change":"2024-04-26T21:16:20.418564+0000","last_active":"2024-04-26T21:16:25.435239+0000","last_peered":"2024-04-26T21:16:25.435239+0000","last_clean":"2024-04-26T21:16:25.435239+0000","last_became_active":"2024-04-26T21:16:20.417882+0000","last_became_peered":"2024-04-26T21:16:20.417882+0000","last_unstale":"2024-04-26T21:16:25.435239+0000","last_undegraded":"2024-04-26T21:16:25.435239+0000","last_fullsized":"2024-04-26T21:16:25.435239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:40.649173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816239+0000","last_change":"2024-04-26T21:16:19.399034+0000","last_active":"2024-04-26T21:16:25.816239+0000","last_peered":"2024-04-26T21:16:25.816239+0000","last_clean":"2024-04-26T21:16:25.816239+0000","last_became_active":"2024-04-26T21:16:19.398765+0000","last_became_peered":"2024-04-26T21:16:19.398765+0000","last_unstale":"2024-04-26T21:16:25.816239+0000","last_undegraded":"2024-04-26T21:16:25.816239+0000","last_fullsized":"2024-04-26T21:16:25.816239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801228+0000","last_change":"2024-04-26T21:16:24.458228+0000","last_active":"2024-04-26T21:16:25.801228+0000","last_peered":"2024-04-26T21:16:25.801228+0000","last_clean":"2024-04-26T21:16:25.801228+0000","last_became_active":"2024-04-26T21:16:24.457891+0000","last_became_peered":"2024-04-26T21:16:24.457891+0000","last_unstale":"2024-04-26T21:16:25.801228+0000","last_undegraded":"2024-04-26T21:16:25.801228+0000","last_fullsized":"2024-04-26T21:16:25.801228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:02.451831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800959+0000","last_change":"2024-04-26T21:16:20.403928+0000","last_active":"2024-04-26T21:16:25.800959+0000","last_peered":"2024-04-26T21:16:25.800959+0000","last_clean":"2024-04-26T21:16:25.800959+0000","last_became_active":"2024-04-26T21:16:20.403679+0000","last_became_peered":"2024-04-26T21:16:20.403679+0000","last_unstale":"2024-04-26T21:16:25.800959+0000","last_undegraded":"2024-04-26T21:16:25.800959+0000","last_fullsized":"2024-04-26T21:16:25.800959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814353+0000","last_change":"2024-04-26T21:16:19.401004+0000","last_active":"2024-04-26T21:16:25.814353+0000","last_peered":"2024-04-26T21:16:25.814353+0000","last_clean":"2024-04-26T21:16:25.814353+0000","last_became_active":"2024-04-26T21:16:19.400735+0000","last_became_peered":"2024-04-26T21:16:19.400735+0000","last_unstale":"2024-04-26T21:16:25.814353+0000","last_undegraded":"2024-04-26T21:16:25.814353+0000","last_fullsized":"2024-04-26T21:16:25.814353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:10.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801692+0000","last_change":"2024-04-26T21:16:24.455241+0000","last_active":"2024-04-26T21:16:25.801692+0000","last_peered":"2024-04-26T21:16:25.801692+0000","last_clean":"2024-04-26T21:16:25.801692+0000","last_became_active":"2024-04-26T21:16:24.454846+0000","last_became_peered":"2024-04-26T21:16:24.454846+0000","last_unstale":"2024-04-26T21:16:25.801692+0000","last_undegraded":"2024-04-26T21:16:25.801692+0000","last_fullsized":"2024-04-26T21:16:25.801692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:31.330251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816525+0000","last_change":"2024-04-26T21:16:20.410135+0000","last_active":"2024-04-26T21:16:25.816525+0000","last_peered":"2024-04-26T21:16:25.816525+0000","last_clean":"2024-04-26T21:16:25.816525+0000","last_became_active":"2024-04-26T21:16:20.409798+0000","last_became_peered":"2024-04-26T21:16:20.409798+0000","last_unstale":"2024-04-26T21:16:25.816525+0000","last_undegraded":"2024-04-26T21:16:25.816525+0000","last_fullsized":"2024-04-26T21:16:25.816525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:11.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435791+0000","last_change":"2024-04-26T21:16:19.412309+0000","last_active":"2024-04-26T21:16:25.435791+0000","last_peered":"2024-04-26T21:16:25.435791+0000","last_clean":"2024-04-26T21:16:25.435791+0000","last_became_active":"2024-04-26T21:16:19.412073+0000","last_became_peered":"2024-04-26T21:16:19.412073+0000","last_unstale":"2024-04-26T21:16:25.435791+0000","last_undegraded":"2024-04-26T21:16:25.435791+0000","last_fullsized":"2024-04-26T21:16:25.435791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817236+0000","last_change":"2024-04-26T21:16:24.458176+0000","last_active":"2024-04-26T21:16:25.817236+0000","last_peered":"2024-04-26T21:16:25.817236+0000","last_clean":"2024-04-26T21:16:25.817236+0000","last_became_active":"2024-04-26T21:16:24.457774+0000","last_became_peered":"2024-04-26T21:16:24.457774+0000","last_unstale":"2024-04-26T21:16:25.817236+0000","last_undegraded":"2024-04-26T21:16:25.817236+0000","last_fullsized":"2024-04-26T21:16:25.817236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:45.881928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814481+0000","last_change":"2024-04-26T21:16:20.425327+0000","last_active":"2024-04-26T21:16:25.814481+0000","last_peered":"2024-04-26T21:16:25.814481+0000","last_clean":"2024-04-26T21:16:25.814481+0000","last_became_active":"2024-04-26T21:16:20.425071+0000","last_became_peered":"2024-04-26T21:16:20.425071+0000","last_unstale":"2024-04-26T21:16:25.814481+0000","last_undegraded":"2024-04-26T21:16:25.814481+0000","last_fullsized":"2024-04-26T21:16:25.814481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816253+0000","last_change":"2024-04-26T21:16:19.408668+0000","last_active":"2024-04-26T21:16:25.816253+0000","last_peered":"2024-04-26T21:16:25.816253+0000","last_clean":"2024-04-26T21:16:25.816253+0000","last_became_active":"2024-04-26T21:16:19.408363+0000","last_became_peered":"2024-04-26T21:16:19.408363+0000","last_unstale":"2024-04-26T21:16:25.816253+0000","last_undegraded":"2024-04-26T21:16:25.816253+0000","last_fullsized":"2024-04-26T21:16:25.816253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435906+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:16:25.435906+0000","last_peered":"2024-04-26T21:16:25.435906+0000","last_clean":"2024-04-26T21:16:25.435906+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:16:25.435906+0000","last_undegraded":"2024-04-26T21:16:25.435906+0000","last_fullsized":"2024-04-26T21:16:25.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434338+0000","last_change":"2024-04-26T21:16:24.452049+0000","last_active":"2024-04-26T21:16:25.434338+0000","last_peered":"2024-04-26T21:16:25.434338+0000","last_clean":"2024-04-26T21:16:25.434338+0000","last_became_active":"2024-04-26T21:16:24.451479+0000","last_became_peered":"2024-04-26T21:16:24.451479+0000","last_unstale":"2024-04-26T21:16:25.434338+0000","last_undegraded":"2024-04-26T21:16:25.434338+0000","last_fullsized":"2024-04-26T21:16:25.434338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:49.007056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436447+0000","last_change":"2024-04-26T21:16:20.425471+0000","last_active":"2024-04-26T21:16:25.436447+0000","last_peered":"2024-04-26T21:16:25.436447+0000","last_clean":"2024-04-26T21:16:25.436447+0000","last_became_active":"2024-04-26T21:16:20.425139+0000","last_became_peered":"2024-04-26T21:16:20.425139+0000","last_unstale":"2024-04-26T21:16:25.436447+0000","last_undegraded":"2024-04-26T21:16:25.436447+0000","last_fullsized":"2024-04-26T21:16:25.436447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:44.971333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815036+0000","last_change":"2024-04-26T21:16:19.405872+0000","last_active":"2024-04-26T21:16:25.815036+0000","last_peered":"2024-04-26T21:16:25.815036+0000","last_clean":"2024-04-26T21:16:25.815036+0000","last_became_active":"2024-04-26T21:16:19.405574+0000","last_became_peered":"2024-04-26T21:16:19.405574+0000","last_unstale":"2024-04-26T21:16:25.815036+0000","last_undegraded":"2024-04-26T21:16:25.815036+0000","last_fullsized":"2024-04-26T21:16:25.815036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:11.405759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433802+0000","last_change":"2024-04-26T21:16:24.452916+0000","last_active":"2024-04-26T21:16:25.433802+0000","last_peered":"2024-04-26T21:16:25.433802+0000","last_clean":"2024-04-26T21:16:25.433802+0000","last_became_active":"2024-04-26T21:16:24.452500+0000","last_became_peered":"2024-04-26T21:16:24.452500+0000","last_unstale":"2024-04-26T21:16:25.433802+0000","last_undegraded":"2024-04-26T21:16:25.433802+0000","last_fullsized":"2024-04-26T21:16:25.433802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:07.354698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816437+0000","last_change":"2024-04-26T21:16:20.434192+0000","last_active":"2024-04-26T21:16:25.816437+0000","last_peered":"2024-04-26T21:16:25.816437+0000","last_clean":"2024-04-26T21:16:25.816437+0000","last_became_active":"2024-04-26T21:16:20.433657+0000","last_became_peered":"2024-04-26T21:16:20.433657+0000","last_unstale":"2024-04-26T21:16:25.816437+0000","last_undegraded":"2024-04-26T21:16:25.816437+0000","last_fullsized":"2024-04-26T21:16:25.816437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:54.005276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801434+0000","last_change":"2024-04-26T21:16:19.403457+0000","last_active":"2024-04-26T21:16:25.801434+0000","last_peered":"2024-04-26T21:16:25.801434+0000","last_clean":"2024-04-26T21:16:25.801434+0000","last_became_active":"2024-04-26T21:16:19.402886+0000","last_became_peered":"2024-04-26T21:16:19.402886+0000","last_unstale":"2024-04-26T21:16:25.801434+0000","last_undegraded":"2024-04-26T21:16:25.801434+0000","last_fullsized":"2024-04-26T21:16:25.801434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816954+0000","last_change":"2024-04-26T21:16:24.454078+0000","last_active":"2024-04-26T21:16:25.816954+0000","last_peered":"2024-04-26T21:16:25.816954+0000","last_clean":"2024-04-26T21:16:25.816954+0000","last_became_active":"2024-04-26T21:16:24.453726+0000","last_became_peered":"2024-04-26T21:16:24.453726+0000","last_unstale":"2024-04-26T21:16:25.816954+0000","last_undegraded":"2024-04-26T21:16:25.816954+0000","last_fullsized":"2024-04-26T21:16:25.816954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:45.803476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436898+0000","last_change":"2024-04-26T21:16:20.415657+0000","last_active":"2024-04-26T21:16:25.436898+0000","last_peered":"2024-04-26T21:16:25.436898+0000","last_clean":"2024-04-26T21:16:25.436898+0000","last_became_active":"2024-04-26T21:16:20.415241+0000","last_became_peered":"2024-04-26T21:16:20.415241+0000","last_unstale":"2024-04-26T21:16:25.436898+0000","last_undegraded":"2024-04-26T21:16:25.436898+0000","last_fullsized":"2024-04-26T21:16:25.436898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:27.294527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815326+0000","last_change":"2024-04-26T21:16:19.398067+0000","last_active":"2024-04-26T21:16:25.815326+0000","last_peered":"2024-04-26T21:16:25.815326+0000","last_clean":"2024-04-26T21:16:25.815326+0000","last_became_active":"2024-04-26T21:16:19.397685+0000","last_became_peered":"2024-04-26T21:16:19.397685+0000","last_unstale":"2024-04-26T21:16:25.815326+0000","last_undegraded":"2024-04-26T21:16:25.815326+0000","last_fullsized":"2024-04-26T21:16:25.815326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:38.089679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815875+0000","last_change":"2024-04-26T21:16:24.450492+0000","last_active":"2024-04-26T21:16:25.815875+0000","last_peered":"2024-04-26T21:16:25.815875+0000","last_clean":"2024-04-26T21:16:25.815875+0000","last_became_active":"2024-04-26T21:16:24.450086+0000","last_became_peered":"2024-04-26T21:16:24.450086+0000","last_unstale":"2024-04-26T21:16:25.815875+0000","last_undegraded":"2024-04-26T21:16:25.815875+0000","last_fullsized":"2024-04-26T21:16:25.815875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436736+0000","last_change":"2024-04-26T21:16:20.422919+0000","last_active":"2024-04-26T21:16:25.436736+0000","last_peered":"2024-04-26T21:16:25.436736+0000","last_clean":"2024-04-26T21:16:25.436736+0000","last_became_active":"2024-04-26T21:16:20.422606+0000","last_became_peered":"2024-04-26T21:16:20.422606+0000","last_unstale":"2024-04-26T21:16:25.436736+0000","last_undegraded":"2024-04-26T21:16:25.436736+0000","last_fullsized":"2024-04-26T21:16:25.436736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:54.005276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434221+0000","last_change":"2024-04-26T21:16:19.409935+0000","last_active":"2024-04-26T21:16:25.434221+0000","last_peered":"2024-04-26T21:16:25.434221+0000","last_clean":"2024-04-26T21:16:25.434221+0000","last_became_active":"2024-04-26T21:16:19.409636+0000","last_became_peered":"2024-04-26T21:16:19.409636+0000","last_unstale":"2024-04-26T21:16:25.434221+0000","last_undegraded":"2024-04-26T21:16:25.434221+0000","last_fullsized":"2024-04-26T21:16:25.434221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:24.652333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434240+0000","last_change":"2024-04-26T21:16:24.462022+0000","last_active":"2024-04-26T21:16:25.434240+0000","last_peered":"2024-04-26T21:16:25.434240+0000","last_clean":"2024-04-26T21:16:25.434240+0000","last_became_active":"2024-04-26T21:16:24.461691+0000","last_became_peered":"2024-04-26T21:16:24.461691+0000","last_unstale":"2024-04-26T21:16:25.434240+0000","last_undegraded":"2024-04-26T21:16:25.434240+0000","last_fullsized":"2024-04-26T21:16:25.434240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:35.967648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435773+0000","last_change":"2024-04-26T21:16:20.406585+0000","last_active":"2024-04-26T21:16:25.435773+0000","last_peered":"2024-04-26T21:16:25.435773+0000","last_clean":"2024-04-26T21:16:25.435773+0000","last_became_active":"2024-04-26T21:16:20.406265+0000","last_became_peered":"2024-04-26T21:16:20.406265+0000","last_unstale":"2024-04-26T21:16:25.435773+0000","last_undegraded":"2024-04-26T21:16:25.435773+0000","last_fullsized":"2024-04-26T21:16:25.435773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814382+0000","last_change":"2024-04-26T21:16:19.395551+0000","last_active":"2024-04-26T21:16:25.814382+0000","last_peered":"2024-04-26T21:16:25.814382+0000","last_clean":"2024-04-26T21:16:25.814382+0000","last_became_active":"2024-04-26T21:16:19.393831+0000","last_became_peered":"2024-04-26T21:16:19.393831+0000","last_unstale":"2024-04-26T21:16:25.814382+0000","last_undegraded":"2024-04-26T21:16:25.814382+0000","last_fullsized":"2024-04-26T21:16:25.814382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:53.258420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817267+0000","last_change":"2024-04-26T21:16:24.452943+0000","last_active":"2024-04-26T21:16:25.817267+0000","last_peered":"2024-04-26T21:16:25.817267+0000","last_clean":"2024-04-26T21:16:25.817267+0000","last_became_active":"2024-04-26T21:16:24.452603+0000","last_became_peered":"2024-04-26T21:16:24.452603+0000","last_unstale":"2024-04-26T21:16:25.817267+0000","last_undegraded":"2024-04-26T21:16:25.817267+0000","last_fullsized":"2024-04-26T21:16:25.817267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433930+0000","last_change":"2024-04-26T21:16:20.410601+0000","last_active":"2024-04-26T21:16:25.433930+0000","last_peered":"2024-04-26T21:16:25.433930+0000","last_clean":"2024-04-26T21:16:25.433930+0000","last_became_active":"2024-04-26T21:16:20.410197+0000","last_became_peered":"2024-04-26T21:16:20.410197+0000","last_unstale":"2024-04-26T21:16:25.433930+0000","last_undegraded":"2024-04-26T21:16:25.433930+0000","last_fullsized":"2024-04-26T21:16:25.433930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433955+0000","last_change":"2024-04-26T21:16:19.413099+0000","last_active":"2024-04-26T21:16:25.433955+0000","last_peered":"2024-04-26T21:16:25.433955+0000","last_clean":"2024-04-26T21:16:25.433955+0000","last_became_active":"2024-04-26T21:16:19.412695+0000","last_became_peered":"2024-04-26T21:16:19.412695+0000","last_unstale":"2024-04-26T21:16:25.433955+0000","last_undegraded":"2024-04-26T21:16:25.433955+0000","last_fullsized":"2024-04-26T21:16:25.433955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815773+0000","last_change":"2024-04-26T21:16:24.446231+0000","last_active":"2024-04-26T21:16:25.815773+0000","last_peered":"2024-04-26T21:16:25.815773+0000","last_clean":"2024-04-26T21:16:25.815773+0000","last_became_active":"2024-04-26T21:16:24.445743+0000","last_became_peered":"2024-04-26T21:16:24.445743+0000","last_unstale":"2024-04-26T21:16:25.815773+0000","last_undegraded":"2024-04-26T21:16:25.815773+0000","last_fullsized":"2024-04-26T21:16:25.815773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:27.238080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436166+0000","last_change":"2024-04-26T21:16:20.423076+0000","last_active":"2024-04-26T21:16:25.436166+0000","last_peered":"2024-04-26T21:16:25.436166+0000","last_clean":"2024-04-26T21:16:25.436166+0000","last_became_active":"2024-04-26T21:16:20.422476+0000","last_became_peered":"2024-04-26T21:16:20.422476+0000","last_unstale":"2024-04-26T21:16:25.436166+0000","last_undegraded":"2024-04-26T21:16:25.436166+0000","last_fullsized":"2024-04-26T21:16:25.436166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816169+0000","last_change":"2024-04-26T21:16:19.406614+0000","last_active":"2024-04-26T21:16:25.816169+0000","last_peered":"2024-04-26T21:16:25.816169+0000","last_clean":"2024-04-26T21:16:25.816169+0000","last_became_active":"2024-04-26T21:16:19.403274+0000","last_became_peered":"2024-04-26T21:16:19.403274+0000","last_unstale":"2024-04-26T21:16:25.816169+0000","last_undegraded":"2024-04-26T21:16:25.816169+0000","last_fullsized":"2024-04-26T21:16:25.816169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815305+0000","last_change":"2024-04-26T21:16:24.451820+0000","last_active":"2024-04-26T21:16:25.815305+0000","last_peered":"2024-04-26T21:16:25.815305+0000","last_clean":"2024-04-26T21:16:25.815305+0000","last_became_active":"2024-04-26T21:16:24.451472+0000","last_became_peered":"2024-04-26T21:16:24.451472+0000","last_unstale":"2024-04-26T21:16:25.815305+0000","last_undegraded":"2024-04-26T21:16:25.815305+0000","last_fullsized":"2024-04-26T21:16:25.815305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:09.977865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816825+0000","last_change":"2024-04-26T21:16:20.425068+0000","last_active":"2024-04-26T21:16:25.816825+0000","last_peered":"2024-04-26T21:16:25.816825+0000","last_clean":"2024-04-26T21:16:25.816825+0000","last_became_active":"2024-04-26T21:16:20.424773+0000","last_became_peered":"2024-04-26T21:16:20.424773+0000","last_unstale":"2024-04-26T21:16:25.816825+0000","last_undegraded":"2024-04-26T21:16:25.816825+0000","last_fullsized":"2024-04-26T21:16:25.816825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817008+0000","last_change":"2024-04-26T21:16:19.413580+0000","last_active":"2024-04-26T21:16:25.817008+0000","last_peered":"2024-04-26T21:16:25.817008+0000","last_clean":"2024-04-26T21:16:25.817008+0000","last_became_active":"2024-04-26T21:16:19.412636+0000","last_became_peered":"2024-04-26T21:16:19.412636+0000","last_unstale":"2024-04-26T21:16:25.817008+0000","last_undegraded":"2024-04-26T21:16:25.817008+0000","last_fullsized":"2024-04-26T21:16:25.817008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:06.128835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816582+0000","last_change":"2024-04-26T21:16:24.456301+0000","last_active":"2024-04-26T21:16:25.816582+0000","last_peered":"2024-04-26T21:16:25.816582+0000","last_clean":"2024-04-26T21:16:25.816582+0000","last_became_active":"2024-04-26T21:16:24.455115+0000","last_became_peered":"2024-04-26T21:16:24.455115+0000","last_unstale":"2024-04-26T21:16:25.816582+0000","last_undegraded":"2024-04-26T21:16:25.816582+0000","last_fullsized":"2024-04-26T21:16:25.816582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:58.709336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436405+0000","last_change":"2024-04-26T21:16:20.404787+0000","last_active":"2024-04-26T21:16:25.436405+0000","last_peered":"2024-04-26T21:16:25.436405+0000","last_clean":"2024-04-26T21:16:25.436405+0000","last_became_active":"2024-04-26T21:16:20.404355+0000","last_became_peered":"2024-04-26T21:16:20.404355+0000","last_unstale":"2024-04-26T21:16:25.436405+0000","last_undegraded":"2024-04-26T21:16:25.436405+0000","last_fullsized":"2024-04-26T21:16:25.436405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:03.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:35.742110+0000","last_change":"2024-04-26T21:16:19.407394+0000","last_active":"2024-04-26T21:16:35.742110+0000","last_peered":"2024-04-26T21:16:35.742110+0000","last_clean":"2024-04-26T21:16:35.742110+0000","last_became_active":"2024-04-26T21:16:19.407056+0000","last_became_peered":"2024-04-26T21:16:19.407056+0000","last_unstale":"2024-04-26T21:16:35.742110+0000","last_undegraded":"2024-04-26T21:16:35.742110+0000","last_fullsized":"2024-04-26T21:16:35.742110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801146+0000","last_change":"2024-04-26T21:16:24.460241+0000","last_active":"2024-04-26T21:16:25.801146+0000","last_peered":"2024-04-26T21:16:25.801146+0000","last_clean":"2024-04-26T21:16:25.801146+0000","last_became_active":"2024-04-26T21:16:24.459738+0000","last_became_peered":"2024-04-26T21:16:24.459738+0000","last_unstale":"2024-04-26T21:16:25.801146+0000","last_undegraded":"2024-04-26T21:16:25.801146+0000","last_fullsized":"2024-04-26T21:16:25.801146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:13.640693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434981+0000","last_change":"2024-04-26T21:16:20.430119+0000","last_active":"2024-04-26T21:16:25.434981+0000","last_peered":"2024-04-26T21:16:25.434981+0000","last_clean":"2024-04-26T21:16:25.434981+0000","last_became_active":"2024-04-26T21:16:20.429573+0000","last_became_peered":"2024-04-26T21:16:20.429573+0000","last_unstale":"2024-04-26T21:16:25.434981+0000","last_undegraded":"2024-04-26T21:16:25.434981+0000","last_fullsized":"2024-04-26T21:16:25.434981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:39.450737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801403+0000","last_change":"2024-04-26T21:16:19.405677+0000","last_active":"2024-04-26T21:16:25.801403+0000","last_peered":"2024-04-26T21:16:25.801403+0000","last_clean":"2024-04-26T21:16:25.801403+0000","last_became_active":"2024-04-26T21:16:19.405168+0000","last_became_peered":"2024-04-26T21:16:19.405168+0000","last_unstale":"2024-04-26T21:16:25.801403+0000","last_undegraded":"2024-04-26T21:16:25.801403+0000","last_fullsized":"2024-04-26T21:16:25.801403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434637+0000","last_change":"2024-04-26T21:16:24.462415+0000","last_active":"2024-04-26T21:16:25.434637+0000","last_peered":"2024-04-26T21:16:25.434637+0000","last_clean":"2024-04-26T21:16:25.434637+0000","last_became_active":"2024-04-26T21:16:24.462047+0000","last_became_peered":"2024-04-26T21:16:24.462047+0000","last_unstale":"2024-04-26T21:16:25.434637+0000","last_undegraded":"2024-04-26T21:16:25.434637+0000","last_fullsized":"2024-04-26T21:16:25.434637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:50.269287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817452+0000","last_change":"2024-04-26T21:16:20.423947+0000","last_active":"2024-04-26T21:16:25.817452+0000","last_peered":"2024-04-26T21:16:25.817452+0000","last_clean":"2024-04-26T21:16:25.817452+0000","last_became_active":"2024-04-26T21:16:20.423647+0000","last_became_peered":"2024-04-26T21:16:20.423647+0000","last_unstale":"2024-04-26T21:16:25.817452+0000","last_undegraded":"2024-04-26T21:16:25.817452+0000","last_fullsized":"2024-04-26T21:16:25.817452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816645+0000","last_change":"2024-04-26T21:16:19.403292+0000","last_active":"2024-04-26T21:16:25.816645+0000","last_peered":"2024-04-26T21:16:25.816645+0000","last_clean":"2024-04-26T21:16:25.816645+0000","last_became_active":"2024-04-26T21:16:19.402784+0000","last_became_peered":"2024-04-26T21:16:19.402784+0000","last_unstale":"2024-04-26T21:16:25.816645+0000","last_undegraded":"2024-04-26T21:16:25.816645+0000","last_fullsized":"2024-04-26T21:16:25.816645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814330+0000","last_change":"2024-04-26T21:16:24.456302+0000","last_active":"2024-04-26T21:16:25.814330+0000","last_peered":"2024-04-26T21:16:25.814330+0000","last_clean":"2024-04-26T21:16:25.814330+0000","last_became_active":"2024-04-26T21:16:24.456017+0000","last_became_peered":"2024-04-26T21:16:24.456017+0000","last_unstale":"2024-04-26T21:16:25.814330+0000","last_undegraded":"2024-04-26T21:16:25.814330+0000","last_fullsized":"2024-04-26T21:16:25.814330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816540+0000","last_change":"2024-04-26T21:16:20.425747+0000","last_active":"2024-04-26T21:16:25.816540+0000","last_peered":"2024-04-26T21:16:25.816540+0000","last_clean":"2024-04-26T21:16:25.816540+0000","last_became_active":"2024-04-26T21:16:20.425488+0000","last_became_peered":"2024-04-26T21:16:20.425488+0000","last_unstale":"2024-04-26T21:16:25.816540+0000","last_undegraded":"2024-04-26T21:16:25.816540+0000","last_fullsized":"2024-04-26T21:16:25.816540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:44.971333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435140+0000","last_change":"2024-04-26T21:16:19.406087+0000","last_active":"2024-04-26T21:16:25.435140+0000","last_peered":"2024-04-26T21:16:25.435140+0000","last_clean":"2024-04-26T21:16:25.435140+0000","last_became_active":"2024-04-26T21:16:19.405864+0000","last_became_peered":"2024-04-26T21:16:19.405864+0000","last_unstale":"2024-04-26T21:16:25.435140+0000","last_undegraded":"2024-04-26T21:16:25.435140+0000","last_fullsized":"2024-04-26T21:16:25.435140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814623+0000","last_change":"2024-04-26T21:16:24.448037+0000","last_active":"2024-04-26T21:16:25.814623+0000","last_peered":"2024-04-26T21:16:25.814623+0000","last_clean":"2024-04-26T21:16:25.814623+0000","last_became_active":"2024-04-26T21:16:24.447296+0000","last_became_peered":"2024-04-26T21:16:24.447296+0000","last_unstale":"2024-04-26T21:16:25.814623+0000","last_undegraded":"2024-04-26T21:16:25.814623+0000","last_fullsized":"2024-04-26T21:16:25.814623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:07.159212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817154+0000","last_change":"2024-04-26T21:16:24.459333+0000","last_active":"2024-04-26T21:16:25.817154+0000","last_peered":"2024-04-26T21:16:25.817154+0000","last_clean":"2024-04-26T21:16:25.817154+0000","last_became_active":"2024-04-26T21:16:24.458880+0000","last_became_peered":"2024-04-26T21:16:24.458880+0000","last_unstale":"2024-04-26T21:16:25.817154+0000","last_undegraded":"2024-04-26T21:16:25.817154+0000","last_fullsized":"2024-04-26T21:16:25.817154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:31.330251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800771+0000","last_change":"2024-04-26T21:16:20.403324+0000","last_active":"2024-04-26T21:16:25.800771+0000","last_peered":"2024-04-26T21:16:25.800771+0000","last_clean":"2024-04-26T21:16:25.800771+0000","last_became_active":"2024-04-26T21:16:20.403028+0000","last_became_peered":"2024-04-26T21:16:20.403028+0000","last_unstale":"2024-04-26T21:16:25.800771+0000","last_undegraded":"2024-04-26T21:16:25.800771+0000","last_fullsized":"2024-04-26T21:16:25.800771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816007+0000","last_change":"2024-04-26T21:16:19.399594+0000","last_active":"2024-04-26T21:16:25.816007+0000","last_peered":"2024-04-26T21:16:25.816007+0000","last_clean":"2024-04-26T21:16:25.816007+0000","last_became_active":"2024-04-26T21:16:19.399283+0000","last_became_peered":"2024-04-26T21:16:19.399283+0000","last_unstale":"2024-04-26T21:16:25.816007+0000","last_undegraded":"2024-04-26T21:16:25.816007+0000","last_fullsized":"2024-04-26T21:16:25.816007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435033+0000","last_change":"2024-04-26T21:16:24.452081+0000","last_active":"2024-04-26T21:16:25.435033+0000","last_peered":"2024-04-26T21:16:25.435033+0000","last_clean":"2024-04-26T21:16:25.435033+0000","last_became_active":"2024-04-26T21:16:24.451654+0000","last_became_peered":"2024-04-26T21:16:24.451654+0000","last_unstale":"2024-04-26T21:16:25.435033+0000","last_undegraded":"2024-04-26T21:16:25.435033+0000","last_fullsized":"2024-04-26T21:16:25.435033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814302+0000","last_change":"2024-04-26T21:16:20.412643+0000","last_active":"2024-04-26T21:16:25.814302+0000","last_peered":"2024-04-26T21:16:25.814302+0000","last_clean":"2024-04-26T21:16:25.814302+0000","last_became_active":"2024-04-26T21:16:20.412229+0000","last_became_peered":"2024-04-26T21:16:20.412229+0000","last_unstale":"2024-04-26T21:16:25.814302+0000","last_undegraded":"2024-04-26T21:16:25.814302+0000","last_fullsized":"2024-04-26T21:16:25.814302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814684+0000","last_change":"2024-04-26T21:16:19.404756+0000","last_active":"2024-04-26T21:16:25.814684+0000","last_peered":"2024-04-26T21:16:25.814684+0000","last_clean":"2024-04-26T21:16:25.814684+0000","last_became_active":"2024-04-26T21:16:19.404480+0000","last_became_peered":"2024-04-26T21:16:19.404480+0000","last_unstale":"2024-04-26T21:16:25.814684+0000","last_undegraded":"2024-04-26T21:16:25.814684+0000","last_fullsized":"2024-04-26T21:16:25.814684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:06.128835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434093+0000","last_change":"2024-04-26T21:16:19.409681+0000","last_active":"2024-04-26T21:16:25.434093+0000","last_peered":"2024-04-26T21:16:25.434093+0000","last_clean":"2024-04-26T21:16:25.434093+0000","last_became_active":"2024-04-26T21:16:19.409425+0000","last_became_peered":"2024-04-26T21:16:19.409425+0000","last_unstale":"2024-04-26T21:16:25.434093+0000","last_undegraded":"2024-04-26T21:16:25.434093+0000","last_fullsized":"2024-04-26T21:16:25.434093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816993+0000","last_change":"2024-04-26T21:16:20.414103+0000","last_active":"2024-04-26T21:16:25.816993+0000","last_peered":"2024-04-26T21:16:25.816993+0000","last_clean":"2024-04-26T21:16:25.816993+0000","last_became_active":"2024-04-26T21:16:20.413448+0000","last_became_peered":"2024-04-26T21:16:20.413448+0000","last_unstale":"2024-04-26T21:16:25.816993+0000","last_undegraded":"2024-04-26T21:16:25.816993+0000","last_fullsized":"2024-04-26T21:16:25.816993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814945+0000","last_change":"2024-04-26T21:16:24.460713+0000","last_active":"2024-04-26T21:16:25.814945+0000","last_peered":"2024-04-26T21:16:25.814945+0000","last_clean":"2024-04-26T21:16:25.814945+0000","last_became_active":"2024-04-26T21:16:24.460386+0000","last_became_peered":"2024-04-26T21:16:24.460386+0000","last_unstale":"2024-04-26T21:16:25.814945+0000","last_undegraded":"2024-04-26T21:16:25.814945+0000","last_fullsized":"2024-04-26T21:16:25.814945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:04.230303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815685+0000","last_change":"2024-04-26T21:16:19.406024+0000","last_active":"2024-04-26T21:16:25.815685+0000","last_peered":"2024-04-26T21:16:25.815685+0000","last_clean":"2024-04-26T21:16:25.815685+0000","last_became_active":"2024-04-26T21:16:19.405711+0000","last_became_peered":"2024-04-26T21:16:19.405711+0000","last_unstale":"2024-04-26T21:16:25.815685+0000","last_undegraded":"2024-04-26T21:16:25.815685+0000","last_fullsized":"2024-04-26T21:16:25.815685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:36.055875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435119+0000","last_change":"2024-04-26T21:16:20.418241+0000","last_active":"2024-04-26T21:16:25.435119+0000","last_peered":"2024-04-26T21:16:25.435119+0000","last_clean":"2024-04-26T21:16:25.435119+0000","last_became_active":"2024-04-26T21:16:20.417321+0000","last_became_peered":"2024-04-26T21:16:20.417321+0000","last_unstale":"2024-04-26T21:16:25.435119+0000","last_undegraded":"2024-04-26T21:16:25.435119+0000","last_fullsized":"2024-04-26T21:16:25.435119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:11.862489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815612+0000","last_change":"2024-04-26T21:16:24.459831+0000","last_active":"2024-04-26T21:16:25.815612+0000","last_peered":"2024-04-26T21:16:25.815612+0000","last_clean":"2024-04-26T21:16:25.815612+0000","last_became_active":"2024-04-26T21:16:24.459065+0000","last_became_peered":"2024-04-26T21:16:24.459065+0000","last_unstale":"2024-04-26T21:16:25.815612+0000","last_undegraded":"2024-04-26T21:16:25.815612+0000","last_fullsized":"2024-04-26T21:16:25.815612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:22.852921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433775+0000","last_change":"2024-04-26T21:16:20.409734+0000","last_active":"2024-04-26T21:16:25.433775+0000","last_peered":"2024-04-26T21:16:25.433775+0000","last_clean":"2024-04-26T21:16:25.433775+0000","last_became_active":"2024-04-26T21:16:20.409468+0000","last_became_peered":"2024-04-26T21:16:20.409468+0000","last_unstale":"2024-04-26T21:16:25.433775+0000","last_undegraded":"2024-04-26T21:16:25.433775+0000","last_fullsized":"2024-04-26T21:16:25.433775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814266+0000","last_change":"2024-04-26T21:16:20.415585+0000","last_active":"2024-04-26T21:16:25.814266+0000","last_peered":"2024-04-26T21:16:25.814266+0000","last_clean":"2024-04-26T21:16:25.814266+0000","last_became_active":"2024-04-26T21:16:20.415303+0000","last_became_peered":"2024-04-26T21:16:20.415303+0000","last_unstale":"2024-04-26T21:16:25.814266+0000","last_undegraded":"2024-04-26T21:16:25.814266+0000","last_fullsized":"2024-04-26T21:16:25.814266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:19:56.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816116+0000","last_change":"2024-04-26T21:16:20.420522+0000","last_active":"2024-04-26T21:16:25.816116+0000","last_peered":"2024-04-26T21:16:25.816116+0000","last_clean":"2024-04-26T21:16:25.816116+0000","last_became_active":"2024-04-26T21:16:20.420320+0000","last_became_peered":"2024-04-26T21:16:20.420320+0000","last_unstale":"2024-04-26T21:16:25.816116+0000","last_undegraded":"2024-04-26T21:16:25.816116+0000","last_fullsized":"2024-04-26T21:16:25.816116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816909+0000","last_change":"2024-04-26T21:16:20.414468+0000","last_active":"2024-04-26T21:16:25.816909+0000","last_peered":"2024-04-26T21:16:25.816909+0000","last_clean":"2024-04-26T21:16:25.816909+0000","last_became_active":"2024-04-26T21:16:20.413736+0000","last_became_peered":"2024-04-26T21:16:20.413736+0000","last_unstale":"2024-04-26T21:16:25.816909+0000","last_undegraded":"2024-04-26T21:16:25.816909+0000","last_fullsized":"2024-04-26T21:16:25.816909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815404+0000","last_change":"2024-04-26T21:16:20.409323+0000","last_active":"2024-04-26T21:16:25.815404+0000","last_peered":"2024-04-26T21:16:25.815404+0000","last_clean":"2024-04-26T21:16:25.815404+0000","last_became_active":"2024-04-26T21:16:20.408990+0000","last_became_peered":"2024-04-26T21:16:20.408990+0000","last_unstale":"2024-04-26T21:16:25.815404+0000","last_undegraded":"2024-04-26T21:16:25.815404+0000","last_fullsized":"2024-04-26T21:16:25.815404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801281+0000","last_change":"2024-04-26T21:16:20.404357+0000","last_active":"2024-04-26T21:16:25.801281+0000","last_peered":"2024-04-26T21:16:25.801281+0000","last_clean":"2024-04-26T21:16:25.801281+0000","last_became_active":"2024-04-26T21:16:20.404167+0000","last_became_peered":"2024-04-26T21:16:20.404167+0000","last_unstale":"2024-04-26T21:16:25.801281+0000","last_undegraded":"2024-04-26T21:16:25.801281+0000","last_fullsized":"2024-04-26T21:16:25.801281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434733+0000","last_change":"2024-04-26T21:16:20.425686+0000","last_active":"2024-04-26T21:16:25.434733+0000","last_peered":"2024-04-26T21:16:25.434733+0000","last_clean":"2024-04-26T21:16:25.434733+0000","last_became_active":"2024-04-26T21:16:20.425371+0000","last_became_peered":"2024-04-26T21:16:20.425371+0000","last_unstale":"2024-04-26T21:16:25.434733+0000","last_undegraded":"2024-04-26T21:16:25.434733+0000","last_fullsized":"2024-04-26T21:16:25.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815714+0000","last_change":"2024-04-26T21:16:20.409302+0000","last_active":"2024-04-26T21:16:25.815714+0000","last_peered":"2024-04-26T21:16:25.815714+0000","last_clean":"2024-04-26T21:16:25.815714+0000","last_became_active":"2024-04-26T21:16:20.409004+0000","last_became_peered":"2024-04-26T21:16:20.409004+0000","last_unstale":"2024-04-26T21:16:25.815714+0000","last_undegraded":"2024-04-26T21:16:25.815714+0000","last_fullsized":"2024-04-26T21:16:25.815714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815954+0000","last_change":"2024-04-26T21:16:20.422765+0000","last_active":"2024-04-26T21:16:25.815954+0000","last_peered":"2024-04-26T21:16:25.815954+0000","last_clean":"2024-04-26T21:16:25.815954+0000","last_became_active":"2024-04-26T21:16:20.422225+0000","last_became_peered":"2024-04-26T21:16:20.422225+0000","last_unstale":"2024-04-26T21:16:25.815954+0000","last_undegraded":"2024-04-26T21:16:25.815954+0000","last_fullsized":"2024-04-26T21:16:25.815954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814587+0000","last_change":"2024-04-26T21:16:20.410383+0000","last_active":"2024-04-26T21:16:25.814587+0000","last_peered":"2024-04-26T21:16:25.814587+0000","last_clean":"2024-04-26T21:16:25.814587+0000","last_became_active":"2024-04-26T21:16:20.409668+0000","last_became_peered":"2024-04-26T21:16:20.409668+0000","last_unstale":"2024-04-26T21:16:25.814587+0000","last_undegraded":"2024-04-26T21:16:25.814587+0000","last_fullsized":"2024-04-26T21:16:25.814587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816058+0000","last_change":"2024-04-26T21:16:20.428016+0000","last_active":"2024-04-26T21:16:25.816058+0000","last_peered":"2024-04-26T21:16:25.816058+0000","last_clean":"2024-04-26T21:16:25.816058+0000","last_became_active":"2024-04-26T21:16:20.427562+0000","last_became_peered":"2024-04-26T21:16:20.427562+0000","last_unstale":"2024-04-26T21:16:25.816058+0000","last_undegraded":"2024-04-26T21:16:25.816058+0000","last_fullsized":"2024-04-26T21:16:25.816058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816756+0000","last_change":"2024-04-26T21:16:20.425316+0000","last_active":"2024-04-26T21:16:25.816756+0000","last_peered":"2024-04-26T21:16:25.816756+0000","last_clean":"2024-04-26T21:16:25.816756+0000","last_became_active":"2024-04-26T21:16:20.425008+0000","last_became_peered":"2024-04-26T21:16:20.425008+0000","last_unstale":"2024-04-26T21:16:25.816756+0000","last_undegraded":"2024-04-26T21:16:25.816756+0000","last_fullsized":"2024-04-26T21:16:25.816756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434193+0000","last_change":"2024-04-26T21:16:20.406211+0000","last_active":"2024-04-26T21:16:25.434193+0000","last_peered":"2024-04-26T21:16:25.434193+0000","last_clean":"2024-04-26T21:16:25.434193+0000","last_became_active":"2024-04-26T21:16:20.405903+0000","last_became_peered":"2024-04-26T21:16:20.405903+0000","last_unstale":"2024-04-26T21:16:25.434193+0000","last_undegraded":"2024-04-26T21:16:25.434193+0000","last_fullsized":"2024-04-26T21:16:25.434193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436716+0000","last_change":"2024-04-26T21:16:20.407047+0000","last_active":"2024-04-26T21:16:25.436716+0000","last_peered":"2024-04-26T21:16:25.436716+0000","last_clean":"2024-04-26T21:16:25.436716+0000","last_became_active":"2024-04-26T21:16:20.404541+0000","last_became_peered":"2024-04-26T21:16:20.404541+0000","last_unstale":"2024-04-26T21:16:25.436716+0000","last_undegraded":"2024-04-26T21:16:25.436716+0000","last_fullsized":"2024-04-26T21:16:25.436716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:09.604970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815290+0000","last_change":"2024-04-26T21:16:20.398199+0000","last_active":"2024-04-26T21:16:25.815290+0000","last_peered":"2024-04-26T21:16:25.815290+0000","last_clean":"2024-04-26T21:16:25.815290+0000","last_became_active":"2024-04-26T21:16:20.397910+0000","last_became_peered":"2024-04-26T21:16:20.397910+0000","last_unstale":"2024-04-26T21:16:25.815290+0000","last_undegraded":"2024-04-26T21:16:25.815290+0000","last_fullsized":"2024-04-26T21:16:25.815290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:09.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816910+0000","last_change":"2024-04-26T21:16:20.433837+0000","last_active":"2024-04-26T21:16:25.816910+0000","last_peered":"2024-04-26T21:16:25.816910+0000","last_clean":"2024-04-26T21:16:25.816910+0000","last_became_active":"2024-04-26T21:16:20.433536+0000","last_became_peered":"2024-04-26T21:16:20.433536+0000","last_unstale":"2024-04-26T21:16:25.816910+0000","last_undegraded":"2024-04-26T21:16:25.816910+0000","last_fullsized":"2024-04-26T21:16:25.816910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:58.416107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815843+0000","last_change":"2024-04-26T21:16:20.422532+0000","last_active":"2024-04-26T21:16:25.815843+0000","last_peered":"2024-04-26T21:16:25.815843+0000","last_clean":"2024-04-26T21:16:25.815843+0000","last_became_active":"2024-04-26T21:16:20.421767+0000","last_became_peered":"2024-04-26T21:16:20.421767+0000","last_unstale":"2024-04-26T21:16:25.815843+0000","last_undegraded":"2024-04-26T21:16:25.815843+0000","last_fullsized":"2024-04-26T21:16:25.815843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800845+0000","last_change":"2024-04-26T21:16:20.413673+0000","last_active":"2024-04-26T21:16:25.800845+0000","last_peered":"2024-04-26T21:16:25.800845+0000","last_clean":"2024-04-26T21:16:25.800845+0000","last_became_active":"2024-04-26T21:16:20.413331+0000","last_became_peered":"2024-04-26T21:16:20.413331+0000","last_unstale":"2024-04-26T21:16:25.800845+0000","last_undegraded":"2024-04-26T21:16:25.800845+0000","last_fullsized":"2024-04-26T21:16:25.800845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816767+0000","last_change":"2024-04-26T21:16:20.410440+0000","last_active":"2024-04-26T21:16:25.816767+0000","last_peered":"2024-04-26T21:16:25.816767+0000","last_clean":"2024-04-26T21:16:25.816767+0000","last_became_active":"2024-04-26T21:16:20.410116+0000","last_became_peered":"2024-04-26T21:16:20.410116+0000","last_unstale":"2024-04-26T21:16:25.816767+0000","last_undegraded":"2024-04-26T21:16:25.816767+0000","last_fullsized":"2024-04-26T21:16:25.816767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:27.807333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814886+0000","last_change":"2024-04-26T21:16:20.404907+0000","last_active":"2024-04-26T21:16:25.814886+0000","last_peered":"2024-04-26T21:16:25.814886+0000","last_clean":"2024-04-26T21:16:25.814886+0000","last_became_active":"2024-04-26T21:16:20.404560+0000","last_became_peered":"2024-04-26T21:16:20.404560+0000","last_unstale":"2024-04-26T21:16:25.814886+0000","last_undegraded":"2024-04-26T21:16:25.814886+0000","last_fullsized":"2024-04-26T21:16:25.814886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434871+0000","last_change":"2024-04-26T21:16:20.423831+0000","last_active":"2024-04-26T21:16:25.434871+0000","last_peered":"2024-04-26T21:16:25.434871+0000","last_clean":"2024-04-26T21:16:25.434871+0000","last_became_active":"2024-04-26T21:16:20.423542+0000","last_became_peered":"2024-04-26T21:16:20.423542+0000","last_unstale":"2024-04-26T21:16:25.434871+0000","last_undegraded":"2024-04-26T21:16:25.434871+0000","last_fullsized":"2024-04-26T21:16:25.434871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:43.515453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434469+0000","last_change":"2024-04-26T21:16:20.426806+0000","last_active":"2024-04-26T21:16:25.434469+0000","last_peered":"2024-04-26T21:16:25.434469+0000","last_clean":"2024-04-26T21:16:25.434469+0000","last_became_active":"2024-04-26T21:16:20.426446+0000","last_became_peered":"2024-04-26T21:16:20.426446+0000","last_unstale":"2024-04-26T21:16:25.434469+0000","last_undegraded":"2024-04-26T21:16:25.434469+0000","last_fullsized":"2024-04-26T21:16:25.434469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434639+0000","last_change":"2024-04-26T21:16:20.428440+0000","last_active":"2024-04-26T21:16:25.434639+0000","last_peered":"2024-04-26T21:16:25.434639+0000","last_clean":"2024-04-26T21:16:25.434639+0000","last_became_active":"2024-04-26T21:16:20.428074+0000","last_became_peered":"2024-04-26T21:16:20.428074+0000","last_unstale":"2024-04-26T21:16:25.434639+0000","last_undegraded":"2024-04-26T21:16:25.434639+0000","last_fullsized":"2024-04-26T21:16:25.434639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436896+0000","last_change":"2024-04-26T21:16:20.427736+0000","last_active":"2024-04-26T21:16:25.436896+0000","last_peered":"2024-04-26T21:16:25.436896+0000","last_clean":"2024-04-26T21:16:25.436896+0000","last_became_active":"2024-04-26T21:16:20.424657+0000","last_became_peered":"2024-04-26T21:16:20.424657+0000","last_unstale":"2024-04-26T21:16:25.436896+0000","last_undegraded":"2024-04-26T21:16:25.436896+0000","last_fullsized":"2024-04-26T21:16:25.436896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:41.767752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814210+0000","last_change":"2024-04-26T21:16:20.425895+0000","last_active":"2024-04-26T21:16:25.814210+0000","last_peered":"2024-04-26T21:16:25.814210+0000","last_clean":"2024-04-26T21:16:25.814210+0000","last_became_active":"2024-04-26T21:16:20.425580+0000","last_became_peered":"2024-04-26T21:16:20.425580+0000","last_unstale":"2024-04-26T21:16:25.814210+0000","last_undegraded":"2024-04-26T21:16:25.814210+0000","last_fullsized":"2024-04-26T21:16:25.814210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435717+0000","last_change":"2024-04-26T21:16:20.421664+0000","last_active":"2024-04-26T21:16:25.435717+0000","last_peered":"2024-04-26T21:16:25.435717+0000","last_clean":"2024-04-26T21:16:25.435717+0000","last_became_active":"2024-04-26T21:16:20.421311+0000","last_became_peered":"2024-04-26T21:16:20.421311+0000","last_unstale":"2024-04-26T21:16:25.435717+0000","last_undegraded":"2024-04-26T21:16:25.435717+0000","last_fullsized":"2024-04-26T21:16:25.435717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815976+0000","last_change":"2024-04-26T21:16:20.427879+0000","last_active":"2024-04-26T21:16:25.815976+0000","last_peered":"2024-04-26T21:16:25.815976+0000","last_clean":"2024-04-26T21:16:25.815976+0000","last_became_active":"2024-04-26T21:16:20.426632+0000","last_became_peered":"2024-04-26T21:16:20.426632+0000","last_unstale":"2024-04-26T21:16:25.815976+0000","last_undegraded":"2024-04-26T21:16:25.815976+0000","last_fullsized":"2024-04-26T21:16:25.815976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436067+0000","last_change":"2024-04-26T21:16:20.401403+0000","last_active":"2024-04-26T21:16:25.436067+0000","last_peered":"2024-04-26T21:16:25.436067+0000","last_clean":"2024-04-26T21:16:25.436067+0000","last_became_active":"2024-04-26T21:16:20.401084+0000","last_became_peered":"2024-04-26T21:16:20.401084+0000","last_unstale":"2024-04-26T21:16:25.436067+0000","last_undegraded":"2024-04-26T21:16:25.436067+0000","last_fullsized":"2024-04-26T21:16:25.436067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816320+0000","last_change":"2024-04-26T21:16:20.434210+0000","last_active":"2024-04-26T21:16:25.816320+0000","last_peered":"2024-04-26T21:16:25.816320+0000","last_clean":"2024-04-26T21:16:25.816320+0000","last_became_active":"2024-04-26T21:16:20.433607+0000","last_became_peered":"2024-04-26T21:16:20.433607+0000","last_unstale":"2024-04-26T21:16:25.816320+0000","last_undegraded":"2024-04-26T21:16:25.816320+0000","last_fullsized":"2024-04-26T21:16:25.816320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817053+0000","last_change":"2024-04-26T21:16:20.419582+0000","last_active":"2024-04-26T21:16:25.817053+0000","last_peered":"2024-04-26T21:16:25.817053+0000","last_clean":"2024-04-26T21:16:25.817053+0000","last_became_active":"2024-04-26T21:16:20.419259+0000","last_became_peered":"2024-04-26T21:16:20.419259+0000","last_unstale":"2024-04-26T21:16:25.817053+0000","last_undegraded":"2024-04-26T21:16:25.817053+0000","last_fullsized":"2024-04-26T21:16:25.817053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801509+0000","last_change":"2024-04-26T21:16:20.405606+0000","last_active":"2024-04-26T21:16:25.801509+0000","last_peered":"2024-04-26T21:16:25.801509+0000","last_clean":"2024-04-26T21:16:25.801509+0000","last_became_active":"2024-04-26T21:16:20.405265+0000","last_became_peered":"2024-04-26T21:16:20.405265+0000","last_unstale":"2024-04-26T21:16:25.801509+0000","last_undegraded":"2024-04-26T21:16:25.801509+0000","last_fullsized":"2024-04-26T21:16:25.801509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436755+0000","last_change":"2024-04-26T21:16:20.415452+0000","last_active":"2024-04-26T21:16:25.436755+0000","last_peered":"2024-04-26T21:16:25.436755+0000","last_clean":"2024-04-26T21:16:25.436755+0000","last_became_active":"2024-04-26T21:16:20.414915+0000","last_became_peered":"2024-04-26T21:16:20.414915+0000","last_unstale":"2024-04-26T21:16:25.436755+0000","last_undegraded":"2024-04-26T21:16:25.436755+0000","last_fullsized":"2024-04-26T21:16:25.436755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:58.416107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":110683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":701563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:16:39.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:16:39.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.727+0000 7f4741400640 1 Processor -- start 2024-04-26T21:16:39.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.727+0000 7f4741400640 1 -- start start 2024-04-26T21:16:39.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.727+0000 7f4741400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f473c160ac0 0x7f473c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.727+0000 7f4741400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c146870 0x7f473c0d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.727+0000 7f4741400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473c0b3da0 con 0x7f473c146490 2024-04-26T21:16:39.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.727+0000 7f4741400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f473c160fa0 con 0x7f473c160ac0 2024-04-26T21:16:39.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.727+0000 7f4741400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f473c161280 con 0x7f473c146870 2024-04-26T21:16:39.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473a800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f473c146490 0x7f473c0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34810/0 (socket says 172.21.15.106:34810) 2024-04-26T21:16:39.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473a800640 1 -- 172.21.15.106:0/4271395979 learned_addr learned my addr 172.21.15.106:0/4271395979 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473b200640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c146870 0x7f473c0d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739e00640 1 --2- 172.21.15.106:0/4271395979 >> v2:172.21.15.112:3300/0 conn(0x7f473c160ac0 0x7f473c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2865134758 0 0) 0x7f473c0b3da0 con 0x7f473c146490 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4720003530 con 0x7f473c146490 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3154984467 0 0) 0x7f4720003530 con 0x7f473c146490 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c146870 msgr2=0x7f473c0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c146870 0x7f473c0d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 >> v2:172.21.15.112:3300/0 conn(0x7f473c160ac0 msgr2=0x7f473c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 --2- 172.21.15.106:0/4271395979 >> v2:172.21.15.112:3300/0 conn(0x7f473c160ac0 0x7f473c15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c161560 con 0x7f473c146490 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f47240016a0 con 0x7f473c146490 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 >> v1:172.21.15.106:6789/0 conn(0x7f473c146490 legacy=0x7f473c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f4720003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c146870 0x7f4720004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4720004d50 0x7f47200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f473c160fa0 con 0x7f47200039c0 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f473c161280 con 0x7f4720004d50 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f472000b9d0 con 0x7f473c146870 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473a800640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f4720003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f4739e00640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c146870 0x7f4720004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473b200640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4720004d50 0x7f47200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473a800640 1 -- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c146870 msgr2=0x7f4720004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473a800640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c146870 0x7f4720004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473a800640 1 -- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4720004d50 msgr2=0x7f47200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473a800640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4720004d50 0x7f47200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.731+0000 7f473a800640 1 -- 172.21.15.106:0/4271395979 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4720003530 con 0x7f47200039c0 2024-04-26T21:16:39.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f473a800640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f4720003de0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f472400c210 tx=0x7f472401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723faaa39ababb32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:39.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724007d70 con 0x7f47200039c0 2024-04-26T21:16:39.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240a9020 con 0x7f47200039c0 2024-04-26T21:16:39.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4739400640 1 -- 172.21.15.106:0/4271395979 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724005b20 con 0x7f47200039c0 2024-04-26T21:16:39.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 -- 172.21.15.106:0/4271395979 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 msgr2=0x7f4720003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 --2- 172.21.15.106:0/4271395979 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f4720003de0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f472400c210 tx=0x7f472401cca0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f473b200640 1 -- 172.21.15.106:0/4271395979 reap_dead start 2024-04-26T21:16:39.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 -- 172.21.15.106:0/4271395979 shutdown_connections 2024-04-26T21:16:39.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 -- 172.21.15.106:0/4271395979 >> 172.21.15.106:0/4271395979 conn(0x7f473c068340 msgr2=0x7f473c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:39.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 -- 172.21.15.106:0/4271395979 shutdown_connections 2024-04-26T21:16:39.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 -- 172.21.15.106:0/4271395979 wait complete. 2024-04-26T21:16:39.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 Processor -- start 2024-04-26T21:16:39.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 -- start start 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f473c164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f473c0b21c0 0x7f473c143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c1401d0 0x7f473c140650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f473c0b4940 con 0x7f47200039c0 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f473c0b47c0 con 0x7f473c0b21c0 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.735+0000 7f4741400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f473c0b4ac0 con 0x7f473c1401d0 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f473c164dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f473c164dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40852/0 (socket says 172.21.15.106:40852) 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473a800640 1 -- 172.21.15.106:0/1959456621 learned_addr learned my addr 172.21.15.106:0/1959456621 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4739e00640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f473c0b21c0 0x7f473c143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473b200640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c1401d0 0x7f473c140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473a800640 1 -- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c1401d0 msgr2=0x7f473c140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473a800640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c1401d0 0x7f473c140650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473a800640 1 -- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f473c0b21c0 msgr2=0x7f473c143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473a800640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f473c0b21c0 0x7f473c143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473a800640 1 -- 172.21.15.106:0/1959456621 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c165bd0 con 0x7f47200039c0 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4739e00640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f473c0b21c0 0x7f473c143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473b200640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c1401d0 0x7f473c140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f473a800640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f473c164dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47240ab040 tx=0x7f4720005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4732a00640 1 -- 172.21.15.106:0/1959456621 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724005d00 con 0x7f47200039c0 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4732a00640 1 -- 172.21.15.106:0/1959456621 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240a5870 con 0x7f47200039c0 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4732a00640 1 -- 172.21.15.106:0/1959456621 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240a5c40 con 0x7f47200039c0 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c165610 con 0x7f47200039c0 2024-04-26T21:16:39.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c161ce0 con 0x7f47200039c0 2024-04-26T21:16:39.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473c069400 con 0x7f47200039c0 2024-04-26T21:16:39.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4732a00640 1 -- 172.21.15.106:0/1959456621 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47240047f0 con 0x7f47200039c0 2024-04-26T21:16:39.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4732a00640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4718068380 0x7f471806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:39.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.739+0000 7f4732a00640 1 -- 172.21.15.106:0/1959456621 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f47241205d0 con 0x7f47200039c0 2024-04-26T21:16:39.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.743+0000 7f4739e00640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4718068380 0x7f471806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:39.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.743+0000 7f4739e00640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4718068380 0x7f471806a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f473c1571c0 tx=0x7f472c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:39.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.743+0000 7f4732a00640 1 -- 172.21.15.106:0/1959456621 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f47240169b0 con 0x7f47200039c0 2024-04-26T21:16:39.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.899+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f473c073d70 con 0x7f4718068380 2024-04-26T21:16:39.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.907+0000 7f4732a00640 1 -- 172.21.15.106:0/1959456621 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332562 (secure 0 0 0) 0x7f473c073d70 con 0x7f4718068380 2024-04-26T21:16:39.913 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:39.915 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4718068380 msgr2=0x7f471806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4718068380 0x7f471806a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f473c1571c0 tx=0x7f472c008040 comp rx=0 tx=0).stop 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 msgr2=0x7f473c164dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f473c164dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47240ab040 tx=0x7f4720005840 comp rx=0 tx=0).stop 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 shutdown_connections 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f473c0b21c0 0x7f473c143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4718068380 0x7f471806a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f473c1401d0 0x7f473c140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 --2- 172.21.15.106:0/1959456621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47200039c0 0x7f473c164dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:39.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 >> 172.21.15.106:0/1959456621 conn(0x7f473c068340 msgr2=0x7f473c15ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:39.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 shutdown_connections 2024-04-26T21:16:39.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:39.911+0000 7f4741400640 1 -- 172.21.15.106:0/1959456621 wait complete. 2024-04-26T21:16:39.933 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-26T21:16:38.293824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219604,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755116,"statfs":{"total":773094113280,"available":772869238784,"internally_reserved":0,"allocated":3514368,"data_stored":2074472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002888"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817484+0000","last_change":"2024-04-26T21:16:19.412305+0000","last_active":"2024-04-26T21:16:25.817484+0000","last_peered":"2024-04-26T21:16:25.817484+0000","last_clean":"2024-04-26T21:16:25.817484+0000","last_became_active":"2024-04-26T21:16:19.411559+0000","last_became_peered":"2024-04-26T21:16:19.411559+0000","last_unstale":"2024-04-26T21:16:25.817484+0000","last_undegraded":"2024-04-26T21:16:25.817484+0000","last_fullsized":"2024-04-26T21:16:25.817484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:31.811132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815514+0000","last_change":"2024-04-26T21:16:20.411882+0000","last_active":"2024-04-26T21:16:25.815514+0000","last_peered":"2024-04-26T21:16:25.815514+0000","last_clean":"2024-04-26T21:16:25.815514+0000","last_became_active":"2024-04-26T21:16:20.411587+0000","last_became_peered":"2024-04-26T21:16:20.411587+0000","last_unstale":"2024-04-26T21:16:25.815514+0000","last_undegraded":"2024-04-26T21:16:25.815514+0000","last_fullsized":"2024-04-26T21:16:25.815514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814423+0000","last_change":"2024-04-26T21:16:24.448323+0000","last_active":"2024-04-26T21:16:25.814423+0000","last_peered":"2024-04-26T21:16:25.814423+0000","last_clean":"2024-04-26T21:16:25.814423+0000","last_became_active":"2024-04-26T21:16:24.447718+0000","last_became_peered":"2024-04-26T21:16:24.447718+0000","last_unstale":"2024-04-26T21:16:25.814423+0000","last_undegraded":"2024-04-26T21:16:25.814423+0000","last_fullsized":"2024-04-26T21:16:25.814423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:58.709336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815628+0000","last_change":"2024-04-26T21:16:19.413460+0000","last_active":"2024-04-26T21:16:25.815628+0000","last_peered":"2024-04-26T21:16:25.815628+0000","last_clean":"2024-04-26T21:16:25.815628+0000","last_became_active":"2024-04-26T21:16:19.413146+0000","last_became_peered":"2024-04-26T21:16:19.413146+0000","last_unstale":"2024-04-26T21:16:25.815628+0000","last_undegraded":"2024-04-26T21:16:25.815628+0000","last_fullsized":"2024-04-26T21:16:25.815628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817398+0000","last_change":"2024-04-26T21:16:20.424236+0000","last_active":"2024-04-26T21:16:25.817398+0000","last_peered":"2024-04-26T21:16:25.817398+0000","last_clean":"2024-04-26T21:16:25.817398+0000","last_became_active":"2024-04-26T21:16:20.423996+0000","last_became_peered":"2024-04-26T21:16:20.423996+0000","last_unstale":"2024-04-26T21:16:25.817398+0000","last_undegraded":"2024-04-26T21:16:25.817398+0000","last_fullsized":"2024-04-26T21:16:25.817398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434335+0000","last_change":"2024-04-26T21:16:24.463491+0000","last_active":"2024-04-26T21:16:25.434335+0000","last_peered":"2024-04-26T21:16:25.434335+0000","last_clean":"2024-04-26T21:16:25.434335+0000","last_became_active":"2024-04-26T21:16:24.463053+0000","last_became_peered":"2024-04-26T21:16:24.463053+0000","last_unstale":"2024-04-26T21:16:25.434335+0000","last_undegraded":"2024-04-26T21:16:25.434335+0000","last_fullsized":"2024-04-26T21:16:25.434335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:29.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436569+0000","last_change":"2024-04-26T21:16:19.411595+0000","last_active":"2024-04-26T21:16:25.436569+0000","last_peered":"2024-04-26T21:16:25.436569+0000","last_clean":"2024-04-26T21:16:25.436569+0000","last_became_active":"2024-04-26T21:16:19.411220+0000","last_became_peered":"2024-04-26T21:16:19.411220+0000","last_unstale":"2024-04-26T21:16:25.436569+0000","last_undegraded":"2024-04-26T21:16:25.436569+0000","last_fullsized":"2024-04-26T21:16:25.436569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816434+0000","last_change":"2024-04-26T21:16:20.426594+0000","last_active":"2024-04-26T21:16:25.816434+0000","last_peered":"2024-04-26T21:16:25.816434+0000","last_clean":"2024-04-26T21:16:25.816434+0000","last_became_active":"2024-04-26T21:16:20.426300+0000","last_became_peered":"2024-04-26T21:16:20.426300+0000","last_unstale":"2024-04-26T21:16:25.816434+0000","last_undegraded":"2024-04-26T21:16:25.816434+0000","last_fullsized":"2024-04-26T21:16:25.816434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435135+0000","last_change":"2024-04-26T21:16:24.461980+0000","last_active":"2024-04-26T21:16:25.435135+0000","last_peered":"2024-04-26T21:16:25.435135+0000","last_clean":"2024-04-26T21:16:25.435135+0000","last_became_active":"2024-04-26T21:16:24.461244+0000","last_became_peered":"2024-04-26T21:16:24.461244+0000","last_unstale":"2024-04-26T21:16:25.435135+0000","last_undegraded":"2024-04-26T21:16:25.435135+0000","last_fullsized":"2024-04-26T21:16:25.435135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:49.007056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436320+0000","last_change":"2024-04-26T21:16:19.413076+0000","last_active":"2024-04-26T21:16:25.436320+0000","last_peered":"2024-04-26T21:16:25.436320+0000","last_clean":"2024-04-26T21:16:25.436320+0000","last_became_active":"2024-04-26T21:16:19.412710+0000","last_became_peered":"2024-04-26T21:16:19.412710+0000","last_unstale":"2024-04-26T21:16:25.436320+0000","last_undegraded":"2024-04-26T21:16:25.436320+0000","last_fullsized":"2024-04-26T21:16:25.436320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:56.575835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816409+0000","last_change":"2024-04-26T21:16:20.421335+0000","last_active":"2024-04-26T21:16:25.816409+0000","last_peered":"2024-04-26T21:16:25.816409+0000","last_clean":"2024-04-26T21:16:25.816409+0000","last_became_active":"2024-04-26T21:16:20.420893+0000","last_became_peered":"2024-04-26T21:16:20.420893+0000","last_unstale":"2024-04-26T21:16:25.816409+0000","last_undegraded":"2024-04-26T21:16:25.816409+0000","last_fullsized":"2024-04-26T21:16:25.816409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:09.604970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434983+0000","last_change":"2024-04-26T21:16:24.457306+0000","last_active":"2024-04-26T21:16:25.434983+0000","last_peered":"2024-04-26T21:16:25.434983+0000","last_clean":"2024-04-26T21:16:25.434983+0000","last_became_active":"2024-04-26T21:16:24.456786+0000","last_became_peered":"2024-04-26T21:16:24.456786+0000","last_unstale":"2024-04-26T21:16:25.434983+0000","last_undegraded":"2024-04-26T21:16:25.434983+0000","last_fullsized":"2024-04-26T21:16:25.434983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:07.354698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433876+0000","last_change":"2024-04-26T21:16:20.407919+0000","last_active":"2024-04-26T21:16:25.433876+0000","last_peered":"2024-04-26T21:16:25.433876+0000","last_clean":"2024-04-26T21:16:25.433876+0000","last_became_active":"2024-04-26T21:16:20.405803+0000","last_became_peered":"2024-04-26T21:16:20.405803+0000","last_unstale":"2024-04-26T21:16:25.433876+0000","last_undegraded":"2024-04-26T21:16:25.433876+0000","last_fullsized":"2024-04-26T21:16:25.433876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436225+0000","last_change":"2024-04-26T21:16:19.408886+0000","last_active":"2024-04-26T21:16:25.436225+0000","last_peered":"2024-04-26T21:16:25.436225+0000","last_clean":"2024-04-26T21:16:25.436225+0000","last_became_active":"2024-04-26T21:16:19.408563+0000","last_became_peered":"2024-04-26T21:16:19.408563+0000","last_unstale":"2024-04-26T21:16:25.436225+0000","last_undegraded":"2024-04-26T21:16:25.436225+0000","last_fullsized":"2024-04-26T21:16:25.436225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436044+0000","last_change":"2024-04-26T21:16:24.463322+0000","last_active":"2024-04-26T21:16:25.436044+0000","last_peered":"2024-04-26T21:16:25.436044+0000","last_clean":"2024-04-26T21:16:25.436044+0000","last_became_active":"2024-04-26T21:16:24.462885+0000","last_became_peered":"2024-04-26T21:16:24.462885+0000","last_unstale":"2024-04-26T21:16:25.436044+0000","last_undegraded":"2024-04-26T21:16:25.436044+0000","last_fullsized":"2024-04-26T21:16:25.436044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814971+0000","last_change":"2024-04-26T21:16:20.417586+0000","last_active":"2024-04-26T21:16:25.814971+0000","last_peered":"2024-04-26T21:16:25.814971+0000","last_clean":"2024-04-26T21:16:25.814971+0000","last_became_active":"2024-04-26T21:16:20.417195+0000","last_became_peered":"2024-04-26T21:16:20.417195+0000","last_unstale":"2024-04-26T21:16:25.814971+0000","last_undegraded":"2024-04-26T21:16:25.814971+0000","last_fullsized":"2024-04-26T21:16:25.814971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801200+0000","last_change":"2024-04-26T21:16:19.402526+0000","last_active":"2024-04-26T21:16:25.801200+0000","last_peered":"2024-04-26T21:16:25.801200+0000","last_clean":"2024-04-26T21:16:25.801200+0000","last_became_active":"2024-04-26T21:16:19.399544+0000","last_became_peered":"2024-04-26T21:16:19.399544+0000","last_unstale":"2024-04-26T21:16:25.801200+0000","last_undegraded":"2024-04-26T21:16:25.801200+0000","last_fullsized":"2024-04-26T21:16:25.801200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434800+0000","last_change":"2024-04-26T21:16:24.462467+0000","last_active":"2024-04-26T21:16:25.434800+0000","last_peered":"2024-04-26T21:16:25.434800+0000","last_clean":"2024-04-26T21:16:25.434800+0000","last_became_active":"2024-04-26T21:16:24.461966+0000","last_became_peered":"2024-04-26T21:16:24.461966+0000","last_unstale":"2024-04-26T21:16:25.434800+0000","last_undegraded":"2024-04-26T21:16:25.434800+0000","last_fullsized":"2024-04-26T21:16:25.434800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:44.228248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814368+0000","last_change":"2024-04-26T21:16:20.404811+0000","last_active":"2024-04-26T21:16:25.814368+0000","last_peered":"2024-04-26T21:16:25.814368+0000","last_clean":"2024-04-26T21:16:25.814368+0000","last_became_active":"2024-04-26T21:16:20.403360+0000","last_became_peered":"2024-04-26T21:16:20.403360+0000","last_unstale":"2024-04-26T21:16:25.814368+0000","last_undegraded":"2024-04-26T21:16:25.814368+0000","last_fullsized":"2024-04-26T21:16:25.814368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800884+0000","last_change":"2024-04-26T21:16:19.400626+0000","last_active":"2024-04-26T21:16:25.800884+0000","last_peered":"2024-04-26T21:16:25.800884+0000","last_clean":"2024-04-26T21:16:25.800884+0000","last_became_active":"2024-04-26T21:16:19.400194+0000","last_became_peered":"2024-04-26T21:16:19.400194+0000","last_unstale":"2024-04-26T21:16:25.800884+0000","last_undegraded":"2024-04-26T21:16:25.800884+0000","last_fullsized":"2024-04-26T21:16:25.800884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801658+0000","last_change":"2024-04-26T21:16:24.461234+0000","last_active":"2024-04-26T21:16:25.801658+0000","last_peered":"2024-04-26T21:16:25.801658+0000","last_clean":"2024-04-26T21:16:25.801658+0000","last_became_active":"2024-04-26T21:16:24.460911+0000","last_became_peered":"2024-04-26T21:16:24.460911+0000","last_unstale":"2024-04-26T21:16:25.801658+0000","last_undegraded":"2024-04-26T21:16:25.801658+0000","last_fullsized":"2024-04-26T21:16:25.801658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:45.803476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434606+0000","last_change":"2024-04-26T21:16:20.418241+0000","last_active":"2024-04-26T21:16:25.434606+0000","last_peered":"2024-04-26T21:16:25.434606+0000","last_clean":"2024-04-26T21:16:25.434606+0000","last_became_active":"2024-04-26T21:16:20.417710+0000","last_became_peered":"2024-04-26T21:16:20.417710+0000","last_unstale":"2024-04-26T21:16:25.434606+0000","last_undegraded":"2024-04-26T21:16:25.434606+0000","last_fullsized":"2024-04-26T21:16:25.434606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:46.750974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435669+0000","last_change":"2024-04-26T21:16:19.417003+0000","last_active":"2024-04-26T21:16:25.435669+0000","last_peered":"2024-04-26T21:16:25.435669+0000","last_clean":"2024-04-26T21:16:25.435669+0000","last_became_active":"2024-04-26T21:16:19.416648+0000","last_became_peered":"2024-04-26T21:16:19.416648+0000","last_unstale":"2024-04-26T21:16:25.435669+0000","last_undegraded":"2024-04-26T21:16:25.435669+0000","last_fullsized":"2024-04-26T21:16:25.435669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434863+0000","last_change":"2024-04-26T21:16:24.462876+0000","last_active":"2024-04-26T21:16:25.434863+0000","last_peered":"2024-04-26T21:16:25.434863+0000","last_clean":"2024-04-26T21:16:25.434863+0000","last_became_active":"2024-04-26T21:16:24.462460+0000","last_became_peered":"2024-04-26T21:16:24.462460+0000","last_unstale":"2024-04-26T21:16:25.434863+0000","last_undegraded":"2024-04-26T21:16:25.434863+0000","last_fullsized":"2024-04-26T21:16:25.434863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:21.311855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817334+0000","last_change":"2024-04-26T21:16:20.408076+0000","last_active":"2024-04-26T21:16:25.817334+0000","last_peered":"2024-04-26T21:16:25.817334+0000","last_clean":"2024-04-26T21:16:25.817334+0000","last_became_active":"2024-04-26T21:16:20.407656+0000","last_became_peered":"2024-04-26T21:16:20.407656+0000","last_unstale":"2024-04-26T21:16:25.817334+0000","last_undegraded":"2024-04-26T21:16:25.817334+0000","last_fullsized":"2024-04-26T21:16:25.817334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435249+0000","last_change":"2024-04-26T21:16:19.411480+0000","last_active":"2024-04-26T21:16:25.435249+0000","last_peered":"2024-04-26T21:16:25.435249+0000","last_clean":"2024-04-26T21:16:25.435249+0000","last_became_active":"2024-04-26T21:16:19.410829+0000","last_became_peered":"2024-04-26T21:16:19.410829+0000","last_unstale":"2024-04-26T21:16:25.435249+0000","last_undegraded":"2024-04-26T21:16:25.435249+0000","last_fullsized":"2024-04-26T21:16:25.435249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434466+0000","last_change":"2024-04-26T21:16:24.456850+0000","last_active":"2024-04-26T21:16:25.434466+0000","last_peered":"2024-04-26T21:16:25.434466+0000","last_clean":"2024-04-26T21:16:25.434466+0000","last_became_active":"2024-04-26T21:16:24.456404+0000","last_became_peered":"2024-04-26T21:16:24.456404+0000","last_unstale":"2024-04-26T21:16:25.434466+0000","last_undegraded":"2024-04-26T21:16:25.434466+0000","last_fullsized":"2024-04-26T21:16:25.434466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:35.587426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815768+0000","last_change":"2024-04-26T21:16:20.427731+0000","last_active":"2024-04-26T21:16:25.815768+0000","last_peered":"2024-04-26T21:16:25.815768+0000","last_clean":"2024-04-26T21:16:25.815768+0000","last_became_active":"2024-04-26T21:16:20.427425+0000","last_became_peered":"2024-04-26T21:16:20.427425+0000","last_unstale":"2024-04-26T21:16:25.815768+0000","last_undegraded":"2024-04-26T21:16:25.815768+0000","last_fullsized":"2024-04-26T21:16:25.815768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801527+0000","last_change":"2024-04-26T21:16:19.406450+0000","last_active":"2024-04-26T21:16:25.801527+0000","last_peered":"2024-04-26T21:16:25.801527+0000","last_clean":"2024-04-26T21:16:25.801527+0000","last_became_active":"2024-04-26T21:16:19.405911+0000","last_became_peered":"2024-04-26T21:16:19.405911+0000","last_unstale":"2024-04-26T21:16:25.801527+0000","last_undegraded":"2024-04-26T21:16:25.801527+0000","last_fullsized":"2024-04-26T21:16:25.801527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814203+0000","last_change":"2024-04-26T21:16:24.458420+0000","last_active":"2024-04-26T21:16:25.814203+0000","last_peered":"2024-04-26T21:16:25.814203+0000","last_clean":"2024-04-26T21:16:25.814203+0000","last_became_active":"2024-04-26T21:16:24.458033+0000","last_became_peered":"2024-04-26T21:16:24.458033+0000","last_unstale":"2024-04-26T21:16:25.814203+0000","last_undegraded":"2024-04-26T21:16:25.814203+0000","last_fullsized":"2024-04-26T21:16:25.814203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:45.881928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801205+0000","last_change":"2024-04-26T21:16:20.410112+0000","last_active":"2024-04-26T21:16:25.801205+0000","last_peered":"2024-04-26T21:16:25.801205+0000","last_clean":"2024-04-26T21:16:25.801205+0000","last_became_active":"2024-04-26T21:16:20.406760+0000","last_became_peered":"2024-04-26T21:16:20.406760+0000","last_unstale":"2024-04-26T21:16:25.801205+0000","last_undegraded":"2024-04-26T21:16:25.801205+0000","last_fullsized":"2024-04-26T21:16:25.801205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436719+0000","last_change":"2024-04-26T21:16:19.415298+0000","last_active":"2024-04-26T21:16:25.436719+0000","last_peered":"2024-04-26T21:16:25.436719+0000","last_clean":"2024-04-26T21:16:25.436719+0000","last_became_active":"2024-04-26T21:16:19.414712+0000","last_became_peered":"2024-04-26T21:16:19.414712+0000","last_unstale":"2024-04-26T21:16:25.436719+0000","last_undegraded":"2024-04-26T21:16:25.436719+0000","last_fullsized":"2024-04-26T21:16:25.436719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:38.445207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816864+0000","last_change":"2024-04-26T21:16:24.454307+0000","last_active":"2024-04-26T21:16:25.816864+0000","last_peered":"2024-04-26T21:16:25.816864+0000","last_clean":"2024-04-26T21:16:25.816864+0000","last_became_active":"2024-04-26T21:16:24.453880+0000","last_became_peered":"2024-04-26T21:16:24.453880+0000","last_unstale":"2024-04-26T21:16:25.816864+0000","last_undegraded":"2024-04-26T21:16:25.816864+0000","last_fullsized":"2024-04-26T21:16:25.816864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:02.451831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816509+0000","last_change":"2024-04-26T21:16:20.421987+0000","last_active":"2024-04-26T21:16:25.816509+0000","last_peered":"2024-04-26T21:16:25.816509+0000","last_clean":"2024-04-26T21:16:25.816509+0000","last_became_active":"2024-04-26T21:16:20.421708+0000","last_became_peered":"2024-04-26T21:16:20.421708+0000","last_unstale":"2024-04-26T21:16:25.816509+0000","last_undegraded":"2024-04-26T21:16:25.816509+0000","last_fullsized":"2024-04-26T21:16:25.816509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:03.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801261+0000","last_change":"2024-04-26T21:16:19.411246+0000","last_active":"2024-04-26T21:16:25.801261+0000","last_peered":"2024-04-26T21:16:25.801261+0000","last_clean":"2024-04-26T21:16:25.801261+0000","last_became_active":"2024-04-26T21:16:19.410899+0000","last_became_peered":"2024-04-26T21:16:19.410899+0000","last_unstale":"2024-04-26T21:16:25.801261+0000","last_undegraded":"2024-04-26T21:16:25.801261+0000","last_fullsized":"2024-04-26T21:16:25.801261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:38.445207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800985+0000","last_change":"2024-04-26T21:16:24.460849+0000","last_active":"2024-04-26T21:16:25.800985+0000","last_peered":"2024-04-26T21:16:25.800985+0000","last_clean":"2024-04-26T21:16:25.800985+0000","last_became_active":"2024-04-26T21:16:24.460317+0000","last_became_peered":"2024-04-26T21:16:24.460317+0000","last_unstale":"2024-04-26T21:16:25.800985+0000","last_undegraded":"2024-04-26T21:16:25.800985+0000","last_fullsized":"2024-04-26T21:16:25.800985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435239+0000","last_change":"2024-04-26T21:16:20.418564+0000","last_active":"2024-04-26T21:16:25.435239+0000","last_peered":"2024-04-26T21:16:25.435239+0000","last_clean":"2024-04-26T21:16:25.435239+0000","last_became_active":"2024-04-26T21:16:20.417882+0000","last_became_peered":"2024-04-26T21:16:20.417882+0000","last_unstale":"2024-04-26T21:16:25.435239+0000","last_undegraded":"2024-04-26T21:16:25.435239+0000","last_fullsized":"2024-04-26T21:16:25.435239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:40.649173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816239+0000","last_change":"2024-04-26T21:16:19.399034+0000","last_active":"2024-04-26T21:16:25.816239+0000","last_peered":"2024-04-26T21:16:25.816239+0000","last_clean":"2024-04-26T21:16:25.816239+0000","last_became_active":"2024-04-26T21:16:19.398765+0000","last_became_peered":"2024-04-26T21:16:19.398765+0000","last_unstale":"2024-04-26T21:16:25.816239+0000","last_undegraded":"2024-04-26T21:16:25.816239+0000","last_fullsized":"2024-04-26T21:16:25.816239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801228+0000","last_change":"2024-04-26T21:16:24.458228+0000","last_active":"2024-04-26T21:16:25.801228+0000","last_peered":"2024-04-26T21:16:25.801228+0000","last_clean":"2024-04-26T21:16:25.801228+0000","last_became_active":"2024-04-26T21:16:24.457891+0000","last_became_peered":"2024-04-26T21:16:24.457891+0000","last_unstale":"2024-04-26T21:16:25.801228+0000","last_undegraded":"2024-04-26T21:16:25.801228+0000","last_fullsized":"2024-04-26T21:16:25.801228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:02.451831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800959+0000","last_change":"2024-04-26T21:16:20.403928+0000","last_active":"2024-04-26T21:16:25.800959+0000","last_peered":"2024-04-26T21:16:25.800959+0000","last_clean":"2024-04-26T21:16:25.800959+0000","last_became_active":"2024-04-26T21:16:20.403679+0000","last_became_peered":"2024-04-26T21:16:20.403679+0000","last_unstale":"2024-04-26T21:16:25.800959+0000","last_undegraded":"2024-04-26T21:16:25.800959+0000","last_fullsized":"2024-04-26T21:16:25.800959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814353+0000","last_change":"2024-04-26T21:16:19.401004+0000","last_active":"2024-04-26T21:16:25.814353+0000","last_peered":"2024-04-26T21:16:25.814353+0000","last_clean":"2024-04-26T21:16:25.814353+0000","last_became_active":"2024-04-26T21:16:19.400735+0000","last_became_peered":"2024-04-26T21:16:19.400735+0000","last_unstale":"2024-04-26T21:16:25.814353+0000","last_undegraded":"2024-04-26T21:16:25.814353+0000","last_fullsized":"2024-04-26T21:16:25.814353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:10.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801692+0000","last_change":"2024-04-26T21:16:24.455241+0000","last_active":"2024-04-26T21:16:25.801692+0000","last_peered":"2024-04-26T21:16:25.801692+0000","last_clean":"2024-04-26T21:16:25.801692+0000","last_became_active":"2024-04-26T21:16:24.454846+0000","last_became_peered":"2024-04-26T21:16:24.454846+0000","last_unstale":"2024-04-26T21:16:25.801692+0000","last_undegraded":"2024-04-26T21:16:25.801692+0000","last_fullsized":"2024-04-26T21:16:25.801692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:31.330251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816525+0000","last_change":"2024-04-26T21:16:20.410135+0000","last_active":"2024-04-26T21:16:25.816525+0000","last_peered":"2024-04-26T21:16:25.816525+0000","last_clean":"2024-04-26T21:16:25.816525+0000","last_became_active":"2024-04-26T21:16:20.409798+0000","last_became_peered":"2024-04-26T21:16:20.409798+0000","last_unstale":"2024-04-26T21:16:25.816525+0000","last_undegraded":"2024-04-26T21:16:25.816525+0000","last_fullsized":"2024-04-26T21:16:25.816525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:11.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435791+0000","last_change":"2024-04-26T21:16:19.412309+0000","last_active":"2024-04-26T21:16:25.435791+0000","last_peered":"2024-04-26T21:16:25.435791+0000","last_clean":"2024-04-26T21:16:25.435791+0000","last_became_active":"2024-04-26T21:16:19.412073+0000","last_became_peered":"2024-04-26T21:16:19.412073+0000","last_unstale":"2024-04-26T21:16:25.435791+0000","last_undegraded":"2024-04-26T21:16:25.435791+0000","last_fullsized":"2024-04-26T21:16:25.435791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817236+0000","last_change":"2024-04-26T21:16:24.458176+0000","last_active":"2024-04-26T21:16:25.817236+0000","last_peered":"2024-04-26T21:16:25.817236+0000","last_clean":"2024-04-26T21:16:25.817236+0000","last_became_active":"2024-04-26T21:16:24.457774+0000","last_became_peered":"2024-04-26T21:16:24.457774+0000","last_unstale":"2024-04-26T21:16:25.817236+0000","last_undegraded":"2024-04-26T21:16:25.817236+0000","last_fullsized":"2024-04-26T21:16:25.817236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:45.881928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814481+0000","last_change":"2024-04-26T21:16:20.425327+0000","last_active":"2024-04-26T21:16:25.814481+0000","last_peered":"2024-04-26T21:16:25.814481+0000","last_clean":"2024-04-26T21:16:25.814481+0000","last_became_active":"2024-04-26T21:16:20.425071+0000","last_became_peered":"2024-04-26T21:16:20.425071+0000","last_unstale":"2024-04-26T21:16:25.814481+0000","last_undegraded":"2024-04-26T21:16:25.814481+0000","last_fullsized":"2024-04-26T21:16:25.814481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816253+0000","last_change":"2024-04-26T21:16:19.408668+0000","last_active":"2024-04-26T21:16:25.816253+0000","last_peered":"2024-04-26T21:16:25.816253+0000","last_clean":"2024-04-26T21:16:25.816253+0000","last_became_active":"2024-04-26T21:16:19.408363+0000","last_became_peered":"2024-04-26T21:16:19.408363+0000","last_unstale":"2024-04-26T21:16:25.816253+0000","last_undegraded":"2024-04-26T21:16:25.816253+0000","last_fullsized":"2024-04-26T21:16:25.816253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435906+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:16:25.435906+0000","last_peered":"2024-04-26T21:16:25.435906+0000","last_clean":"2024-04-26T21:16:25.435906+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:16:25.435906+0000","last_undegraded":"2024-04-26T21:16:25.435906+0000","last_fullsized":"2024-04-26T21:16:25.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434338+0000","last_change":"2024-04-26T21:16:24.452049+0000","last_active":"2024-04-26T21:16:25.434338+0000","last_peered":"2024-04-26T21:16:25.434338+0000","last_clean":"2024-04-26T21:16:25.434338+0000","last_became_active":"2024-04-26T21:16:24.451479+0000","last_became_peered":"2024-04-26T21:16:24.451479+0000","last_unstale":"2024-04-26T21:16:25.434338+0000","last_undegraded":"2024-04-26T21:16:25.434338+0000","last_fullsized":"2024-04-26T21:16:25.434338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:49.007056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436447+0000","last_change":"2024-04-26T21:16:20.425471+0000","last_active":"2024-04-26T21:16:25.436447+0000","last_peered":"2024-04-26T21:16:25.436447+0000","last_clean":"2024-04-26T21:16:25.436447+0000","last_became_active":"2024-04-26T21:16:20.425139+0000","last_became_peered":"2024-04-26T21:16:20.425139+0000","last_unstale":"2024-04-26T21:16:25.436447+0000","last_undegraded":"2024-04-26T21:16:25.436447+0000","last_fullsized":"2024-04-26T21:16:25.436447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:44.971333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815036+0000","last_change":"2024-04-26T21:16:19.405872+0000","last_active":"2024-04-26T21:16:25.815036+0000","last_peered":"2024-04-26T21:16:25.815036+0000","last_clean":"2024-04-26T21:16:25.815036+0000","last_became_active":"2024-04-26T21:16:19.405574+0000","last_became_peered":"2024-04-26T21:16:19.405574+0000","last_unstale":"2024-04-26T21:16:25.815036+0000","last_undegraded":"2024-04-26T21:16:25.815036+0000","last_fullsized":"2024-04-26T21:16:25.815036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:11.405759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433802+0000","last_change":"2024-04-26T21:16:24.452916+0000","last_active":"2024-04-26T21:16:25.433802+0000","last_peered":"2024-04-26T21:16:25.433802+0000","last_clean":"2024-04-26T21:16:25.433802+0000","last_became_active":"2024-04-26T21:16:24.452500+0000","last_became_peered":"2024-04-26T21:16:24.452500+0000","last_unstale":"2024-04-26T21:16:25.433802+0000","last_undegraded":"2024-04-26T21:16:25.433802+0000","last_fullsized":"2024-04-26T21:16:25.433802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:07.354698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816437+0000","last_change":"2024-04-26T21:16:20.434192+0000","last_active":"2024-04-26T21:16:25.816437+0000","last_peered":"2024-04-26T21:16:25.816437+0000","last_clean":"2024-04-26T21:16:25.816437+0000","last_became_active":"2024-04-26T21:16:20.433657+0000","last_became_peered":"2024-04-26T21:16:20.433657+0000","last_unstale":"2024-04-26T21:16:25.816437+0000","last_undegraded":"2024-04-26T21:16:25.816437+0000","last_fullsized":"2024-04-26T21:16:25.816437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:54.005276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801434+0000","last_change":"2024-04-26T21:16:19.403457+0000","last_active":"2024-04-26T21:16:25.801434+0000","last_peered":"2024-04-26T21:16:25.801434+0000","last_clean":"2024-04-26T21:16:25.801434+0000","last_became_active":"2024-04-26T21:16:19.402886+0000","last_became_peered":"2024-04-26T21:16:19.402886+0000","last_unstale":"2024-04-26T21:16:25.801434+0000","last_undegraded":"2024-04-26T21:16:25.801434+0000","last_fullsized":"2024-04-26T21:16:25.801434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816954+0000","last_change":"2024-04-26T21:16:24.454078+0000","last_active":"2024-04-26T21:16:25.816954+0000","last_peered":"2024-04-26T21:16:25.816954+0000","last_clean":"2024-04-26T21:16:25.816954+0000","last_became_active":"2024-04-26T21:16:24.453726+0000","last_became_peered":"2024-04-26T21:16:24.453726+0000","last_unstale":"2024-04-26T21:16:25.816954+0000","last_undegraded":"2024-04-26T21:16:25.816954+0000","last_fullsized":"2024-04-26T21:16:25.816954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:45.803476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436898+0000","last_change":"2024-04-26T21:16:20.415657+0000","last_active":"2024-04-26T21:16:25.436898+0000","last_peered":"2024-04-26T21:16:25.436898+0000","last_clean":"2024-04-26T21:16:25.436898+0000","last_became_active":"2024-04-26T21:16:20.415241+0000","last_became_peered":"2024-04-26T21:16:20.415241+0000","last_unstale":"2024-04-26T21:16:25.436898+0000","last_undegraded":"2024-04-26T21:16:25.436898+0000","last_fullsized":"2024-04-26T21:16:25.436898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:27.294527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815326+0000","last_change":"2024-04-26T21:16:19.398067+0000","last_active":"2024-04-26T21:16:25.815326+0000","last_peered":"2024-04-26T21:16:25.815326+0000","last_clean":"2024-04-26T21:16:25.815326+0000","last_became_active":"2024-04-26T21:16:19.397685+0000","last_became_peered":"2024-04-26T21:16:19.397685+0000","last_unstale":"2024-04-26T21:16:25.815326+0000","last_undegraded":"2024-04-26T21:16:25.815326+0000","last_fullsized":"2024-04-26T21:16:25.815326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:38.089679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815875+0000","last_change":"2024-04-26T21:16:24.450492+0000","last_active":"2024-04-26T21:16:25.815875+0000","last_peered":"2024-04-26T21:16:25.815875+0000","last_clean":"2024-04-26T21:16:25.815875+0000","last_became_active":"2024-04-26T21:16:24.450086+0000","last_became_peered":"2024-04-26T21:16:24.450086+0000","last_unstale":"2024-04-26T21:16:25.815875+0000","last_undegraded":"2024-04-26T21:16:25.815875+0000","last_fullsized":"2024-04-26T21:16:25.815875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436736+0000","last_change":"2024-04-26T21:16:20.422919+0000","last_active":"2024-04-26T21:16:25.436736+0000","last_peered":"2024-04-26T21:16:25.436736+0000","last_clean":"2024-04-26T21:16:25.436736+0000","last_became_active":"2024-04-26T21:16:20.422606+0000","last_became_peered":"2024-04-26T21:16:20.422606+0000","last_unstale":"2024-04-26T21:16:25.436736+0000","last_undegraded":"2024-04-26T21:16:25.436736+0000","last_fullsized":"2024-04-26T21:16:25.436736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:54.005276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434221+0000","last_change":"2024-04-26T21:16:19.409935+0000","last_active":"2024-04-26T21:16:25.434221+0000","last_peered":"2024-04-26T21:16:25.434221+0000","last_clean":"2024-04-26T21:16:25.434221+0000","last_became_active":"2024-04-26T21:16:19.409636+0000","last_became_peered":"2024-04-26T21:16:19.409636+0000","last_unstale":"2024-04-26T21:16:25.434221+0000","last_undegraded":"2024-04-26T21:16:25.434221+0000","last_fullsized":"2024-04-26T21:16:25.434221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:24.652333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434240+0000","last_change":"2024-04-26T21:16:24.462022+0000","last_active":"2024-04-26T21:16:25.434240+0000","last_peered":"2024-04-26T21:16:25.434240+0000","last_clean":"2024-04-26T21:16:25.434240+0000","last_became_active":"2024-04-26T21:16:24.461691+0000","last_became_peered":"2024-04-26T21:16:24.461691+0000","last_unstale":"2024-04-26T21:16:25.434240+0000","last_undegraded":"2024-04-26T21:16:25.434240+0000","last_fullsized":"2024-04-26T21:16:25.434240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:35.967648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435773+0000","last_change":"2024-04-26T21:16:20.406585+0000","last_active":"2024-04-26T21:16:25.435773+0000","last_peered":"2024-04-26T21:16:25.435773+0000","last_clean":"2024-04-26T21:16:25.435773+0000","last_became_active":"2024-04-26T21:16:20.406265+0000","last_became_peered":"2024-04-26T21:16:20.406265+0000","last_unstale":"2024-04-26T21:16:25.435773+0000","last_undegraded":"2024-04-26T21:16:25.435773+0000","last_fullsized":"2024-04-26T21:16:25.435773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814382+0000","last_change":"2024-04-26T21:16:19.395551+0000","last_active":"2024-04-26T21:16:25.814382+0000","last_peered":"2024-04-26T21:16:25.814382+0000","last_clean":"2024-04-26T21:16:25.814382+0000","last_became_active":"2024-04-26T21:16:19.393831+0000","last_became_peered":"2024-04-26T21:16:19.393831+0000","last_unstale":"2024-04-26T21:16:25.814382+0000","last_undegraded":"2024-04-26T21:16:25.814382+0000","last_fullsized":"2024-04-26T21:16:25.814382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:53.258420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817267+0000","last_change":"2024-04-26T21:16:24.452943+0000","last_active":"2024-04-26T21:16:25.817267+0000","last_peered":"2024-04-26T21:16:25.817267+0000","last_clean":"2024-04-26T21:16:25.817267+0000","last_became_active":"2024-04-26T21:16:24.452603+0000","last_became_peered":"2024-04-26T21:16:24.452603+0000","last_unstale":"2024-04-26T21:16:25.817267+0000","last_undegraded":"2024-04-26T21:16:25.817267+0000","last_fullsized":"2024-04-26T21:16:25.817267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433930+0000","last_change":"2024-04-26T21:16:20.410601+0000","last_active":"2024-04-26T21:16:25.433930+0000","last_peered":"2024-04-26T21:16:25.433930+0000","last_clean":"2024-04-26T21:16:25.433930+0000","last_became_active":"2024-04-26T21:16:20.410197+0000","last_became_peered":"2024-04-26T21:16:20.410197+0000","last_unstale":"2024-04-26T21:16:25.433930+0000","last_undegraded":"2024-04-26T21:16:25.433930+0000","last_fullsized":"2024-04-26T21:16:25.433930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433955+0000","last_change":"2024-04-26T21:16:19.413099+0000","last_active":"2024-04-26T21:16:25.433955+0000","last_peered":"2024-04-26T21:16:25.433955+0000","last_clean":"2024-04-26T21:16:25.433955+0000","last_became_active":"2024-04-26T21:16:19.412695+0000","last_became_peered":"2024-04-26T21:16:19.412695+0000","last_unstale":"2024-04-26T21:16:25.433955+0000","last_undegraded":"2024-04-26T21:16:25.433955+0000","last_fullsized":"2024-04-26T21:16:25.433955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815773+0000","last_change":"2024-04-26T21:16:24.446231+0000","last_active":"2024-04-26T21:16:25.815773+0000","last_peered":"2024-04-26T21:16:25.815773+0000","last_clean":"2024-04-26T21:16:25.815773+0000","last_became_active":"2024-04-26T21:16:24.445743+0000","last_became_peered":"2024-04-26T21:16:24.445743+0000","last_unstale":"2024-04-26T21:16:25.815773+0000","last_undegraded":"2024-04-26T21:16:25.815773+0000","last_fullsized":"2024-04-26T21:16:25.815773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:27.238080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436166+0000","last_change":"2024-04-26T21:16:20.423076+0000","last_active":"2024-04-26T21:16:25.436166+0000","last_peered":"2024-04-26T21:16:25.436166+0000","last_clean":"2024-04-26T21:16:25.436166+0000","last_became_active":"2024-04-26T21:16:20.422476+0000","last_became_peered":"2024-04-26T21:16:20.422476+0000","last_unstale":"2024-04-26T21:16:25.436166+0000","last_undegraded":"2024-04-26T21:16:25.436166+0000","last_fullsized":"2024-04-26T21:16:25.436166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816169+0000","last_change":"2024-04-26T21:16:19.406614+0000","last_active":"2024-04-26T21:16:25.816169+0000","last_peered":"2024-04-26T21:16:25.816169+0000","last_clean":"2024-04-26T21:16:25.816169+0000","last_became_active":"2024-04-26T21:16:19.403274+0000","last_became_peered":"2024-04-26T21:16:19.403274+0000","last_unstale":"2024-04-26T21:16:25.816169+0000","last_undegraded":"2024-04-26T21:16:25.816169+0000","last_fullsized":"2024-04-26T21:16:25.816169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815305+0000","last_change":"2024-04-26T21:16:24.451820+0000","last_active":"2024-04-26T21:16:25.815305+0000","last_peered":"2024-04-26T21:16:25.815305+0000","last_clean":"2024-04-26T21:16:25.815305+0000","last_became_active":"2024-04-26T21:16:24.451472+0000","last_became_peered":"2024-04-26T21:16:24.451472+0000","last_unstale":"2024-04-26T21:16:25.815305+0000","last_undegraded":"2024-04-26T21:16:25.815305+0000","last_fullsized":"2024-04-26T21:16:25.815305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:09.977865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816825+0000","last_change":"2024-04-26T21:16:20.425068+0000","last_active":"2024-04-26T21:16:25.816825+0000","last_peered":"2024-04-26T21:16:25.816825+0000","last_clean":"2024-04-26T21:16:25.816825+0000","last_became_active":"2024-04-26T21:16:20.424773+0000","last_became_peered":"2024-04-26T21:16:20.424773+0000","last_unstale":"2024-04-26T21:16:25.816825+0000","last_undegraded":"2024-04-26T21:16:25.816825+0000","last_fullsized":"2024-04-26T21:16:25.816825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817008+0000","last_change":"2024-04-26T21:16:19.413580+0000","last_active":"2024-04-26T21:16:25.817008+0000","last_peered":"2024-04-26T21:16:25.817008+0000","last_clean":"2024-04-26T21:16:25.817008+0000","last_became_active":"2024-04-26T21:16:19.412636+0000","last_became_peered":"2024-04-26T21:16:19.412636+0000","last_unstale":"2024-04-26T21:16:25.817008+0000","last_undegraded":"2024-04-26T21:16:25.817008+0000","last_fullsized":"2024-04-26T21:16:25.817008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:06.128835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816582+0000","last_change":"2024-04-26T21:16:24.456301+0000","last_active":"2024-04-26T21:16:25.816582+0000","last_peered":"2024-04-26T21:16:25.816582+0000","last_clean":"2024-04-26T21:16:25.816582+0000","last_became_active":"2024-04-26T21:16:24.455115+0000","last_became_peered":"2024-04-26T21:16:24.455115+0000","last_unstale":"2024-04-26T21:16:25.816582+0000","last_undegraded":"2024-04-26T21:16:25.816582+0000","last_fullsized":"2024-04-26T21:16:25.816582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:58.709336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436405+0000","last_change":"2024-04-26T21:16:20.404787+0000","last_active":"2024-04-26T21:16:25.436405+0000","last_peered":"2024-04-26T21:16:25.436405+0000","last_clean":"2024-04-26T21:16:25.436405+0000","last_became_active":"2024-04-26T21:16:20.404355+0000","last_became_peered":"2024-04-26T21:16:20.404355+0000","last_unstale":"2024-04-26T21:16:25.436405+0000","last_undegraded":"2024-04-26T21:16:25.436405+0000","last_fullsized":"2024-04-26T21:16:25.436405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:03.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:35.742110+0000","last_change":"2024-04-26T21:16:19.407394+0000","last_active":"2024-04-26T21:16:35.742110+0000","last_peered":"2024-04-26T21:16:35.742110+0000","last_clean":"2024-04-26T21:16:35.742110+0000","last_became_active":"2024-04-26T21:16:19.407056+0000","last_became_peered":"2024-04-26T21:16:19.407056+0000","last_unstale":"2024-04-26T21:16:35.742110+0000","last_undegraded":"2024-04-26T21:16:35.742110+0000","last_fullsized":"2024-04-26T21:16:35.742110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801146+0000","last_change":"2024-04-26T21:16:24.460241+0000","last_active":"2024-04-26T21:16:25.801146+0000","last_peered":"2024-04-26T21:16:25.801146+0000","last_clean":"2024-04-26T21:16:25.801146+0000","last_became_active":"2024-04-26T21:16:24.459738+0000","last_became_peered":"2024-04-26T21:16:24.459738+0000","last_unstale":"2024-04-26T21:16:25.801146+0000","last_undegraded":"2024-04-26T21:16:25.801146+0000","last_fullsized":"2024-04-26T21:16:25.801146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:13.640693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434981+0000","last_change":"2024-04-26T21:16:20.430119+0000","last_active":"2024-04-26T21:16:25.434981+0000","last_peered":"2024-04-26T21:16:25.434981+0000","last_clean":"2024-04-26T21:16:25.434981+0000","last_became_active":"2024-04-26T21:16:20.429573+0000","last_became_peered":"2024-04-26T21:16:20.429573+0000","last_unstale":"2024-04-26T21:16:25.434981+0000","last_undegraded":"2024-04-26T21:16:25.434981+0000","last_fullsized":"2024-04-26T21:16:25.434981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:39.450737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801403+0000","last_change":"2024-04-26T21:16:19.405677+0000","last_active":"2024-04-26T21:16:25.801403+0000","last_peered":"2024-04-26T21:16:25.801403+0000","last_clean":"2024-04-26T21:16:25.801403+0000","last_became_active":"2024-04-26T21:16:19.405168+0000","last_became_peered":"2024-04-26T21:16:19.405168+0000","last_unstale":"2024-04-26T21:16:25.801403+0000","last_undegraded":"2024-04-26T21:16:25.801403+0000","last_fullsized":"2024-04-26T21:16:25.801403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434637+0000","last_change":"2024-04-26T21:16:24.462415+0000","last_active":"2024-04-26T21:16:25.434637+0000","last_peered":"2024-04-26T21:16:25.434637+0000","last_clean":"2024-04-26T21:16:25.434637+0000","last_became_active":"2024-04-26T21:16:24.462047+0000","last_became_peered":"2024-04-26T21:16:24.462047+0000","last_unstale":"2024-04-26T21:16:25.434637+0000","last_undegraded":"2024-04-26T21:16:25.434637+0000","last_fullsized":"2024-04-26T21:16:25.434637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:50.269287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817452+0000","last_change":"2024-04-26T21:16:20.423947+0000","last_active":"2024-04-26T21:16:25.817452+0000","last_peered":"2024-04-26T21:16:25.817452+0000","last_clean":"2024-04-26T21:16:25.817452+0000","last_became_active":"2024-04-26T21:16:20.423647+0000","last_became_peered":"2024-04-26T21:16:20.423647+0000","last_unstale":"2024-04-26T21:16:25.817452+0000","last_undegraded":"2024-04-26T21:16:25.817452+0000","last_fullsized":"2024-04-26T21:16:25.817452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816645+0000","last_change":"2024-04-26T21:16:19.403292+0000","last_active":"2024-04-26T21:16:25.816645+0000","last_peered":"2024-04-26T21:16:25.816645+0000","last_clean":"2024-04-26T21:16:25.816645+0000","last_became_active":"2024-04-26T21:16:19.402784+0000","last_became_peered":"2024-04-26T21:16:19.402784+0000","last_unstale":"2024-04-26T21:16:25.816645+0000","last_undegraded":"2024-04-26T21:16:25.816645+0000","last_fullsized":"2024-04-26T21:16:25.816645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814330+0000","last_change":"2024-04-26T21:16:24.456302+0000","last_active":"2024-04-26T21:16:25.814330+0000","last_peered":"2024-04-26T21:16:25.814330+0000","last_clean":"2024-04-26T21:16:25.814330+0000","last_became_active":"2024-04-26T21:16:24.456017+0000","last_became_peered":"2024-04-26T21:16:24.456017+0000","last_unstale":"2024-04-26T21:16:25.814330+0000","last_undegraded":"2024-04-26T21:16:25.814330+0000","last_fullsized":"2024-04-26T21:16:25.814330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816540+0000","last_change":"2024-04-26T21:16:20.425747+0000","last_active":"2024-04-26T21:16:25.816540+0000","last_peered":"2024-04-26T21:16:25.816540+0000","last_clean":"2024-04-26T21:16:25.816540+0000","last_became_active":"2024-04-26T21:16:20.425488+0000","last_became_peered":"2024-04-26T21:16:20.425488+0000","last_unstale":"2024-04-26T21:16:25.816540+0000","last_undegraded":"2024-04-26T21:16:25.816540+0000","last_fullsized":"2024-04-26T21:16:25.816540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:44.971333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435140+0000","last_change":"2024-04-26T21:16:19.406087+0000","last_active":"2024-04-26T21:16:25.435140+0000","last_peered":"2024-04-26T21:16:25.435140+0000","last_clean":"2024-04-26T21:16:25.435140+0000","last_became_active":"2024-04-26T21:16:19.405864+0000","last_became_peered":"2024-04-26T21:16:19.405864+0000","last_unstale":"2024-04-26T21:16:25.435140+0000","last_undegraded":"2024-04-26T21:16:25.435140+0000","last_fullsized":"2024-04-26T21:16:25.435140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814623+0000","last_change":"2024-04-26T21:16:24.448037+0000","last_active":"2024-04-26T21:16:25.814623+0000","last_peered":"2024-04-26T21:16:25.814623+0000","last_clean":"2024-04-26T21:16:25.814623+0000","last_became_active":"2024-04-26T21:16:24.447296+0000","last_became_peered":"2024-04-26T21:16:24.447296+0000","last_unstale":"2024-04-26T21:16:25.814623+0000","last_undegraded":"2024-04-26T21:16:25.814623+0000","last_fullsized":"2024-04-26T21:16:25.814623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:07.159212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817154+0000","last_change":"2024-04-26T21:16:24.459333+0000","last_active":"2024-04-26T21:16:25.817154+0000","last_peered":"2024-04-26T21:16:25.817154+0000","last_clean":"2024-04-26T21:16:25.817154+0000","last_became_active":"2024-04-26T21:16:24.458880+0000","last_became_peered":"2024-04-26T21:16:24.458880+0000","last_unstale":"2024-04-26T21:16:25.817154+0000","last_undegraded":"2024-04-26T21:16:25.817154+0000","last_fullsized":"2024-04-26T21:16:25.817154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:31.330251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800771+0000","last_change":"2024-04-26T21:16:20.403324+0000","last_active":"2024-04-26T21:16:25.800771+0000","last_peered":"2024-04-26T21:16:25.800771+0000","last_clean":"2024-04-26T21:16:25.800771+0000","last_became_active":"2024-04-26T21:16:20.403028+0000","last_became_peered":"2024-04-26T21:16:20.403028+0000","last_unstale":"2024-04-26T21:16:25.800771+0000","last_undegraded":"2024-04-26T21:16:25.800771+0000","last_fullsized":"2024-04-26T21:16:25.800771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816007+0000","last_change":"2024-04-26T21:16:19.399594+0000","last_active":"2024-04-26T21:16:25.816007+0000","last_peered":"2024-04-26T21:16:25.816007+0000","last_clean":"2024-04-26T21:16:25.816007+0000","last_became_active":"2024-04-26T21:16:19.399283+0000","last_became_peered":"2024-04-26T21:16:19.399283+0000","last_unstale":"2024-04-26T21:16:25.816007+0000","last_undegraded":"2024-04-26T21:16:25.816007+0000","last_fullsized":"2024-04-26T21:16:25.816007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435033+0000","last_change":"2024-04-26T21:16:24.452081+0000","last_active":"2024-04-26T21:16:25.435033+0000","last_peered":"2024-04-26T21:16:25.435033+0000","last_clean":"2024-04-26T21:16:25.435033+0000","last_became_active":"2024-04-26T21:16:24.451654+0000","last_became_peered":"2024-04-26T21:16:24.451654+0000","last_unstale":"2024-04-26T21:16:25.435033+0000","last_undegraded":"2024-04-26T21:16:25.435033+0000","last_fullsized":"2024-04-26T21:16:25.435033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814302+0000","last_change":"2024-04-26T21:16:20.412643+0000","last_active":"2024-04-26T21:16:25.814302+0000","last_peered":"2024-04-26T21:16:25.814302+0000","last_clean":"2024-04-26T21:16:25.814302+0000","last_became_active":"2024-04-26T21:16:20.412229+0000","last_became_peered":"2024-04-26T21:16:20.412229+0000","last_unstale":"2024-04-26T21:16:25.814302+0000","last_undegraded":"2024-04-26T21:16:25.814302+0000","last_fullsized":"2024-04-26T21:16:25.814302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814684+0000","last_change":"2024-04-26T21:16:19.404756+0000","last_active":"2024-04-26T21:16:25.814684+0000","last_peered":"2024-04-26T21:16:25.814684+0000","last_clean":"2024-04-26T21:16:25.814684+0000","last_became_active":"2024-04-26T21:16:19.404480+0000","last_became_peered":"2024-04-26T21:16:19.404480+0000","last_unstale":"2024-04-26T21:16:25.814684+0000","last_undegraded":"2024-04-26T21:16:25.814684+0000","last_fullsized":"2024-04-26T21:16:25.814684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:06.128835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434093+0000","last_change":"2024-04-26T21:16:19.409681+0000","last_active":"2024-04-26T21:16:25.434093+0000","last_peered":"2024-04-26T21:16:25.434093+0000","last_clean":"2024-04-26T21:16:25.434093+0000","last_became_active":"2024-04-26T21:16:19.409425+0000","last_became_peered":"2024-04-26T21:16:19.409425+0000","last_unstale":"2024-04-26T21:16:25.434093+0000","last_undegraded":"2024-04-26T21:16:25.434093+0000","last_fullsized":"2024-04-26T21:16:25.434093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816993+0000","last_change":"2024-04-26T21:16:20.414103+0000","last_active":"2024-04-26T21:16:25.816993+0000","last_peered":"2024-04-26T21:16:25.816993+0000","last_clean":"2024-04-26T21:16:25.816993+0000","last_became_active":"2024-04-26T21:16:20.413448+0000","last_became_peered":"2024-04-26T21:16:20.413448+0000","last_unstale":"2024-04-26T21:16:25.816993+0000","last_undegraded":"2024-04-26T21:16:25.816993+0000","last_fullsized":"2024-04-26T21:16:25.816993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814945+0000","last_change":"2024-04-26T21:16:24.460713+0000","last_active":"2024-04-26T21:16:25.814945+0000","last_peered":"2024-04-26T21:16:25.814945+0000","last_clean":"2024-04-26T21:16:25.814945+0000","last_became_active":"2024-04-26T21:16:24.460386+0000","last_became_peered":"2024-04-26T21:16:24.460386+0000","last_unstale":"2024-04-26T21:16:25.814945+0000","last_undegraded":"2024-04-26T21:16:25.814945+0000","last_fullsized":"2024-04-26T21:16:25.814945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:04.230303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815685+0000","last_change":"2024-04-26T21:16:19.406024+0000","last_active":"2024-04-26T21:16:25.815685+0000","last_peered":"2024-04-26T21:16:25.815685+0000","last_clean":"2024-04-26T21:16:25.815685+0000","last_became_active":"2024-04-26T21:16:19.405711+0000","last_became_peered":"2024-04-26T21:16:19.405711+0000","last_unstale":"2024-04-26T21:16:25.815685+0000","last_undegraded":"2024-04-26T21:16:25.815685+0000","last_fullsized":"2024-04-26T21:16:25.815685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:36.055875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435119+0000","last_change":"2024-04-26T21:16:20.418241+0000","last_active":"2024-04-26T21:16:25.435119+0000","last_peered":"2024-04-26T21:16:25.435119+0000","last_clean":"2024-04-26T21:16:25.435119+0000","last_became_active":"2024-04-26T21:16:20.417321+0000","last_became_peered":"2024-04-26T21:16:20.417321+0000","last_unstale":"2024-04-26T21:16:25.435119+0000","last_undegraded":"2024-04-26T21:16:25.435119+0000","last_fullsized":"2024-04-26T21:16:25.435119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:11.862489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815612+0000","last_change":"2024-04-26T21:16:24.459831+0000","last_active":"2024-04-26T21:16:25.815612+0000","last_peered":"2024-04-26T21:16:25.815612+0000","last_clean":"2024-04-26T21:16:25.815612+0000","last_became_active":"2024-04-26T21:16:24.459065+0000","last_became_peered":"2024-04-26T21:16:24.459065+0000","last_unstale":"2024-04-26T21:16:25.815612+0000","last_undegraded":"2024-04-26T21:16:25.815612+0000","last_fullsized":"2024-04-26T21:16:25.815612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:22.852921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433775+0000","last_change":"2024-04-26T21:16:20.409734+0000","last_active":"2024-04-26T21:16:25.433775+0000","last_peered":"2024-04-26T21:16:25.433775+0000","last_clean":"2024-04-26T21:16:25.433775+0000","last_became_active":"2024-04-26T21:16:20.409468+0000","last_became_peered":"2024-04-26T21:16:20.409468+0000","last_unstale":"2024-04-26T21:16:25.433775+0000","last_undegraded":"2024-04-26T21:16:25.433775+0000","last_fullsized":"2024-04-26T21:16:25.433775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814266+0000","last_change":"2024-04-26T21:16:20.415585+0000","last_active":"2024-04-26T21:16:25.814266+0000","last_peered":"2024-04-26T21:16:25.814266+0000","last_clean":"2024-04-26T21:16:25.814266+0000","last_became_active":"2024-04-26T21:16:20.415303+0000","last_became_peered":"2024-04-26T21:16:20.415303+0000","last_unstale":"2024-04-26T21:16:25.814266+0000","last_undegraded":"2024-04-26T21:16:25.814266+0000","last_fullsized":"2024-04-26T21:16:25.814266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:19:56.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816116+0000","last_change":"2024-04-26T21:16:20.420522+0000","last_active":"2024-04-26T21:16:25.816116+0000","last_peered":"2024-04-26T21:16:25.816116+0000","last_clean":"2024-04-26T21:16:25.816116+0000","last_became_active":"2024-04-26T21:16:20.420320+0000","last_became_peered":"2024-04-26T21:16:20.420320+0000","last_unstale":"2024-04-26T21:16:25.816116+0000","last_undegraded":"2024-04-26T21:16:25.816116+0000","last_fullsized":"2024-04-26T21:16:25.816116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816909+0000","last_change":"2024-04-26T21:16:20.414468+0000","last_active":"2024-04-26T21:16:25.816909+0000","last_peered":"2024-04-26T21:16:25.816909+0000","last_clean":"2024-04-26T21:16:25.816909+0000","last_became_active":"2024-04-26T21:16:20.413736+0000","last_became_peered":"2024-04-26T21:16:20.413736+0000","last_unstale":"2024-04-26T21:16:25.816909+0000","last_undegraded":"2024-04-26T21:16:25.816909+0000","last_fullsized":"2024-04-26T21:16:25.816909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815404+0000","last_change":"2024-04-26T21:16:20.409323+0000","last_active":"2024-04-26T21:16:25.815404+0000","last_peered":"2024-04-26T21:16:25.815404+0000","last_clean":"2024-04-26T21:16:25.815404+0000","last_became_active":"2024-04-26T21:16:20.408990+0000","last_became_peered":"2024-04-26T21:16:20.408990+0000","last_unstale":"2024-04-26T21:16:25.815404+0000","last_undegraded":"2024-04-26T21:16:25.815404+0000","last_fullsized":"2024-04-26T21:16:25.815404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801281+0000","last_change":"2024-04-26T21:16:20.404357+0000","last_active":"2024-04-26T21:16:25.801281+0000","last_peered":"2024-04-26T21:16:25.801281+0000","last_clean":"2024-04-26T21:16:25.801281+0000","last_became_active":"2024-04-26T21:16:20.404167+0000","last_became_peered":"2024-04-26T21:16:20.404167+0000","last_unstale":"2024-04-26T21:16:25.801281+0000","last_undegraded":"2024-04-26T21:16:25.801281+0000","last_fullsized":"2024-04-26T21:16:25.801281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434733+0000","last_change":"2024-04-26T21:16:20.425686+0000","last_active":"2024-04-26T21:16:25.434733+0000","last_peered":"2024-04-26T21:16:25.434733+0000","last_clean":"2024-04-26T21:16:25.434733+0000","last_became_active":"2024-04-26T21:16:20.425371+0000","last_became_peered":"2024-04-26T21:16:20.425371+0000","last_unstale":"2024-04-26T21:16:25.434733+0000","last_undegraded":"2024-04-26T21:16:25.434733+0000","last_fullsized":"2024-04-26T21:16:25.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815714+0000","last_change":"2024-04-26T21:16:20.409302+0000","last_active":"2024-04-26T21:16:25.815714+0000","last_peered":"2024-04-26T21:16:25.815714+0000","last_clean":"2024-04-26T21:16:25.815714+0000","last_became_active":"2024-04-26T21:16:20.409004+0000","last_became_peered":"2024-04-26T21:16:20.409004+0000","last_unstale":"2024-04-26T21:16:25.815714+0000","last_undegraded":"2024-04-26T21:16:25.815714+0000","last_fullsized":"2024-04-26T21:16:25.815714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815954+0000","last_change":"2024-04-26T21:16:20.422765+0000","last_active":"2024-04-26T21:16:25.815954+0000","last_peered":"2024-04-26T21:16:25.815954+0000","last_clean":"2024-04-26T21:16:25.815954+0000","last_became_active":"2024-04-26T21:16:20.422225+0000","last_became_peered":"2024-04-26T21:16:20.422225+0000","last_unstale":"2024-04-26T21:16:25.815954+0000","last_undegraded":"2024-04-26T21:16:25.815954+0000","last_fullsized":"2024-04-26T21:16:25.815954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814587+0000","last_change":"2024-04-26T21:16:20.410383+0000","last_active":"2024-04-26T21:16:25.814587+0000","last_peered":"2024-04-26T21:16:25.814587+0000","last_clean":"2024-04-26T21:16:25.814587+0000","last_became_active":"2024-04-26T21:16:20.409668+0000","last_became_peered":"2024-04-26T21:16:20.409668+0000","last_unstale":"2024-04-26T21:16:25.814587+0000","last_undegraded":"2024-04-26T21:16:25.814587+0000","last_fullsized":"2024-04-26T21:16:25.814587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816058+0000","last_change":"2024-04-26T21:16:20.428016+0000","last_active":"2024-04-26T21:16:25.816058+0000","last_peered":"2024-04-26T21:16:25.816058+0000","last_clean":"2024-04-26T21:16:25.816058+0000","last_became_active":"2024-04-26T21:16:20.427562+0000","last_became_peered":"2024-04-26T21:16:20.427562+0000","last_unstale":"2024-04-26T21:16:25.816058+0000","last_undegraded":"2024-04-26T21:16:25.816058+0000","last_fullsized":"2024-04-26T21:16:25.816058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816756+0000","last_change":"2024-04-26T21:16:20.425316+0000","last_active":"2024-04-26T21:16:25.816756+0000","last_peered":"2024-04-26T21:16:25.816756+0000","last_clean":"2024-04-26T21:16:25.816756+0000","last_became_active":"2024-04-26T21:16:20.425008+0000","last_became_peered":"2024-04-26T21:16:20.425008+0000","last_unstale":"2024-04-26T21:16:25.816756+0000","last_undegraded":"2024-04-26T21:16:25.816756+0000","last_fullsized":"2024-04-26T21:16:25.816756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434193+0000","last_change":"2024-04-26T21:16:20.406211+0000","last_active":"2024-04-26T21:16:25.434193+0000","last_peered":"2024-04-26T21:16:25.434193+0000","last_clean":"2024-04-26T21:16:25.434193+0000","last_became_active":"2024-04-26T21:16:20.405903+0000","last_became_peered":"2024-04-26T21:16:20.405903+0000","last_unstale":"2024-04-26T21:16:25.434193+0000","last_undegraded":"2024-04-26T21:16:25.434193+0000","last_fullsized":"2024-04-26T21:16:25.434193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436716+0000","last_change":"2024-04-26T21:16:20.407047+0000","last_active":"2024-04-26T21:16:25.436716+0000","last_peered":"2024-04-26T21:16:25.436716+0000","last_clean":"2024-04-26T21:16:25.436716+0000","last_became_active":"2024-04-26T21:16:20.404541+0000","last_became_peered":"2024-04-26T21:16:20.404541+0000","last_unstale":"2024-04-26T21:16:25.436716+0000","last_undegraded":"2024-04-26T21:16:25.436716+0000","last_fullsized":"2024-04-26T21:16:25.436716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:09.604970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815290+0000","last_change":"2024-04-26T21:16:20.398199+0000","last_active":"2024-04-26T21:16:25.815290+0000","last_peered":"2024-04-26T21:16:25.815290+0000","last_clean":"2024-04-26T21:16:25.815290+0000","last_became_active":"2024-04-26T21:16:20.397910+0000","last_became_peered":"2024-04-26T21:16:20.397910+0000","last_unstale":"2024-04-26T21:16:25.815290+0000","last_undegraded":"2024-04-26T21:16:25.815290+0000","last_fullsized":"2024-04-26T21:16:25.815290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:09.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816910+0000","last_change":"2024-04-26T21:16:20.433837+0000","last_active":"2024-04-26T21:16:25.816910+0000","last_peered":"2024-04-26T21:16:25.816910+0000","last_clean":"2024-04-26T21:16:25.816910+0000","last_became_active":"2024-04-26T21:16:20.433536+0000","last_became_peered":"2024-04-26T21:16:20.433536+0000","last_unstale":"2024-04-26T21:16:25.816910+0000","last_undegraded":"2024-04-26T21:16:25.816910+0000","last_fullsized":"2024-04-26T21:16:25.816910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:58.416107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815843+0000","last_change":"2024-04-26T21:16:20.422532+0000","last_active":"2024-04-26T21:16:25.815843+0000","last_peered":"2024-04-26T21:16:25.815843+0000","last_clean":"2024-04-26T21:16:25.815843+0000","last_became_active":"2024-04-26T21:16:20.421767+0000","last_became_peered":"2024-04-26T21:16:20.421767+0000","last_unstale":"2024-04-26T21:16:25.815843+0000","last_undegraded":"2024-04-26T21:16:25.815843+0000","last_fullsized":"2024-04-26T21:16:25.815843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800845+0000","last_change":"2024-04-26T21:16:20.413673+0000","last_active":"2024-04-26T21:16:25.800845+0000","last_peered":"2024-04-26T21:16:25.800845+0000","last_clean":"2024-04-26T21:16:25.800845+0000","last_became_active":"2024-04-26T21:16:20.413331+0000","last_became_peered":"2024-04-26T21:16:20.413331+0000","last_unstale":"2024-04-26T21:16:25.800845+0000","last_undegraded":"2024-04-26T21:16:25.800845+0000","last_fullsized":"2024-04-26T21:16:25.800845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816767+0000","last_change":"2024-04-26T21:16:20.410440+0000","last_active":"2024-04-26T21:16:25.816767+0000","last_peered":"2024-04-26T21:16:25.816767+0000","last_clean":"2024-04-26T21:16:25.816767+0000","last_became_active":"2024-04-26T21:16:20.410116+0000","last_became_peered":"2024-04-26T21:16:20.410116+0000","last_unstale":"2024-04-26T21:16:25.816767+0000","last_undegraded":"2024-04-26T21:16:25.816767+0000","last_fullsized":"2024-04-26T21:16:25.816767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:27.807333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814886+0000","last_change":"2024-04-26T21:16:20.404907+0000","last_active":"2024-04-26T21:16:25.814886+0000","last_peered":"2024-04-26T21:16:25.814886+0000","last_clean":"2024-04-26T21:16:25.814886+0000","last_became_active":"2024-04-26T21:16:20.404560+0000","last_became_peered":"2024-04-26T21:16:20.404560+0000","last_unstale":"2024-04-26T21:16:25.814886+0000","last_undegraded":"2024-04-26T21:16:25.814886+0000","last_fullsized":"2024-04-26T21:16:25.814886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434871+0000","last_change":"2024-04-26T21:16:20.423831+0000","last_active":"2024-04-26T21:16:25.434871+0000","last_peered":"2024-04-26T21:16:25.434871+0000","last_clean":"2024-04-26T21:16:25.434871+0000","last_became_active":"2024-04-26T21:16:20.423542+0000","last_became_peered":"2024-04-26T21:16:20.423542+0000","last_unstale":"2024-04-26T21:16:25.434871+0000","last_undegraded":"2024-04-26T21:16:25.434871+0000","last_fullsized":"2024-04-26T21:16:25.434871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:43.515453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434469+0000","last_change":"2024-04-26T21:16:20.426806+0000","last_active":"2024-04-26T21:16:25.434469+0000","last_peered":"2024-04-26T21:16:25.434469+0000","last_clean":"2024-04-26T21:16:25.434469+0000","last_became_active":"2024-04-26T21:16:20.426446+0000","last_became_peered":"2024-04-26T21:16:20.426446+0000","last_unstale":"2024-04-26T21:16:25.434469+0000","last_undegraded":"2024-04-26T21:16:25.434469+0000","last_fullsized":"2024-04-26T21:16:25.434469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434639+0000","last_change":"2024-04-26T21:16:20.428440+0000","last_active":"2024-04-26T21:16:25.434639+0000","last_peered":"2024-04-26T21:16:25.434639+0000","last_clean":"2024-04-26T21:16:25.434639+0000","last_became_active":"2024-04-26T21:16:20.428074+0000","last_became_peered":"2024-04-26T21:16:20.428074+0000","last_unstale":"2024-04-26T21:16:25.434639+0000","last_undegraded":"2024-04-26T21:16:25.434639+0000","last_fullsized":"2024-04-26T21:16:25.434639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436896+0000","last_change":"2024-04-26T21:16:20.427736+0000","last_active":"2024-04-26T21:16:25.436896+0000","last_peered":"2024-04-26T21:16:25.436896+0000","last_clean":"2024-04-26T21:16:25.436896+0000","last_became_active":"2024-04-26T21:16:20.424657+0000","last_became_peered":"2024-04-26T21:16:20.424657+0000","last_unstale":"2024-04-26T21:16:25.436896+0000","last_undegraded":"2024-04-26T21:16:25.436896+0000","last_fullsized":"2024-04-26T21:16:25.436896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:41.767752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814210+0000","last_change":"2024-04-26T21:16:20.425895+0000","last_active":"2024-04-26T21:16:25.814210+0000","last_peered":"2024-04-26T21:16:25.814210+0000","last_clean":"2024-04-26T21:16:25.814210+0000","last_became_active":"2024-04-26T21:16:20.425580+0000","last_became_peered":"2024-04-26T21:16:20.425580+0000","last_unstale":"2024-04-26T21:16:25.814210+0000","last_undegraded":"2024-04-26T21:16:25.814210+0000","last_fullsized":"2024-04-26T21:16:25.814210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435717+0000","last_change":"2024-04-26T21:16:20.421664+0000","last_active":"2024-04-26T21:16:25.435717+0000","last_peered":"2024-04-26T21:16:25.435717+0000","last_clean":"2024-04-26T21:16:25.435717+0000","last_became_active":"2024-04-26T21:16:20.421311+0000","last_became_peered":"2024-04-26T21:16:20.421311+0000","last_unstale":"2024-04-26T21:16:25.435717+0000","last_undegraded":"2024-04-26T21:16:25.435717+0000","last_fullsized":"2024-04-26T21:16:25.435717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815976+0000","last_change":"2024-04-26T21:16:20.427879+0000","last_active":"2024-04-26T21:16:25.815976+0000","last_peered":"2024-04-26T21:16:25.815976+0000","last_clean":"2024-04-26T21:16:25.815976+0000","last_became_active":"2024-04-26T21:16:20.426632+0000","last_became_peered":"2024-04-26T21:16:20.426632+0000","last_unstale":"2024-04-26T21:16:25.815976+0000","last_undegraded":"2024-04-26T21:16:25.815976+0000","last_fullsized":"2024-04-26T21:16:25.815976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436067+0000","last_change":"2024-04-26T21:16:20.401403+0000","last_active":"2024-04-26T21:16:25.436067+0000","last_peered":"2024-04-26T21:16:25.436067+0000","last_clean":"2024-04-26T21:16:25.436067+0000","last_became_active":"2024-04-26T21:16:20.401084+0000","last_became_peered":"2024-04-26T21:16:20.401084+0000","last_unstale":"2024-04-26T21:16:25.436067+0000","last_undegraded":"2024-04-26T21:16:25.436067+0000","last_fullsized":"2024-04-26T21:16:25.436067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816320+0000","last_change":"2024-04-26T21:16:20.434210+0000","last_active":"2024-04-26T21:16:25.816320+0000","last_peered":"2024-04-26T21:16:25.816320+0000","last_clean":"2024-04-26T21:16:25.816320+0000","last_became_active":"2024-04-26T21:16:20.433607+0000","last_became_peered":"2024-04-26T21:16:20.433607+0000","last_unstale":"2024-04-26T21:16:25.816320+0000","last_undegraded":"2024-04-26T21:16:25.816320+0000","last_fullsized":"2024-04-26T21:16:25.816320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817053+0000","last_change":"2024-04-26T21:16:20.419582+0000","last_active":"2024-04-26T21:16:25.817053+0000","last_peered":"2024-04-26T21:16:25.817053+0000","last_clean":"2024-04-26T21:16:25.817053+0000","last_became_active":"2024-04-26T21:16:20.419259+0000","last_became_peered":"2024-04-26T21:16:20.419259+0000","last_unstale":"2024-04-26T21:16:25.817053+0000","last_undegraded":"2024-04-26T21:16:25.817053+0000","last_fullsized":"2024-04-26T21:16:25.817053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801509+0000","last_change":"2024-04-26T21:16:20.405606+0000","last_active":"2024-04-26T21:16:25.801509+0000","last_peered":"2024-04-26T21:16:25.801509+0000","last_clean":"2024-04-26T21:16:25.801509+0000","last_became_active":"2024-04-26T21:16:20.405265+0000","last_became_peered":"2024-04-26T21:16:20.405265+0000","last_unstale":"2024-04-26T21:16:25.801509+0000","last_undegraded":"2024-04-26T21:16:25.801509+0000","last_fullsized":"2024-04-26T21:16:25.801509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436755+0000","last_change":"2024-04-26T21:16:20.415452+0000","last_active":"2024-04-26T21:16:25.436755+0000","last_peered":"2024-04-26T21:16:25.436755+0000","last_clean":"2024-04-26T21:16:25.436755+0000","last_became_active":"2024-04-26T21:16:20.414915+0000","last_became_peered":"2024-04-26T21:16:20.414915+0000","last_unstale":"2024-04-26T21:16:25.436755+0000","last_undegraded":"2024-04-26T21:16:25.436755+0000","last_fullsized":"2024-04-26T21:16:25.436755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:58.416107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":110683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":701563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:16:39.938 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T21:16:39.938 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T21:16:39.938 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T21:16:39.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T21:16:39.939 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T21:16:40.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.107+0000 7f9de1800640 1 Processor -- start 2024-04-26T21:16:40.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.107+0000 7f9de1800640 1 -- start start 2024-04-26T21:16:40.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9de1800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc13ed60 0x7f9ddc15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9de1800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9ddc06eb70 0x7f9ddc0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9de1800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ddc0b3d10 con 0x7f9ddc13f140 2024-04-26T21:16:40.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9de1800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f9ddc0b3ac0 con 0x7f9ddc06eb70 2024-04-26T21:16:40.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9de1800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc0b4920 con 0x7f9ddc13ed60 2024-04-26T21:16:40.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9ddb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9ddc06eb70 0x7f9ddc0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9ddb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9ddc06eb70 0x7f9ddc0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40864/0 (socket says 172.21.15.106:40864) 2024-04-26T21:16:40.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9ddb400640 1 -- 172.21.15.106:0/2591571481 learned_addr learned my addr 172.21.15.106:0/2591571481 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:40.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9ddaa00640 1 --2- 172.21.15.106:0/2591571481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc13ed60 0x7f9ddc15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9ddb400640 1 -- 172.21.15.106:0/2591571481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc13ed60 msgr2=0x7f9ddc15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9ddb400640 1 --2- 172.21.15.106:0/2591571481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc13ed60 0x7f9ddc15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9ddb400640 1 -- 172.21.15.106:0/2591571481 >> v1:172.21.15.112:6789/0 conn(0x7f9ddc13f140 legacy=0x7f9ddc0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.111+0000 7f9ddb400640 1 -- 172.21.15.106:0/2591571481 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc0b3ff0 con 0x7f9ddc06eb70 2024-04-26T21:16:40.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9ddb400640 1 --2- 172.21.15.106:0/2591571481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc06eb70 0x7f9ddc0d0df0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc06e5c0 tx=0x7f9dd401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d0ca8e44033cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:40.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9dd9600640 1 -- 172.21.15.106:0/2591571481 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40b0070 con 0x7f9ddc06eb70 2024-04-26T21:16:40.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9dd9600640 1 -- 172.21.15.106:0/2591571481 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd40ab600 con 0x7f9ddc06eb70 2024-04-26T21:16:40.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9dd9600640 1 -- 172.21.15.106:0/2591571481 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40ab9d0 con 0x7f9ddc06eb70 2024-04-26T21:16:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 -- 172.21.15.106:0/2591571481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc06eb70 msgr2=0x7f9ddc0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 --2- 172.21.15.106:0/2591571481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc06eb70 0x7f9ddc0d0df0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc06e5c0 tx=0x7f9dd401c3c0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 -- 172.21.15.106:0/2591571481 shutdown_connections 2024-04-26T21:16:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 --2- 172.21.15.106:0/2591571481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc06eb70 0x7f9ddc0d0df0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 --2- 172.21.15.106:0/2591571481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc13ed60 0x7f9ddc15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 -- 172.21.15.106:0/2591571481 >> 172.21.15.106:0/2591571481 conn(0x7f9ddc068340 msgr2=0x7f9ddc068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 -- 172.21.15.106:0/2591571481 shutdown_connections 2024-04-26T21:16:40.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 -- 172.21.15.106:0/2591571481 wait complete. 2024-04-26T21:16:40.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 Processor -- start 2024-04-26T21:16:40.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 -- start start 2024-04-26T21:16:40.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc13ed60 0x7f9ddc1f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc13e320 0x7f9ddc161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc15b7a0 0x7f9ddc15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc1607d0 con 0x7f9ddc13e320 2024-04-26T21:16:40.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc160650 con 0x7f9ddc13ed60 2024-04-26T21:16:40.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9de1800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc168b60 con 0x7f9ddc15b7a0 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.115+0000 7f9dda000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc13e320 0x7f9ddc161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dda000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc13e320 0x7f9ddc161870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40876/0 (socket says 172.21.15.106:40876) 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dda000640 1 -- 172.21.15.106:0/2966219927 learned_addr learned my addr 172.21.15.106:0/2966219927 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9ddb400640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc15b7a0 0x7f9ddc15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9ddaa00640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc13ed60 0x7f9ddc1f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dda000640 1 -- 172.21.15.106:0/2966219927 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc15b7a0 msgr2=0x7f9ddc15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dda000640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc15b7a0 0x7f9ddc15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dda000640 1 -- 172.21.15.106:0/2966219927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc13ed60 msgr2=0x7f9ddc1f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dda000640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc13ed60 0x7f9ddc1f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dda000640 1 -- 172.21.15.106:0/2966219927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc162150 con 0x7f9ddc13e320 2024-04-26T21:16:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dda000640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc13e320 0x7f9ddc161870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800b440 tx=0x7f9dc800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:40.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dd2a00640 1 -- 172.21.15.106:0/2966219927 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8015020 con 0x7f9ddc13e320 2024-04-26T21:16:40.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dd2a00640 1 -- 172.21.15.106:0/2966219927 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc8011830 con 0x7f9ddc13e320 2024-04-26T21:16:40.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dd2a00640 1 -- 172.21.15.106:0/2966219927 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8011c20 con 0x7f9ddc13e320 2024-04-26T21:16:40.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc162430 con 0x7f9ddc13e320 2024-04-26T21:16:40.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc1629f0 con 0x7f9ddc13e320 2024-04-26T21:16:40.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ddc069400 con 0x7f9ddc13e320 2024-04-26T21:16:40.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dd2a00640 1 -- 172.21.15.106:0/2966219927 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9dc8018020 con 0x7f9ddc13e320 2024-04-26T21:16:40.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.119+0000 7f9dd2a00640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9dbc068380 0x7f9dbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.123+0000 7f9dd2a00640 1 -- 172.21.15.106:0/2966219927 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9dc8086820 con 0x7f9ddc13e320 2024-04-26T21:16:40.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.123+0000 7f9ddaa00640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9dbc068380 0x7f9dbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.123+0000 7f9ddaa00640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9dbc068380 0x7f9dbc06a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc003b90 tx=0x7f9dcc0098d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:40.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.127+0000 7f9dd2a00640 1 -- 172.21.15.106:0/2966219927 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9dc801f030 con 0x7f9ddc13e320 2024-04-26T21:16:40.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.319+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9ddc068a00 con 0x7f9ddc13e320 2024-04-26T21:16:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.323+0000 7f9dd2a00640 1 -- 172.21.15.106:0/2966219927 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168091 (secure 0 0 0) 0x7f9dc80563b0 con 0x7f9ddc13e320 2024-04-26T21:16:40.328 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9dbc068380 msgr2=0x7f9dbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9dbc068380 0x7f9dbc06a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc003b90 tx=0x7f9dcc0098d0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc13e320 msgr2=0x7f9ddc161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc13e320 0x7f9ddc161870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800b440 tx=0x7f9dc800b900 comp rx=0 tx=0).stop 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 shutdown_connections 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9dbc068380 0x7f9dbc06a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ddc15b7a0 0x7f9ddc15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ddc13e320 0x7f9ddc161870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 --2- 172.21.15.106:0/2966219927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ddc13ed60 0x7f9ddc1f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 >> 172.21.15.106:0/2966219927 conn(0x7f9ddc068340 msgr2=0x7f9ddc0cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:40.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 shutdown_connections 2024-04-26T21:16:40.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.327+0000 7f9de1800640 1 -- 172.21.15.106:0/2966219927 wait complete. 2024-04-26T21:16:40.348 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3357608223},{"type":"v1","addr":"172.21.15.106:6833","nonce":3357608223}]},"active_addr":"172.21.15.106:6833/3357608223","active_change":"2024-04-26T21:16:00.275272+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":4168426113}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":4179380400}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":977493713}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3449984825}]}]} 2024-04-26T21:16:40.352 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T21:16:40.352 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T21:16:40.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:40.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.487+0000 7fa44a200640 1 Processor -- start 2024-04-26T21:16:40.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.487+0000 7fa44a200640 1 -- start start 2024-04-26T21:16:40.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa44a200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa44413f140 0x7fa44415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa44a200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4440b3d10 con 0x7fa44406eb70 2024-04-26T21:16:40.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa44a200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4440b3ff0 con 0x7fa44413ed60 2024-04-26T21:16:40.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa44a200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fa4440b3ac0 con 0x7fa44413f140 2024-04-26T21:16:40.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa442a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa44413f140 0x7fa44415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa443e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa44406eb70 0x7fa4440d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34818/0 (socket says 172.21.15.106:34818) 2024-04-26T21:16:40.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa442a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa44413f140 0x7fa44415c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40888/0 (socket says 172.21.15.106:40888) 2024-04-26T21:16:40.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa443e00640 1 -- 172.21.15.106:0/3233775511 learned_addr learned my addr 172.21.15.106:0/3233775511 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:40.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa442a00640 1 -- 172.21.15.106:0/3233775511 >> v1:172.21.15.112:6789/0 conn(0x7fa44413ed60 legacy=0x7fa4440b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa442a00640 1 -- 172.21.15.106:0/3233775511 >> v1:172.21.15.106:6789/0 conn(0x7fa44406eb70 legacy=0x7fa4440d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.491+0000 7fa442a00640 1 -- 172.21.15.106:0/3233775511 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4440b42d0 con 0x7fa44413f140 2024-04-26T21:16:40.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa442a00640 1 --2- 172.21.15.106:0/3233775511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa44413f140 0x7fa44415c3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa4300097c0 tx=0x7fa43001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973b0436ea3c95c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:40.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa442000640 1 -- 172.21.15.106:0/3233775511 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4300b0070 con 0x7fa44413f140 2024-04-26T21:16:40.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa442000640 1 -- 172.21.15.106:0/3233775511 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4300ab600 con 0x7fa44413f140 2024-04-26T21:16:40.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa442000640 1 -- 172.21.15.106:0/3233775511 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4300ab9d0 con 0x7fa44413f140 2024-04-26T21:16:40.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa44a200640 1 -- 172.21.15.106:0/3233775511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa44413f140 msgr2=0x7fa44415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa44a200640 1 --2- 172.21.15.106:0/3233775511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa44413f140 0x7fa44415c3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa4300097c0 tx=0x7fa43001c380 comp rx=0 tx=0).stop 2024-04-26T21:16:40.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa44a200640 1 -- 172.21.15.106:0/3233775511 shutdown_connections 2024-04-26T21:16:40.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa44a200640 1 --2- 172.21.15.106:0/3233775511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa44413f140 0x7fa44415c3e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa44a200640 1 -- 172.21.15.106:0/3233775511 >> 172.21.15.106:0/3233775511 conn(0x7fa444068340 msgr2=0x7fa444068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:40.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa44a200640 1 -- 172.21.15.106:0/3233775511 shutdown_connections 2024-04-26T21:16:40.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa44a200640 1 -- 172.21.15.106:0/3233775511 wait complete. 2024-04-26T21:16:40.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa44a200640 1 Processor -- start 2024-04-26T21:16:40.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.495+0000 7fa44a200640 1 -- start start 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa44a200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44413ed60 0x7fa444143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa44a200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44415b4d0 0x7fa44415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa44a200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa444071f50 0x7fa4440723d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa44a200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa444160400 con 0x7fa444071f50 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa44a200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440d1710 con 0x7fa44413ed60 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa44a200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa444160580 con 0x7fa44415b4d0 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa444071f50 0x7fa4440723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa444071f50 0x7fa4440723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40892/0 (socket says 172.21.15.106:40892) 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443e00640 1 -- 172.21.15.106:0/1730609968 learned_addr learned my addr 172.21.15.106:0/1730609968 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443400640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44413ed60 0x7fa444143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa442a00640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44415b4d0 0x7fa44415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443e00640 1 -- 172.21.15.106:0/1730609968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44415b4d0 msgr2=0x7fa44415ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443e00640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44415b4d0 0x7fa44415ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443e00640 1 -- 172.21.15.106:0/1730609968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44413ed60 msgr2=0x7fa444143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443e00640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44413ed60 0x7fa444143c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443e00640 1 -- 172.21.15.106:0/1730609968 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4441453b0 con 0x7fa444071f50 2024-04-26T21:16:40.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa443e00640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa444071f50 0x7fa4440723d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00cbc0 tx=0x7fa43c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:40.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa43b400640 1 -- 172.21.15.106:0/1730609968 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c017070 con 0x7fa444071f50 2024-04-26T21:16:40.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa43b400640 1 -- 172.21.15.106:0/1730609968 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43c00ad40 con 0x7fa444071f50 2024-04-26T21:16:40.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa444144310 con 0x7fa444071f50 2024-04-26T21:16:40.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa43b400640 1 -- 172.21.15.106:0/1730609968 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c012600 con 0x7fa444071f50 2024-04-26T21:16:40.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4441448d0 con 0x7fa444071f50 2024-04-26T21:16:40.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa444069400 con 0x7fa444071f50 2024-04-26T21:16:40.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.499+0000 7fa43b400640 1 -- 172.21.15.106:0/1730609968 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa43c01a070 con 0x7fa444071f50 2024-04-26T21:16:40.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.503+0000 7fa43b400640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa424068380 0x7fa42406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.503+0000 7fa43b400640 1 -- 172.21.15.106:0/1730609968 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa43c086960 con 0x7fa444071f50 2024-04-26T21:16:40.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.503+0000 7fa443400640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa424068380 0x7fa42406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.503+0000 7fa443400640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa424068380 0x7fa42406a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa434001810 tx=0x7fa434009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:40.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.507+0000 7fa43b400640 1 -- 172.21.15.106:0/1730609968 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa4441453b0 con 0x7fa444071f50 2024-04-26T21:16:40.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.663+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4440cf310 con 0x7fa444071f50 2024-04-26T21:16:40.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.663+0000 7fa43b400640 1 -- 172.21.15.106:0/1730609968 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7fa43c056580 con 0x7fa444071f50 2024-04-26T21:16:40.668 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:40.668 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:40.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa424068380 msgr2=0x7fa42406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa424068380 0x7fa42406a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa434001810 tx=0x7fa434009040 comp rx=0 tx=0).stop 2024-04-26T21:16:40.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa444071f50 msgr2=0x7fa4440723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa444071f50 0x7fa4440723d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00cbc0 tx=0x7fa43c00a430 comp rx=0 tx=0).stop 2024-04-26T21:16:40.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 shutdown_connections 2024-04-26T21:16:40.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa424068380 0x7fa42406a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa444071f50 0x7fa4440723d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa44415b4d0 0x7fa44415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 --2- 172.21.15.106:0/1730609968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa44413ed60 0x7fa444143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 >> 172.21.15.106:0/1730609968 conn(0x7fa444068340 msgr2=0x7fa4440ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:40.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 shutdown_connections 2024-04-26T21:16:40.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.667+0000 7fa44a200640 1 -- 172.21.15.106:0/1730609968 wait complete. 2024-04-26T21:16:40.689 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T21:16:40.690 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:40.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e9c600640 1 Processor -- start 2024-04-26T21:16:40.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e9c600640 1 -- start start 2024-04-26T21:16:40.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e9c600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3e9413ed60 0x7f3e9415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e9c600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e9413f140 0x7f3e940b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e9c600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e940b3d10 con 0x7f3e9406eb70 2024-04-26T21:16:40.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e9c600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f3e940b3ac0 con 0x7f3e9413f140 2024-04-26T21:16:40.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e9c600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3e940b4920 con 0x7f3e9413ed60 2024-04-26T21:16:40.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e99200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e9413f140 0x7f3e940b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e99200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e9413f140 0x7f3e940b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40902/0 (socket says 172.21.15.106:40902) 2024-04-26T21:16:40.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e99200640 1 -- 172.21.15.106:0/3786815739 learned_addr learned my addr 172.21.15.106:0/3786815739 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:40.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e99c00640 1 --2- 172.21.15.106:0/3786815739 >> v2:172.21.15.112:3300/0 conn(0x7f3e9413ed60 0x7f3e9415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e99200640 1 -- 172.21.15.106:0/3786815739 >> v2:172.21.15.112:3300/0 conn(0x7f3e9413ed60 msgr2=0x7f3e9415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:40.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e99200640 1 --2- 172.21.15.106:0/3786815739 >> v2:172.21.15.112:3300/0 conn(0x7f3e9413ed60 0x7f3e9415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e99200640 1 -- 172.21.15.106:0/3786815739 >> v1:172.21.15.112:6789/0 conn(0x7f3e9406eb70 legacy=0x7f3e940d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.823+0000 7f3e99200640 1 -- 172.21.15.106:0/3786815739 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940b3ff0 con 0x7f3e9413f140 2024-04-26T21:16:40.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e99200640 1 --2- 172.21.15.106:0/3786815739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e9413f140 0x7f3e940b52e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3e94074400 tx=0x7f3e8001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d0427b7e3c3b8e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:40.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e93e00640 1 -- 172.21.15.106:0/3786815739 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e800ab600 con 0x7f3e9413f140 2024-04-26T21:16:40.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e93e00640 1 -- 172.21.15.106:0/3786815739 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e800b0070 con 0x7f3e9413f140 2024-04-26T21:16:40.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e93e00640 1 -- 172.21.15.106:0/3786815739 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e800ab9c0 con 0x7f3e9413f140 2024-04-26T21:16:40.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e9c600640 1 -- 172.21.15.106:0/3786815739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e9413f140 msgr2=0x7f3e940b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e9c600640 1 --2- 172.21.15.106:0/3786815739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e9413f140 0x7f3e940b52e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3e94074400 tx=0x7f3e8001c400 comp rx=0 tx=0).stop 2024-04-26T21:16:40.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e9c600640 1 -- 172.21.15.106:0/3786815739 shutdown_connections 2024-04-26T21:16:40.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e9c600640 1 --2- 172.21.15.106:0/3786815739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e9413f140 0x7f3e940b52e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e9c600640 1 --2- 172.21.15.106:0/3786815739 >> v2:172.21.15.112:3300/0 conn(0x7f3e9413ed60 0x7f3e9415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e9c600640 1 -- 172.21.15.106:0/3786815739 >> 172.21.15.106:0/3786815739 conn(0x7f3e94068340 msgr2=0x7f3e94068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:40.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e9c600640 1 -- 172.21.15.106:0/3786815739 shutdown_connections 2024-04-26T21:16:40.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e9c600640 1 -- 172.21.15.106:0/3786815739 wait complete. 2024-04-26T21:16:40.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.827+0000 7f3e9c600640 1 Processor -- start 2024-04-26T21:16:40.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 -- start start 2024-04-26T21:16:40.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e9413ed60 0x7f3e9415ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940b1940 0x7f3e94153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e94154250 0x7f3e9413a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940d1680 con 0x7f3e940b1940 2024-04-26T21:16:40.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940d1500 con 0x7f3e94154250 2024-04-26T21:16:40.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3e94160400 con 0x7f3e9413ed60 2024-04-26T21:16:40.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940b1940 0x7f3e94153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940b1940 0x7f3e94153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40904/0 (socket says 172.21.15.106:40904) 2024-04-26T21:16:40.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99200640 1 -- 172.21.15.106:0/1058825382 learned_addr learned my addr 172.21.15.106:0/1058825382 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99c00640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e9413ed60 0x7f3e9415ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9a600640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e94154250 0x7f3e9413a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99200640 1 -- 172.21.15.106:0/1058825382 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e9413ed60 msgr2=0x7f3e9415ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99200640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e9413ed60 0x7f3e9415ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99200640 1 -- 172.21.15.106:0/1058825382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e94154250 msgr2=0x7f3e9413a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99200640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e94154250 0x7f3e9413a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99200640 1 -- 172.21.15.106:0/1058825382 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9415f290 con 0x7f3e940b1940 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9a600640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e94154250 0x7f3e9413a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e99200640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940b1940 0x7f3e94153d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e8001a030 tx=0x7f3e8001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e91600640 1 -- 172.21.15.106:0/1058825382 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e800be5f0 con 0x7f3e940b1940 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e91600640 1 -- 172.21.15.106:0/1058825382 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e800be7b0 con 0x7f3e940b1940 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9415dcb0 con 0x7f3e940b1940 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e91600640 1 -- 172.21.15.106:0/1058825382 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e800beba0 con 0x7f3e940b1940 2024-04-26T21:16:40.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9415e270 con 0x7f3e940b1940 2024-04-26T21:16:40.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.831+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e94069400 con 0x7f3e940b1940 2024-04-26T21:16:40.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.835+0000 7f3e91600640 1 -- 172.21.15.106:0/1058825382 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e800aa070 con 0x7f3e940b1940 2024-04-26T21:16:40.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.835+0000 7f3e91600640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e740683b0 0x7f3e7406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:40.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.835+0000 7f3e91600640 1 -- 172.21.15.106:0/1058825382 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3e80120d00 con 0x7f3e940b1940 2024-04-26T21:16:40.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.835+0000 7f3e99c00640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e740683b0 0x7f3e7406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:40.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.835+0000 7f3e99c00640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e740683b0 0x7f3e7406a870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009b60 tx=0x7f3e88009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:40.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.839+0000 7f3e91600640 1 -- 172.21.15.106:0/1058825382 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3e800c4060 con 0x7f3e940b1940 2024-04-26T21:16:40.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.995+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e940cd070 con 0x7f3e940b1940 2024-04-26T21:16:40.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.995+0000 7f3e91600640 1 -- 172.21.15.106:0/1058825382 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7f3e80016110 con 0x7f3e940b1940 2024-04-26T21:16:40.999 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:40.999 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:41.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e740683b0 msgr2=0x7f3e7406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e740683b0 0x7f3e7406a870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009b60 tx=0x7f3e88009190 comp rx=0 tx=0).stop 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940b1940 msgr2=0x7f3e94153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940b1940 0x7f3e94153d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e8001a030 tx=0x7f3e8001ac40 comp rx=0 tx=0).stop 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 shutdown_connections 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e94154250 0x7f3e9413a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e740683b0 0x7f3e7406a870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e940b1940 0x7f3e94153d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 --2- 172.21.15.106:0/1058825382 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e9413ed60 0x7f3e9415ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 >> 172.21.15.106:0/1058825382 conn(0x7f3e94068340 msgr2=0x7f3e94167440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 shutdown_connections 2024-04-26T21:16:41.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:40.999+0000 7f3e9c600640 1 -- 172.21.15.106:0/1058825382 wait complete. 2024-04-26T21:16:41.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T21:16:41.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T21:16:41.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T21:16:41.022 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T21:16:41.022 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T21:16:41.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T21:16:41.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T21:16:41.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T21:16:41.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.259+0000 7f8bd7000640 1 Processor -- start 2024-04-26T21:16:41.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.259+0000 7f8bd7000640 1 -- start start 2024-04-26T21:16:41.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.259+0000 7f72ff600640 1 Processor -- start 2024-04-26T21:16:41.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.259+0000 7f72ff600640 1 -- start start 2024-04-26T21:16:41.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bd7000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8bc80f04a0 0x7f8bc80f2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bd7000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc8034220 con 0x7f8bc8033e40 2024-04-26T21:16:41.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bd7000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc804fa30 con 0x7f8bc8047c20 2024-04-26T21:16:41.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bd7000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8bc8050210 con 0x7f8bc80f04a0 2024-04-26T21:16:41.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72ff600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0006290 0x7f72f003a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72ff600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f004fdf0 con 0x7f72f0050e10 2024-04-26T21:16:41.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72ff600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f00500d0 con 0x7f72f00e33d0 2024-04-26T21:16:41.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72ff600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f72f0038ec0 con 0x7f72f0006290 2024-04-26T21:16:41.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcfe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8bc8033e40 0x7f8bc80eb180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34832/0 (socket says 172.21.15.106:34832) 2024-04-26T21:16:41.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcfe00640 1 -- 172.21.15.106:0/2530669984 learned_addr learned my addr 172.21.15.106:0/2530669984 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:41.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bd5000640 1 --2- 172.21.15.106:0/2530669984 >> v2:172.21.15.112:3300/0 conn(0x7f8bc80f04a0 0x7f8bc80f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153515185 0 0) 0x7f8bc804fa30 con 0x7f8bc8047c20 2024-04-26T21:16:41.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72fcc00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f72f00e33d0 0x7f72f0050700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:43906/0 (socket says 172.21.15.106:43906) 2024-04-26T21:16:41.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72fcc00640 1 -- 172.21.15.106:0/96082231 learned_addr learned my addr 172.21.15.106:0/96082231 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:41.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bb8003530 con 0x7f8bc8047c20 2024-04-26T21:16:41.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72fd600640 1 --2- 172.21.15.106:0/96082231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0006290 0x7f72f003a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584801536 0 0) 0x7f8bc8034220 con 0x7f8bc8033e40 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bc804fa30 con 0x7f8bc8033e40 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 <== mon.1 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3592051758 0 0) 0x7f8bb8003530 con 0x7f8bc8047c20 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 >> v2:172.21.15.112:3300/0 conn(0x7f8bc80f04a0 msgr2=0x7f8bc80f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 --2- 172.21.15.106:0/2530669984 >> v2:172.21.15.112:3300/0 conn(0x7f8bc80f04a0 0x7f8bc80f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 >> v1:172.21.15.106:6789/0 conn(0x7f8bc8033e40 legacy=0x7f8bc80eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc804f2e0 con 0x7f8bc8047c20 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 <== mon.1 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f8bc4001680 con 0x7f8bc8047c20 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 >> v1:172.21.15.112:6789/0 conn(0x7f8bc8047c20 legacy=0x7f8bc80eb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb8003ba0 0x7f8bb8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bb8004810 0x7f8bb8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb80052f0 0x7f8bb800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc8050210 con 0x7f8bb8004810 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb800c1a0 con 0x7f8bb8003ba0 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb800c3a0 con 0x7f8bb80052f0 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f8bcf400640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bb8004810 0x7f8bb8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f8bd5000640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb80052f0 0x7f8bb800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f8bcfe00640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb8003ba0 0x7f8bb8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f8bcf400640 1 -- 172.21.15.106:0/2530669984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb80052f0 msgr2=0x7f8bb800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f8bcf400640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb80052f0 0x7f8bb800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f8bcf400640 1 -- 172.21.15.106:0/2530669984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb8003ba0 msgr2=0x7f8bb8003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f8bcf400640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb8003ba0 0x7f8bb8003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f8bcf400640 1 -- 172.21.15.106:0/2530669984 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb8003530 con 0x7f8bb8004810 2024-04-26T21:16:41.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f9913600640 1 Processor -- start 2024-04-26T21:16:41.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72f7400640 1 -- 172.21.15.106:0/96082231 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594839704 0 0) 0x7f72f00500d0 con 0x7f72f00e33d0 2024-04-26T21:16:41.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72f7400640 1 -- 172.21.15.106:0/96082231 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e0005740 con 0x7f72f00e33d0 2024-04-26T21:16:41.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72fd600640 1 -- 172.21.15.106:0/96082231 >> v1:172.21.15.112:6789/0 conn(0x7f72f00e33d0 legacy=0x7f72f0050700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72fd600640 1 -- 172.21.15.106:0/96082231 >> v1:172.21.15.106:6789/0 conn(0x7f72f0050e10 legacy=0x7f72f00396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f8bd5000640 1 -- 172.21.15.106:0/2530669984 reap_dead start 2024-04-26T21:16:41.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f8bcfe00640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb8003ba0 0x7f8bb8003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.263+0000 7f72fd600640 1 -- 172.21.15.106:0/96082231 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f00391a0 con 0x7f72f0006290 2024-04-26T21:16:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f9913600640 1 -- start start 2024-04-26T21:16:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f4c62000640 1 Processor -- start 2024-04-26T21:16:41.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.267+0000 7f35f0800640 1 Processor -- start 2024-04-26T21:16:41.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f4c62000640 1 -- start start 2024-04-26T21:16:41.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9913600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904055620 0x7f99040df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72fd600640 1 --2- 172.21.15.106:0/96082231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0006290 0x7f72f003a640 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72e40097f0 tx=0x7f72e401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3cfdd425851c25b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9913600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9904053c40 0x7f99040380c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9913600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9904005f70 con 0x7f9904033e50 2024-04-26T21:16:41.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9913600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f99040541b0 con 0x7f9904053c40 2024-04-26T21:16:41.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9913600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9904006210 con 0x7f9904055620 2024-04-26T21:16:41.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9910c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904055620 0x7f99040df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9910c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904055620 0x7f99040df3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49296/0 (socket says 172.21.15.106:49296) 2024-04-26T21:16:41.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9910c00640 1 -- 172.21.15.106:0/910597039 learned_addr learned my addr 172.21.15.106:0/910597039 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72f7400640 1 -- 172.21.15.106:0/96082231 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e40b2070 con 0x7f72f0006290 2024-04-26T21:16:41.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72f7400640 1 -- 172.21.15.106:0/96082231 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e40ad680 con 0x7f72f0006290 2024-04-26T21:16:41.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72f7400640 1 -- 172.21.15.106:0/96082231 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e40ada50 con 0x7f72f0006290 2024-04-26T21:16:41.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35f0800640 1 -- start start 2024-04-26T21:16:41.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9910c00640 1 -- 172.21.15.106:0/910597039 >> v2:172.21.15.106:3300/0 conn(0x7f9904053c40 msgr2=0x7f99040380c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9910c00640 1 --2- 172.21.15.106:0/910597039 >> v2:172.21.15.106:3300/0 conn(0x7f9904053c40 0x7f99040380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9910c00640 1 -- 172.21.15.106:0/910597039 >> v1:172.21.15.112:6789/0 conn(0x7f9904033e50 legacy=0x7f990404fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f8bcf400640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bb8004810 0x7f8bb8004c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4007ed0 tx=0x7f8bc401f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864925ed3f8f92cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72ff600640 1 -- 172.21.15.106:0/96082231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0006290 msgr2=0x7f72f003a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72ff600640 1 --2- 172.21.15.106:0/96082231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0006290 0x7f72f003a640 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72e40097f0 tx=0x7f72e401c4a0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f9910c00640 1 -- 172.21.15.106:0/910597039 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99040064f0 con 0x7f9904055620 2024-04-26T21:16:41.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72ff600640 1 -- 172.21.15.106:0/96082231 shutdown_connections 2024-04-26T21:16:41.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72ff600640 1 --2- 172.21.15.106:0/96082231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0006290 0x7f72f003a640 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72ff600640 1 -- 172.21.15.106:0/96082231 >> 172.21.15.106:0/96082231 conn(0x7f72f0009fc0 msgr2=0x7f72f000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35f0800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80b2ed0 0x7f35e8141600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72ff600640 1 -- 172.21.15.106:0/96082231 shutdown_connections 2024-04-26T21:16:41.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35f0800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f35e815ecf0 0x7f35e815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35f0800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e806f4b0 con 0x7f35e806df80 2024-04-26T21:16:41.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35f0800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f35e8141b40 con 0x7f35e815ecf0 2024-04-26T21:16:41.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35f0800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f35e80b5f80 con 0x7f35e80b2ed0 2024-04-26T21:16:41.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35ede00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f35e806df80 0x7f35e80b5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34850/0 (socket says 172.21.15.106:34850) 2024-04-26T21:16:41.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35ede00640 1 -- 172.21.15.106:0/827571301 learned_addr learned my addr 172.21.15.106:0/827571301 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:41.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40b5070 con 0x7f8bb8004810 2024-04-26T21:16:41.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f72ff600640 1 -- 172.21.15.106:0/96082231 wait complete. 2024-04-26T21:16:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35ee800640 1 --2- 172.21.15.106:0/827571301 >> v2:172.21.15.112:3300/0 conn(0x7f35e815ecf0 0x7f35e815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35ed400640 1 --2- 172.21.15.106:0/827571301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80b2ed0 0x7f35e8141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc40a8d90 con 0x7f8bb8004810 2024-04-26T21:16:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f8bcea00640 1 -- 172.21.15.106:0/2530669984 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4007b20 con 0x7f8bb8004810 2024-04-26T21:16:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f4c62000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c5c15f950 0x7f4c5c15fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f4c62000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c5c0b44e0 0x7f4c5c160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f4c62000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c06ecc0 con 0x7f4c5c06e820 2024-04-26T21:16:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f4c62000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4c5c06efa0 con 0x7f4c5c0b44e0 2024-04-26T21:16:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f4c62000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5c06f280 con 0x7f4c5c15f950 2024-04-26T21:16:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f6ff3c00640 1 Processor -- start 2024-04-26T21:16:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f8bd7000640 1 -- 172.21.15.106:0/2530669984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bb8004810 msgr2=0x7f8bb8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f8bd7000640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bb8004810 0x7f8bb8004c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4007ed0 tx=0x7f8bc401f170 comp rx=0 tx=0).stop 2024-04-26T21:16:41.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35ee800640 1 -- 172.21.15.106:0/827571301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80b2ed0 msgr2=0x7f35e8141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35ee800640 1 --2- 172.21.15.106:0/827571301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80b2ed0 0x7f35e8141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35ee800640 1 -- 172.21.15.106:0/827571301 >> v1:172.21.15.106:6789/0 conn(0x7f35e806df80 legacy=0x7f35e80b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.271+0000 7f35ee800640 1 -- 172.21.15.106:0/827571301 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e806e410 con 0x7f35e815ecf0 2024-04-26T21:16:41.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb759800640 1 Processor -- start 2024-04-26T21:16:41.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb759800640 1 -- start start 2024-04-26T21:16:41.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f8bd7000640 1 -- 172.21.15.106:0/2530669984 shutdown_connections 2024-04-26T21:16:41.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f8bd7000640 1 --2- 172.21.15.106:0/2530669984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bb8004810 0x7f8bb8004c90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f8bd7000640 1 -- 172.21.15.106:0/2530669984 >> 172.21.15.106:0/2530669984 conn(0x7f8bc8009fc0 msgr2=0x7f8bc800a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f4c5be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c5c0b44e0 0x7f4c5c160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f4c5be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c5c0b44e0 0x7f4c5c160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40938/0 (socket says 172.21.15.106:40938) 2024-04-26T21:16:41.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f4c5be00640 1 -- 172.21.15.106:0/529451859 learned_addr learned my addr 172.21.15.106:0/529451859 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f4c53e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4c5c06e820 0x7f4c5c0b3dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34852/0 (socket says 172.21.15.106:34852) 2024-04-26T21:16:41.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f6ff3c00640 1 -- start start 2024-04-26T21:16:41.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f72ff600640 1 Processor -- start 2024-04-26T21:16:41.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f4c5b400640 1 --2- 172.21.15.106:0/529451859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c5c15f950 0x7f4c5c15fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f4c5be00640 1 -- 172.21.15.106:0/529451859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c5c15f950 msgr2=0x7f4c5c15fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb759800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04e760 0x7fb74c0339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb759800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb74c038640 0x7fb74c0500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f4c5be00640 1 --2- 172.21.15.106:0/529451859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c5c15f950 0x7f4c5c15fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb759800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb74c050610 con 0x7fb74c039e60 2024-04-26T21:16:41.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb759800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb74c050d20 con 0x7fb74c038640 2024-04-26T21:16:41.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb759800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb74c051000 con 0x7fb74c04e760 2024-04-26T21:16:41.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f8bd7000640 1 -- 172.21.15.106:0/2530669984 shutdown_connections 2024-04-26T21:16:41.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f8bd7000640 1 -- 172.21.15.106:0/2530669984 wait complete. 2024-04-26T21:16:41.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f72ff600640 1 -- start start 2024-04-26T21:16:41.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f4c5be00640 1 -- 172.21.15.106:0/529451859 >> v1:172.21.15.106:6789/0 conn(0x7f4c5c06e820 legacy=0x7f4c5c0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f4c5be00640 1 -- 172.21.15.106:0/529451859 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c06f560 con 0x7f4c5c0b44e0 2024-04-26T21:16:41.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb753e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04e760 0x7fb74c0339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb753e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04e760 0x7fb74c0339c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49316/0 (socket says 172.21.15.106:49316) 2024-04-26T21:16:41.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb753e00640 1 -- 172.21.15.106:0/1671036437 learned_addr learned my addr 172.21.15.106:0/1671036437 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f6ff3c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6fe40e6cd0 0x7f6fe4053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f6ff3c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6fe4053750 0x7f6fe40e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f6ff3c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe40e75f0 con 0x7f6fe403c100 2024-04-26T21:16:41.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f6ff3c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe40e3640 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7f6ff3c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe40061d0 con 0x7f6fe4053750 2024-04-26T21:16:41.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb753400640 1 --2- 172.21.15.106:0/1671036437 >> v2:172.21.15.112:3300/0 conn(0x7fb74c038640 0x7fb74c0500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb753e00640 1 -- 172.21.15.106:0/1671036437 >> v2:172.21.15.112:3300/0 conn(0x7fb74c038640 msgr2=0x7fb74c0500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.275+0000 7fb753e00640 1 --2- 172.21.15.106:0/1671036437 >> v2:172.21.15.112:3300/0 conn(0x7fb74c038640 0x7fb74c0500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72ff600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f0006290 0x7f72f00e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72ff600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0050e10 0x7f72f00dbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72ff600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72f00e33d0 0x7f72f0182640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72ff600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f72f00e37b0 con 0x7f72f00e33d0 2024-04-26T21:16:41.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72ff600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72f00503b0 con 0x7f72f0006290 2024-04-26T21:16:41.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72ff600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f72f0006f40 con 0x7f72f0050e10 2024-04-26T21:16:41.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72fcc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f0006290 0x7f72f00e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72fcc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f0006290 0x7f72f00e0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44248/0 (socket says 172.21.15.106:44248) 2024-04-26T21:16:41.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72fcc00640 1 -- 172.21.15.106:0/2299625557 learned_addr learned my addr 172.21.15.106:0/2299625557 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f6febe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6fe4053750 0x7f6fe40e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f6ff1200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6fe40e6cd0 0x7f6fe4053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f6ff1200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6fe40e6cd0 0x7f6fe4053f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40946/0 (socket says 172.21.15.106:40946) 2024-04-26T21:16:41.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f6ff1200640 1 -- 172.21.15.106:0/2759336832 learned_addr learned my addr 172.21.15.106:0/2759336832 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f8bd7000640 1 Processor -- start 2024-04-26T21:16:41.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72fd600640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72f00e33d0 0x7f72f0182640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f8bd7000640 1 -- start start 2024-04-26T21:16:41.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f9910c00640 1 --2- 172.21.15.106:0/910597039 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904055620 0x7f99040df3e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009870 tx=0x7f98f801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4446680e439a8aad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f35ee800640 1 --2- 172.21.15.106:0/827571301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 0x7f35e815f1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009dc0 tx=0x7f35e401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=389196ae5a319744 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72fcc00640 1 -- 172.21.15.106:0/2299625557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0050e10 msgr2=0x7f72f00dbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f990b400640 1 -- 172.21.15.106:0/910597039 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f80b0070 con 0x7f9904055620 2024-04-26T21:16:41.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72f7e00640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0050e10 0x7f72f00dbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72fcc00640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0050e10 0x7f72f00dbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72fcc00640 1 -- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72f00e33d0 msgr2=0x7f72f0182640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72fcc00640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72f00e33d0 0x7f72f0182640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72fcc00640 1 -- 172.21.15.106:0/2299625557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f0188d00 con 0x7f72f0006290 2024-04-26T21:16:41.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f72f7e00640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72f0050e10 0x7f72f00dbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f990b400640 1 -- 172.21.15.106:0/910597039 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f80ab600 con 0x7f9904055620 2024-04-26T21:16:41.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f990b400640 1 -- 172.21.15.106:0/910597039 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f80ab9d0 con 0x7f9904055620 2024-04-26T21:16:41.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f35eca00640 1 -- 172.21.15.106:0/827571301 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e40b2070 con 0x7f35e815ecf0 2024-04-26T21:16:41.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f35eca00640 1 -- 172.21.15.106:0/827571301 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e40a5810 con 0x7f35e815ecf0 2024-04-26T21:16:41.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f35eca00640 1 -- 172.21.15.106:0/827571301 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e40a5be0 con 0x7f35e815ecf0 2024-04-26T21:16:41.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f77f8a00640 1 Processor -- start 2024-04-26T21:16:41.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f9913600640 1 -- 172.21.15.106:0/910597039 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904055620 msgr2=0x7f99040df3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f9913600640 1 --2- 172.21.15.106:0/910597039 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904055620 0x7f99040df3e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009870 tx=0x7f98f801c460 comp rx=0 tx=0).stop 2024-04-26T21:16:41.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f77f8a00640 1 -- start start 2024-04-26T21:16:41.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f8bd7000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb8004810 0x7f8bc804e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f8bd7000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc80dc620 0x7f8bc804d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f8bd7000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bc8035db0 0x7f8bc80e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7fb753e00640 1 -- 172.21.15.106:0/1671036437 >> v1:172.21.15.112:6789/0 conn(0x7fb74c039e60 legacy=0x7fb74c03a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7fb753e00640 1 -- 172.21.15.106:0/1671036437 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74c0512e0 con 0x7fb74c04e760 2024-04-26T21:16:41.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f6febe00640 1 -- 172.21.15.106:0/2759336832 >> v2:172.21.15.106:3300/0 conn(0x7f6fe40e6cd0 msgr2=0x7f6fe4053f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f6febe00640 1 --2- 172.21.15.106:0/2759336832 >> v2:172.21.15.106:3300/0 conn(0x7f6fe40e6cd0 0x7f6fe4053f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f6febe00640 1 -- 172.21.15.106:0/2759336832 >> v1:172.21.15.106:6789/0 conn(0x7f6fe403c100 legacy=0x7f6fe4006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f6febe00640 1 -- 172.21.15.106:0/2759336832 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe40e7a90 con 0x7f6fe4053750 2024-04-26T21:16:41.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f8bcfe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb8004810 0x7f8bc804e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f8bcfe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb8004810 0x7f8bc804e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49344/0 (socket says 172.21.15.106:49344) 2024-04-26T21:16:41.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f4c5be00640 1 --2- 172.21.15.106:0/529451859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c5c0b44e0 0x7f4c5c160270 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0af8e0 tx=0x7f4c5401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b6e1afd25e1a07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f8bcfe00640 1 -- 172.21.15.106:0/2782150432 learned_addr learned my addr 172.21.15.106:0/2782150432 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.279+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc804f090 con 0x7f8bc8035db0 2024-04-26T21:16:41.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc804fd80 con 0x7f8bc80dc620 2024-04-26T21:16:41.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc80482c0 con 0x7f8bb8004810 2024-04-26T21:16:41.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f8a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f4071d20 0x7f77f4072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f35f0800640 1 -- 172.21.15.106:0/827571301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 msgr2=0x7f35e815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f35f0800640 1 --2- 172.21.15.106:0/827571301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 0x7f35e815f1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009dc0 tx=0x7f35e401c950 comp rx=0 tx=0).stop 2024-04-26T21:16:41.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f77f40d6d80 0x7f77f40d82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f35f0800640 1 -- 172.21.15.106:0/827571301 shutdown_connections 2024-04-26T21:16:41.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f35f0800640 1 --2- 172.21.15.106:0/827571301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 0x7f35e815f1a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f35f0800640 1 --2- 172.21.15.106:0/827571301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80b2ed0 0x7f35e8141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f8a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f40b8750 con 0x7f77f4164380 2024-04-26T21:16:41.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bcfe00640 1 -- 172.21.15.106:0/2782150432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc80dc620 msgr2=0x7f8bc804d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bcf400640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc80dc620 0x7f8bc804d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f8a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f77f4072640 con 0x7f77f40d6d80 2024-04-26T21:16:41.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f8a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f77f40d8820 con 0x7f77f4071d20 2024-04-26T21:16:41.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f35f0800640 1 -- 172.21.15.106:0/827571301 >> 172.21.15.106:0/827571301 conn(0x7f35e80689c0 msgr2=0x7f35e80b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c5aa00640 1 -- 172.21.15.106:0/529451859 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c540a56c0 con 0x7f4c5c0b44e0 2024-04-26T21:16:41.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f1e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f4071d20 0x7f77f4072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bcfe00640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc80dc620 0x7f8bc804d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c5aa00640 1 -- 172.21.15.106:0/529451859 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c540a5860 con 0x7f4c5c0b44e0 2024-04-26T21:16:41.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c5aa00640 1 -- 172.21.15.106:0/529451859 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c540a5c30 con 0x7f4c5c0b44e0 2024-04-26T21:16:41.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bcfe00640 1 -- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bc8035db0 msgr2=0x7f8bc80e6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f1e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f4071d20 0x7f77f4072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49358/0 (socket says 172.21.15.106:49358) 2024-04-26T21:16:41.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bcfe00640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bc8035db0 0x7f8bc80e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f1e00640 1 -- 172.21.15.106:0/4258538050 learned_addr learned my addr 172.21.15.106:0/4258538050 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f1400640 1 --2- 172.21.15.106:0/4258538050 >> v2:172.21.15.112:3300/0 conn(0x7f77f40d6d80 0x7f77f40d82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f72fcc00640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f0006290 0x7f72f00e0c30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00c4a0 tx=0x7f72ec00c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f72f4c00640 1 -- 172.21.15.106:0/2299625557 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec018070 con 0x7f72f0006290 2024-04-26T21:16:41.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f72f4c00640 1 -- 172.21.15.106:0/2299625557 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ec0074e0 con 0x7f72f0006290 2024-04-26T21:16:41.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f72f4c00640 1 -- 172.21.15.106:0/2299625557 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0049f0 con 0x7f72f0006290 2024-04-26T21:16:41.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f0188fe0 con 0x7f72f0006290 2024-04-26T21:16:41.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f1e00640 1 -- 172.21.15.106:0/4258538050 >> v2:172.21.15.112:3300/0 conn(0x7f77f40d6d80 msgr2=0x7f77f40d82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f1e00640 1 --2- 172.21.15.106:0/4258538050 >> v2:172.21.15.112:3300/0 conn(0x7f77f40d6d80 0x7f77f40d82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f1e00640 1 -- 172.21.15.106:0/4258538050 >> v1:172.21.15.112:6789/0 conn(0x7f77f4164380 legacy=0x7f77f40d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f77f1e00640 1 -- 172.21.15.106:0/4258538050 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f40d7240 con 0x7f77f4071d20 2024-04-26T21:16:41.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f01895a0 con 0x7f72f0006290 2024-04-26T21:16:41.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c62000640 1 -- 172.21.15.106:0/529451859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c5c0b44e0 msgr2=0x7f4c5c160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c62000640 1 --2- 172.21.15.106:0/529451859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c5c0b44e0 0x7f4c5c160270 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0af8e0 tx=0x7f4c5401c8a0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f9913600640 1 -- 172.21.15.106:0/910597039 shutdown_connections 2024-04-26T21:16:41.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f9913600640 1 --2- 172.21.15.106:0/910597039 >> v2:172.21.15.106:3300/0 conn(0x7f9904053c40 0x7f99040380c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f9913600640 1 --2- 172.21.15.106:0/910597039 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904055620 0x7f99040df3e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f9913600640 1 -- 172.21.15.106:0/910597039 >> 172.21.15.106:0/910597039 conn(0x7f9904054b00 msgr2=0x7f9904054f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c62000640 1 -- 172.21.15.106:0/529451859 shutdown_connections 2024-04-26T21:16:41.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c62000640 1 --2- 172.21.15.106:0/529451859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c5c0b44e0 0x7f4c5c160270 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c62000640 1 --2- 172.21.15.106:0/529451859 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c5c15f950 0x7f4c5c15fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c62000640 1 -- 172.21.15.106:0/529451859 >> 172.21.15.106:0/529451859 conn(0x7f4c5c0689c0 msgr2=0x7f4c5c0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f9913600640 1 -- 172.21.15.106:0/910597039 shutdown_connections 2024-04-26T21:16:41.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f9913600640 1 -- 172.21.15.106:0/910597039 wait complete. 2024-04-26T21:16:41.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bcfe00640 1 -- 172.21.15.106:0/2782150432 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc804df40 con 0x7f8bb8004810 2024-04-26T21:16:41.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bcf400640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc80dc620 0x7f8bc804d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bcfe00640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb8004810 0x7f8bc804e900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00d770 tx=0x7f8bbc00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72f00053a0 con 0x7f72f0006290 2024-04-26T21:16:41.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c62000640 1 -- 172.21.15.106:0/529451859 shutdown_connections 2024-04-26T21:16:41.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f35f0800640 1 -- 172.21.15.106:0/827571301 shutdown_connections 2024-04-26T21:16:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f4c62000640 1 -- 172.21.15.106:0/529451859 wait complete. 2024-04-26T21:16:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7fb753e00640 1 --2- 172.21.15.106:0/1671036437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04e760 0x7fb74c0339c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb754051300 tx=0x7fb754098800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55e6a07b58caf4e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bc3e00640 1 -- 172.21.15.106:0/2782150432 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc005ae0 con 0x7f8bb8004810 2024-04-26T21:16:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7fb752a00640 1 -- 172.21.15.106:0/1671036437 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75412c070 con 0x7fb74c04e760 2024-04-26T21:16:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7fb752a00640 1 -- 172.21.15.106:0/1671036437 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7541273f0 con 0x7fb74c04e760 2024-04-26T21:16:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7fb752a00640 1 -- 172.21.15.106:0/1671036437 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb754127860 con 0x7fb74c04e760 2024-04-26T21:16:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bc3e00640 1 -- 172.21.15.106:0/2782150432 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc017070 con 0x7f8bb8004810 2024-04-26T21:16:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f8bc3e00640 1 -- 172.21.15.106:0/2782150432 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc007070 con 0x7f8bb8004810 2024-04-26T21:16:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc8035030 con 0x7f8bb8004810 2024-04-26T21:16:41.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7fb759800640 1 -- 172.21.15.106:0/1671036437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04e760 msgr2=0x7fb74c0339c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7fb759800640 1 --2- 172.21.15.106:0/1671036437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04e760 0x7fb74c0339c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb754051300 tx=0x7fb754098800 comp rx=0 tx=0).stop 2024-04-26T21:16:41.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7fb759800640 1 -- 172.21.15.106:0/1671036437 shutdown_connections 2024-04-26T21:16:41.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7fb759800640 1 --2- 172.21.15.106:0/1671036437 >> v2:172.21.15.112:3300/0 conn(0x7fb74c038640 0x7fb74c0500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7fb759800640 1 --2- 172.21.15.106:0/1671036437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04e760 0x7fb74c0339c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7fb759800640 1 -- 172.21.15.106:0/1671036437 >> 172.21.15.106:0/1671036437 conn(0x7fb74c009fc0 msgr2=0x7fb74c00a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f9913600640 1 Processor -- start 2024-04-26T21:16:41.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.283+0000 7f35f0800640 1 -- 172.21.15.106:0/827571301 wait complete. 2024-04-26T21:16:41.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc80352d0 con 0x7f8bb8004810 2024-04-26T21:16:41.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f72f4c00640 1 -- 172.21.15.106:0/2299625557 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72ec01b070 con 0x7f72f0006290 2024-04-26T21:16:41.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6febe00640 1 --2- 172.21.15.106:0/2759336832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fe4053750 0x7f6fe40e70b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4058db0 tx=0x7f6fd801c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e4ce66f3c62e29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f72f4c00640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f72d80683d0 0x7f72d806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f72f4c00640 1 -- 172.21.15.106:0/2299625557 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f72ec085fd0 con 0x7f72f0006290 2024-04-26T21:16:41.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6feb400640 1 -- 172.21.15.106:0/2759336832 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd80b0070 con 0x7f6fe4053750 2024-04-26T21:16:41.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6feb400640 1 -- 172.21.15.106:0/2759336832 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd80ab600 con 0x7f6fe4053750 2024-04-26T21:16:41.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6feb400640 1 -- 172.21.15.106:0/2759336832 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd80ab9d0 con 0x7f6fe4053750 2024-04-26T21:16:41.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7fb759800640 1 -- 172.21.15.106:0/1671036437 shutdown_connections 2024-04-26T21:16:41.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f72f4c00640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7f72d8071b50 0x7f72d8073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f72f4c00640 1 -- 172.21.15.106:0/2299625557 --> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72ec01ce50 con 0x7f72d8071b50 2024-04-26T21:16:41.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f72f4c00640 1 -- 172.21.15.106:0/2299625557 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f72ec0885f0 con 0x7f72f0006290 2024-04-26T21:16:41.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f4c62000640 1 Processor -- start 2024-04-26T21:16:41.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8bc80053a0 con 0x7f8bb8004810 2024-04-26T21:16:41.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f35f0800640 1 Processor -- start 2024-04-26T21:16:41.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f9913600640 1 -- start start 2024-04-26T21:16:41.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7fb759800640 1 -- 172.21.15.106:0/1671036437 wait complete. 2024-04-26T21:16:41.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f4c62000640 1 -- start start 2024-04-26T21:16:41.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f72fd600640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7f72d8071b50 0x7f72d8073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f35f0800640 1 -- start start 2024-04-26T21:16:41.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f72f7e00640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f72d80683d0 0x7f72d806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6ff3c00640 1 -- 172.21.15.106:0/2759336832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fe4053750 msgr2=0x7f6fe40e70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6ff3c00640 1 --2- 172.21.15.106:0/2759336832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fe4053750 0x7f6fe40e70b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4058db0 tx=0x7f6fd801c3d0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6ff3c00640 1 -- 172.21.15.106:0/2759336832 shutdown_connections 2024-04-26T21:16:41.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6ff3c00640 1 --2- 172.21.15.106:0/2759336832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fe4053750 0x7f6fe40e70b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6ff3c00640 1 --2- 172.21.15.106:0/2759336832 >> v2:172.21.15.106:3300/0 conn(0x7f6fe40e6cd0 0x7f6fe4053f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.287+0000 7f6ff3c00640 1 -- 172.21.15.106:0/2759336832 >> 172.21.15.106:0/2759336832 conn(0x7f6fe4058ef0 msgr2=0x7f6fe4059300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c62000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c5c06e820 0x7f4c5c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c62000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c5c0b44e0 0x7f4c5c1f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c62000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c5c15f950 0x7f4c5c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c62000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c0b4b00 con 0x7f4c5c0b44e0 2024-04-26T21:16:41.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c62000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c06fd60 con 0x7f4c5c15f950 2024-04-26T21:16:41.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c62000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5c1f54f0 con 0x7f4c5c06e820 2024-04-26T21:16:41.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f6ff3c00640 1 -- 172.21.15.106:0/2759336832 shutdown_connections 2024-04-26T21:16:41.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f6ff3c00640 1 -- 172.21.15.106:0/2759336832 wait complete. 2024-04-26T21:16:41.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 Processor -- start 2024-04-26T21:16:41.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 -- start start 2024-04-26T21:16:41.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c5c15f950 0x7f4c5c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c5c15f950 0x7f4c5c0ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44274/0 (socket says 172.21.15.106:44274) 2024-04-26T21:16:41.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5be00640 1 -- 172.21.15.106:0/1284906378 learned_addr learned my addr 172.21.15.106:0/1284906378 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35f0800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80b2ed0 0x7f35e816a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35f0800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 0x7f35e8168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35f0800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35e816b370 0x7f35e8162e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f8bc3e00640 1 -- 172.21.15.106:0/2782150432 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8bbc007210 con 0x7f8bb8004810 2024-04-26T21:16:41.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35ed400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 0x7f35e8168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35ed400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 0x7f35e8168dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44278/0 (socket says 172.21.15.106:44278) 2024-04-26T21:16:41.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35f0800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8072760 con 0x7f35e816b370 2024-04-26T21:16:41.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35f0800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35e806ef90 con 0x7f35e815ecf0 2024-04-26T21:16:41.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35f0800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f35e80728e0 con 0x7f35e80b2ed0 2024-04-26T21:16:41.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb74c038640 0x7fb74c0e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c039e60 0x7fb74c0e4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04adc0 0x7fb74c17d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb74c006830 con 0x7fb74c038640 2024-04-26T21:16:41.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb74c0066b0 con 0x7fb74c039e60 2024-04-26T21:16:41.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb74c0069b0 con 0x7fb74c04adc0 2024-04-26T21:16:41.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f9913600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904033e50 0x7f990404ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f9913600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9904053c40 0x7f99040cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f9913600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9904055620 0x7f99040ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f9913600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9904007220 con 0x7f9904055620 2024-04-26T21:16:41.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f9913600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9904050480 con 0x7f9904053c40 2024-04-26T21:16:41.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f9913600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f99040073a0 con 0x7f9904033e50 2024-04-26T21:16:41.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5b400640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c5c06e820 0x7f4c5c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35ed400640 1 -- 172.21.15.106:0/4194021214 learned_addr learned my addr 172.21.15.106:0/4194021214 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f35ede00640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80b2ed0 0x7f35e816a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f72fd600640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7f72d8071b50 0x7f72d8073f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f990be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9904053c40 0x7f99040cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f72f7e00640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f72d80683d0 0x7f72d806a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72f80519e0 tx=0x7f72f806f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f990be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9904053c40 0x7f99040cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44298/0 (socket says 172.21.15.106:44298) 2024-04-26T21:16:41.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f990be00640 1 -- 172.21.15.106:0/2621152083 learned_addr learned my addr 172.21.15.106:0/2621152083 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f9910c00640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904033e50 0x7f990404ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5be00640 1 -- 172.21.15.106:0/1284906378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c5c06e820 msgr2=0x7f4c5c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5be00640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c5c06e820 0x7f4c5c15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5be00640 1 -- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c5c0b44e0 msgr2=0x7f4c5c1f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5be00640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c5c0b44e0 0x7f4c5c1f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5be00640 1 -- 172.21.15.106:0/1284906378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c1f57d0 con 0x7f4c5c15f950 2024-04-26T21:16:41.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb753400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c039e60 0x7fb74c0e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb753400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c039e60 0x7fb74c0e4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44286/0 (socket says 172.21.15.106:44286) 2024-04-26T21:16:41.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb753400640 1 -- 172.21.15.106:0/192818460 learned_addr learned my addr 172.21.15.106:0/192818460 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb758e00640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04adc0 0x7fb74c17d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb753400640 1 -- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04adc0 msgr2=0x7fb74c17d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb753400640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb74c04adc0 0x7fb74c17d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb753400640 1 -- 172.21.15.106:0/192818460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb74c038640 msgr2=0x7fb74c0e40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb753400640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb74c038640 0x7fb74c0e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb753400640 1 -- 172.21.15.106:0/192818460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74c0e4610 con 0x7fb74c039e60 2024-04-26T21:16:41.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb753400640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c039e60 0x7fb74c0e4910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb74800e8a0 tx=0x7fb74800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb747e00640 1 -- 172.21.15.106:0/192818460 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748017070 con 0x7fb74c039e60 2024-04-26T21:16:41.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb747e00640 1 -- 172.21.15.106:0/192818460 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74800c940 con 0x7fb74c039e60 2024-04-26T21:16:41.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb747e00640 1 -- 172.21.15.106:0/192818460 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74800cd50 con 0x7fb74c039e60 2024-04-26T21:16:41.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74c0e5160 con 0x7fb74c039e60 2024-04-26T21:16:41.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f4c5be00640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c5c15f950 0x7f4c5c0ae8d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4c540af040 tx=0x7f4c54019640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f6ff3c00640 1 Processor -- start 2024-04-26T21:16:41.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb74c0e5720 con 0x7fb74c039e60 2024-04-26T21:16:41.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f8bc3e00640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bb0068400 0x7f8bb006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f9911600640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9904055620 0x7f99040ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f990be00640 1 -- 172.21.15.106:0/2621152083 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904033e50 msgr2=0x7f990404ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f990be00640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9904033e50 0x7f990404ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f990be00640 1 -- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9904055620 msgr2=0x7f99040ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f990be00640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9904055620 0x7f99040ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f990be00640 1 -- 172.21.15.106:0/2621152083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99040e96b0 con 0x7f9904053c40 2024-04-26T21:16:41.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f6ff3c00640 1 -- start start 2024-04-26T21:16:41.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.291+0000 7f77f1e00640 1 --2- 172.21.15.106:0/4258538050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f4071d20 0x7f77f4072100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009870 tx=0x7f77e401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fffbd4b9dcd0ba2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f8bc3e00640 1 -- 172.21.15.106:0/2782150432 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8bbc086a00 con 0x7f8bb8004810 2024-04-26T21:16:41.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f0a00640 1 -- 172.21.15.106:0/4258538050 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e40a95f0 con 0x7f77f4071d20 2024-04-26T21:16:41.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f0a00640 1 -- 172.21.15.106:0/4258538050 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e40a9790 con 0x7f77f4071d20 2024-04-26T21:16:41.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f0a00640 1 -- 172.21.15.106:0/4258538050 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e40a9b60 con 0x7f77f4071d20 2024-04-26T21:16:41.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35ed400640 1 -- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80b2ed0 msgr2=0x7f35e816a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35ed400640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35e80b2ed0 0x7f35e816a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb74c0053a0 con 0x7fb74c039e60 2024-04-26T21:16:41.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f8bc3e00640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7f8bb0071b70 0x7f8bb0073fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35ed400640 1 -- 172.21.15.106:0/4194021214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35e816b370 msgr2=0x7f35e8162e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35ed400640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35e816b370 0x7f35e8162e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35ed400640 1 -- 172.21.15.106:0/4194021214 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8169450 con 0x7f35e815ecf0 2024-04-26T21:16:41.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f8bc3e00640 1 -- 172.21.15.106:0/2782150432 --> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8bb0074680 con 0x7f8bb0071b70 2024-04-26T21:16:41.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f8bc3e00640 1 -- 172.21.15.106:0/2782150432 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8bbc08b2c0 con 0x7f8bb8004810 2024-04-26T21:16:41.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f8bcf400640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bb0068400 0x7f8bb006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f4c53400640 1 -- 172.21.15.106:0/1284906378 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c54009510 con 0x7f4c5c15f950 2024-04-26T21:16:41.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f8a00640 1 -- 172.21.15.106:0/4258538050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f4071d20 msgr2=0x7f77f4072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f8a00640 1 --2- 172.21.15.106:0/4258538050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f4071d20 0x7f77f4072100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009870 tx=0x7f77e401c530 comp rx=0 tx=0).stop 2024-04-26T21:16:41.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f8bd5000640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7f8bb0071b70 0x7f8bb0073fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f4c53400640 1 -- 172.21.15.106:0/1284906378 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c540be070 con 0x7f4c5c15f950 2024-04-26T21:16:41.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f4c53400640 1 -- 172.21.15.106:0/1284906378 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c540a56c0 con 0x7f4c5c15f950 2024-04-26T21:16:41.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35ed400640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 0x7f35e8168dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35d800e900 tx=0x7f35d800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f8a00640 1 -- 172.21.15.106:0/4258538050 shutdown_connections 2024-04-26T21:16:41.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f8a00640 1 --2- 172.21.15.106:0/4258538050 >> v2:172.21.15.112:3300/0 conn(0x7f77f40d6d80 0x7f77f40d82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f8a00640 1 --2- 172.21.15.106:0/4258538050 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f4071d20 0x7f77f4072100 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f8a00640 1 -- 172.21.15.106:0/4258538050 >> 172.21.15.106:0/4258538050 conn(0x7f77f40d91b0 msgr2=0x7f77f40d95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f990be00640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9904053c40 0x7f99040cc730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f990000b550 tx=0x7f990000ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f9908c00640 1 -- 172.21.15.106:0/2621152083 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900014070 con 0x7f9904053c40 2024-04-26T21:16:41.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f9908c00640 1 -- 172.21.15.106:0/2621152083 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9900010890 con 0x7f9904053c40 2024-04-26T21:16:41.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f9908c00640 1 -- 172.21.15.106:0/2621152083 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900010c80 con 0x7f9904053c40 2024-04-26T21:16:41.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f4c62000640 1 -- 172.21.15.106:0/1284906378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5c1f5ab0 con 0x7f4c5c15f950 2024-04-26T21:16:41.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6ff3c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fe403c100 0x7f6fe404ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6ff3c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe4053750 0x7f6fe40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f4c62000640 1 -- 172.21.15.106:0/1284906378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5c1f51b0 con 0x7f4c5c15f950 2024-04-26T21:16:41.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f8a00640 1 -- 172.21.15.106:0/4258538050 shutdown_connections 2024-04-26T21:16:41.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35e2000640 1 -- 172.21.15.106:0/4194021214 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8017070 con 0x7f35e815ecf0 2024-04-26T21:16:41.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7fb747e00640 1 -- 172.21.15.106:0/192818460 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb74801a070 con 0x7fb74c039e60 2024-04-26T21:16:41.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35e2000640 1 -- 172.21.15.106:0/4194021214 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d800c9a0 con 0x7f35e815ecf0 2024-04-26T21:16:41.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35e2000640 1 -- 172.21.15.106:0/4194021214 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d800cd90 con 0x7f35e815ecf0 2024-04-26T21:16:41.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f8bd5000640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7f8bb0071b70 0x7f8bb0073fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6ff3c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6fe40e6cd0 0x7f6fe4039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6febe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe4053750 0x7f6fe40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6febe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe4053750 0x7f6fe40ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41018/0 (socket says 172.21.15.106:41018) 2024-04-26T21:16:41.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6ff1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fe403c100 0x7f6fe404ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6ff1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fe403c100 0x7f6fe404ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44308/0 (socket says 172.21.15.106:44308) 2024-04-26T21:16:41.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f9913600640 1 -- 172.21.15.106:0/2621152083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99040ebab0 con 0x7f9904053c40 2024-04-26T21:16:41.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f9913600640 1 -- 172.21.15.106:0/2621152083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99040e9990 con 0x7f9904053c40 2024-04-26T21:16:41.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f4c50c00640 1 -- 172.21.15.106:0/1284906378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c5c0c5a30 con 0x7f4c5c15f950 2024-04-26T21:16:41.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35f0800640 1 -- 172.21.15.106:0/4194021214 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e8169730 con 0x7f35e815ecf0 2024-04-26T21:16:41.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f35f0800640 1 -- 172.21.15.106:0/4194021214 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e8169cf0 con 0x7f35e815ecf0 2024-04-26T21:16:41.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6febe00640 1 -- 172.21.15.106:0/1548692861 learned_addr learned my addr 172.21.15.106:0/1548692861 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6ff1c00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6fe40e6cd0 0x7f6fe4039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4007a20 con 0x7f6fe4053750 2024-04-26T21:16:41.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe40069e0 con 0x7f6fe403c100 2024-04-26T21:16:41.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe403c530 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f77f8a00640 1 -- 172.21.15.106:0/4258538050 wait complete. 2024-04-26T21:16:41.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7fb747e00640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb734068380 0x7fb73406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7f8bcf400640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bb0068400 0x7f8bb006a8c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40b2000 tx=0x7f8bc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f8bc3e00640 1 -- 172.21.15.106:0/2782150432 <== osd.0 v2:172.21.15.106:6824/2880453688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8bb0074680 con 0x7f8bb0071b70 2024-04-26T21:16:41.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f72f4c00640 1 -- 172.21.15.106:0/2299625557 <== osd.1 v2:172.21.15.106:6808/1511992084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72ec01ce50 con 0x7f72d8071b50 2024-04-26T21:16:41.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f98fe000640 1 -- 172.21.15.106:0/2621152083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98e0001040 con 0x7f9904053c40 2024-04-26T21:16:41.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f35d7400640 1 -- 172.21.15.106:0/4194021214 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35c0001040 con 0x7f35e815ecf0 2024-04-26T21:16:41.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6ff1c00640 1 -- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fe403c100 msgr2=0x7f6fe404ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6ff1c00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fe403c100 0x7f6fe404ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6ff1c00640 1 -- 172.21.15.106:0/1548692861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe4053750 msgr2=0x7f6fe40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6ff1c00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe4053750 0x7f6fe40ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6ff1c00640 1 -- 172.21.15.106:0/1548692861 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe4038e10 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6ff1c00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6fe40e6cd0 0x7f6fe4039eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fec06ab10 tx=0x7f6fec064170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7fb747e00640 1 -- 172.21.15.106:0/192818460 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb748087480 con 0x7fb74c039e60 2024-04-26T21:16:41.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7fb747e00640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fb734071a80 0x7fb734073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7fb747e00640 1 -- 172.21.15.106:0/192818460 --> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb74800ae90 con 0x7fb734071a80 2024-04-26T21:16:41.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.295+0000 7fb747e00640 1 -- 172.21.15.106:0/192818460 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb748087830 con 0x7fb74c039e60 2024-04-26T21:16:41.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7fb758e00640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fb734071a80 0x7fb734073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7fb758e00640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fb734071a80 0x7fb734073ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6fe8c00640 1 -- 172.21.15.106:0/1548692861 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec074750 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6fe8c00640 1 -- 172.21.15.106:0/1548692861 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec091030 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6fe8c00640 1 -- 172.21.15.106:0/1548692861 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec06c400 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe40390f0 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7fb753e00640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb734068380 0x7fb73406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f77f8a00640 1 Processor -- start 2024-04-26T21:16:41.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7fb747e00640 1 -- 172.21.15.106:0/192818460 <== osd.7 v2:172.21.15.112:6824/2983510698 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb74800ae90 con 0x7fb734071a80 2024-04-26T21:16:41.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe40396b0 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fe40053a0 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7f4c53400640 1 -- 172.21.15.106:0/1284906378 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c540b8470 con 0x7f4c5c15f950 2024-04-26T21:16:41.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.299+0000 7fb753e00640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb734068380 0x7fb73406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb74c051180 tx=0x7fb75406c190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f35e2000640 1 -- 172.21.15.106:0/4194021214 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35d801a070 con 0x7f35e815ecf0 2024-04-26T21:16:41.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f8a00640 1 -- start start 2024-04-26T21:16:41.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f4c53400640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c38068450 0x7f4c3806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f4c53400640 1 -- 172.21.15.106:0/1284906378 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4c54122300 con 0x7f4c5c15f950 2024-04-26T21:16:41.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f4c53400640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f4c38071bc0 0x7f4c38074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f4c53400640 1 -- 172.21.15.106:0/1284906378 --> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c540a5860 con 0x7f4c38071bc0 2024-04-26T21:16:41.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f4c53400640 1 -- 172.21.15.106:0/1284906378 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4c54129050 con 0x7f4c5c15f950 2024-04-26T21:16:41.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f6fe8c00640 1 -- 172.21.15.106:0/1548692861 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6fec06c5a0 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f4c5b400640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c38068450 0x7f4c3806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f6fe8c00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6fcc068450 0x7f6fcc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f6fe8c00640 1 -- 172.21.15.106:0/1548692861 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6fec102cc0 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f6fe8c00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f6fcc071bc0 0x7f6fcc074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f6fe8c00640 1 -- 172.21.15.106:0/1548692861 --> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fec08de50 con 0x7f6fcc071bc0 2024-04-26T21:16:41.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f6fe8c00640 1 -- 172.21.15.106:0/1548692861 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6fec1030b0 con 0x7f6fe40e6cd0 2024-04-26T21:16:41.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77f4071d20 0x7f77f4156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f8a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f40d6d80 0x7f77f40d2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f8a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f4164380 0x7f77f406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f8a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f77f40d4320 con 0x7f77f4164380 2024-04-26T21:16:41.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f8a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f77f40d7dc0 con 0x7f77f4071d20 2024-04-26T21:16:41.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f8a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f77f4161270 con 0x7f77f40d6d80 2024-04-26T21:16:41.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77f4071d20 0x7f77f4156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77f4071d20 0x7f77f4156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44324/0 (socket says 172.21.15.106:44324) 2024-04-26T21:16:41.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1e00640 1 -- 172.21.15.106:0/607296897 learned_addr learned my addr 172.21.15.106:0/607296897 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f2800640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f4164380 0x7f77f406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1400640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f40d6d80 0x7f77f40d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f4c5b400640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c38068450 0x7f4c3806a910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006fd0 tx=0x7f4c4c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f35e2000640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f35cc068450 0x7f35cc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f35e2000640 1 -- 172.21.15.106:0/4194021214 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f35d8086f80 con 0x7f35e815ecf0 2024-04-26T21:16:41.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f35e2000640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f35cc071bc0 0x7f35cc074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f35e2000640 1 -- 172.21.15.106:0/4194021214 --> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35d8015e50 con 0x7f35cc071bc0 2024-04-26T21:16:41.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f35e2000640 1 -- 172.21.15.106:0/4194021214 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f35d80895e0 con 0x7f35e815ecf0 2024-04-26T21:16:41.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f35ede00640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f35cc068450 0x7f35cc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f6febe00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f6fcc071bc0 0x7f6fcc074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1e00640 1 -- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f40d6d80 msgr2=0x7f77f40d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1e00640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f40d6d80 0x7f77f40d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1e00640 1 -- 172.21.15.106:0/607296897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f4164380 msgr2=0x7f77f406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1e00640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f4164380 0x7f77f406dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1e00640 1 -- 172.21.15.106:0/607296897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f4156b50 con 0x7f77f4071d20 2024-04-26T21:16:41.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f77f1400640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77f40d6d80 0x7f77f40d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.303+0000 7f6ff1200640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6fcc068450 0x7f6fcc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f4c53e00640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f4c38071bc0 0x7f4c38074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f35ee800640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f35cc071bc0 0x7f35cc074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f35ede00640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f35cc068450 0x7f35cc06a910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000f70 tx=0x7f35dc007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f77f1e00640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77f4071d20 0x7f77f4156610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f77e401abe0 tx=0x7f77e40192d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f6febe00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f6fcc071bc0 0x7f6fcc074000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f35ee800640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f35cc071bc0 0x7f35cc074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f9908c00640 1 -- 172.21.15.106:0/2621152083 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9900017070 con 0x7f9904053c40 2024-04-26T21:16:41.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f77ea000640 1 -- 172.21.15.106:0/607296897 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e40a95f0 con 0x7f77f4071d20 2024-04-26T21:16:41.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f77ea000640 1 -- 172.21.15.106:0/607296897 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e40b1800 con 0x7f77f4071d20 2024-04-26T21:16:41.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f77f8a00640 1 -- 172.21.15.106:0/607296897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f406e720 con 0x7f77f4071d20 2024-04-26T21:16:41.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f77f8a00640 1 -- 172.21.15.106:0/607296897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f40d1c40 con 0x7f77f4071d20 2024-04-26T21:16:41.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f6ff1200640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6fcc068450 0x7f6fcc06a910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6fe403bb10 tx=0x7f6fe0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f35e2000640 1 -- 172.21.15.106:0/4194021214 <== osd.4 v2:172.21.15.112:6808/4133025482 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35d8015e50 con 0x7f35cc071bc0 2024-04-26T21:16:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f77ea000640 1 -- 172.21.15.106:0/607296897 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e40b1bf0 con 0x7f77f4071d20 2024-04-26T21:16:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f9908c00640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068450 0x7f98ec06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f9908c00640 1 -- 172.21.15.106:0/2621152083 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9900086a00 con 0x7f9904053c40 2024-04-26T21:16:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f6fe8c00640 1 -- 172.21.15.106:0/1548692861 <== osd.5 v2:172.21.15.112:6800/2195698135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fec08de50 con 0x7f6fcc071bc0 2024-04-26T21:16:41.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f9908c00640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f98ec071bd0 0x7f98ec074010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f4c53e00640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f4c38071bc0 0x7f4c38074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f9911600640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f98ec071bd0 0x7f98ec074010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.307+0000 7f9908c00640 1 -- 172.21.15.106:0/2621152083 --> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98ec0746e0 con 0x7f98ec071bd0 2024-04-26T21:16:41.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f9908c00640 1 -- 172.21.15.106:0/2621152083 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f990008b2a0 con 0x7f9904053c40 2024-04-26T21:16:41.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f9910c00640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068450 0x7f98ec06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f9911600640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f98ec071bd0 0x7f98ec074010 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f9910c00640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068450 0x7f98ec06a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f98f80ad000 tx=0x7f98f8004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77ea000640 1 -- 172.21.15.106:0/607296897 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f77e40bb3f0 con 0x7f77f4071d20 2024-04-26T21:16:41.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77df400640 1 -- 172.21.15.106:0/607296897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77cc001040 con 0x7f77f4071d20 2024-04-26T21:16:41.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77ea000640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f77d40683d0 0x7f77d406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77ea000640 1 -- 172.21.15.106:0/607296897 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f77e4120b80 con 0x7f77f4071d20 2024-04-26T21:16:41.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77f1400640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f77d40683d0 0x7f77d406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77ea000640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7f77d4071b50 0x7f77d4073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77ea000640 1 -- 172.21.15.106:0/607296897 --> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77e4001d40 con 0x7f77d4071b50 2024-04-26T21:16:41.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77ea000640 1 -- 172.21.15.106:0/607296897 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f77e412d050 con 0x7f77f4071d20 2024-04-26T21:16:41.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f4c53400640 1 -- 172.21.15.106:0/1284906378 <== osd.3 v2:172.21.15.106:6816/1343890463 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c540a5860 con 0x7f4c38071bc0 2024-04-26T21:16:41.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77f1400640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f77d40683d0 0x7f77d406a890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77f41ffb10 tx=0x7f77e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f9908c00640 1 -- 172.21.15.106:0/2621152083 <== osd.2 v2:172.21.15.106:6800/522723976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f98ec0746e0 con 0x7f98ec071bd0 2024-04-26T21:16:41.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.311+0000 7f77f2800640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7f77d4071b50 0x7f77d4073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.315+0000 7f77f2800640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7f77d4071b50 0x7f77d4073f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.315+0000 7f77ea000640 1 -- 172.21.15.106:0/607296897 <== osd.6 v2:172.21.15.112:6810/3830481749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77e4001d40 con 0x7f77d4071b50 2024-04-26T21:16:41.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.323+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 --> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f72f0005f50 con 0x7f72d8071b50 2024-04-26T21:16:41.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.327+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 --> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8bc8052830 con 0x7f8bb0071b70 2024-04-26T21:16:41.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.327+0000 7f72f4c00640 1 -- 172.21.15.106:0/2299625557 <== osd.1 v2:172.21.15.106:6808/1511992084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f72f0005f50 con 0x7f72d8071b50 2024-04-26T21:16:41.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.327+0000 7f8bc3e00640 1 -- 172.21.15.106:0/2782150432 <== osd.0 v2:172.21.15.106:6824/2880453688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8bc8052830 con 0x7f8bb0071b70 2024-04-26T21:16:41.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.327+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7f72d8071b50 msgr2=0x7f72d8073f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.327+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7f8bb0071b70 msgr2=0x7f8bb0073fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.327+0000 7f8bd7000640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7f8bb0071b70 0x7f8bb0073fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.327+0000 7f72ff600640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7f72d8071b50 0x7f72d8073f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.327+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bb0068400 msgr2=0x7f8bb006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.327+0000 7f8bd7000640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bb0068400 0x7f8bb006a8c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40b2000 tx=0x7f8bc4009040 comp rx=0 tx=0).stop 2024-04-26T21:16:41.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f72d80683d0 msgr2=0x7f72d806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb8004810 msgr2=0x7f8bc804e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f8bd7000640 1 --2- 172.21.15.106:0/2782150432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bb8004810 0x7f8bc804e900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00d770 tx=0x7f8bbc00dc30 comp rx=0 tx=0).stop 2024-04-26T21:16:41.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f8bd5000640 1 -- 172.21.15.106:0/2782150432 reap_dead start 2024-04-26T21:16:41.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 shutdown_connections 2024-04-26T21:16:41.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 >> 172.21.15.106:0/2782150432 conn(0x7f8bc8009fc0 msgr2=0x7f8bc8038b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f72ff600640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f72d80683d0 0x7f72d806a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72f80519e0 tx=0x7f72f806f040 comp rx=0 tx=0).stop 2024-04-26T21:16:41.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f0006290 msgr2=0x7f72f00e0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f72ff600640 1 --2- 172.21.15.106:0/2299625557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72f0006290 0x7f72f00e0c30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00c4a0 tx=0x7f72ec00c960 comp rx=0 tx=0).stop 2024-04-26T21:16:41.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f72fd600640 1 -- 172.21.15.106:0/2299625557 reap_dead start 2024-04-26T21:16:41.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 shutdown_connections 2024-04-26T21:16:41.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 >> 172.21.15.106:0/2299625557 conn(0x7f72f0009fc0 msgr2=0x7f72f004f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 shutdown_connections 2024-04-26T21:16:41.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f8bd7000640 1 -- 172.21.15.106:0/2782150432 wait complete. 2024-04-26T21:16:41.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 shutdown_connections 2024-04-26T21:16:41.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.331+0000 7f72ff600640 1 -- 172.21.15.106:0/2299625557 wait complete. 2024-04-26T21:16:41.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.335+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 --> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb74c006f00 con 0x7fb734071a80 2024-04-26T21:16:41.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.335+0000 7f98fe000640 1 -- 172.21.15.106:0/2621152083 --> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f98e0002de0 con 0x7f98ec071bd0 2024-04-26T21:16:41.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.335+0000 7f35d7400640 1 -- 172.21.15.106:0/4194021214 --> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35c0002de0 con 0x7f35cc071bc0 2024-04-26T21:16:41.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.335+0000 7fb747e00640 1 -- 172.21.15.106:0/192818460 <== osd.7 v2:172.21.15.112:6824/2983510698 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb74c006f00 con 0x7fb734071a80 2024-04-26T21:16:41.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.335+0000 7f35e2000640 1 -- 172.21.15.106:0/4194021214 <== osd.4 v2:172.21.15.112:6808/4133025482 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f35c0002de0 con 0x7f35cc071bc0 2024-04-26T21:16:41.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fb734071a80 msgr2=0x7fb734073ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fb734071a80 0x7fb734073ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 -- 172.21.15.106:0/1284906378 --> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4c5c069400 con 0x7f4c38071bc0 2024-04-26T21:16:41.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb734068380 msgr2=0x7fb73406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb734068380 0x7fb73406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb74c051180 tx=0x7fb75406c190 comp rx=0 tx=0).stop 2024-04-26T21:16:41.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f9908c00640 1 -- 172.21.15.106:0/2621152083 <== osd.2 v2:172.21.15.106:6800/522723976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f98e0002de0 con 0x7f98ec071bd0 2024-04-26T21:16:41.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c039e60 msgr2=0x7fb74c0e4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 --2- 172.21.15.106:0/192818460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c039e60 0x7fb74c0e4910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb74800e8a0 tx=0x7fb74800ed60 comp rx=0 tx=0).stop 2024-04-26T21:16:41.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb758e00640 1 -- 172.21.15.106:0/192818460 reap_dead start 2024-04-26T21:16:41.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 shutdown_connections 2024-04-26T21:16:41.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 >> 172.21.15.106:0/192818460 conn(0x7fb74c009fc0 msgr2=0x7fb74c0540b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c53400640 1 -- 172.21.15.106:0/1284906378 <== osd.3 v2:172.21.15.106:6816/1343890463 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4c5c069400 con 0x7f4c38071bc0 2024-04-26T21:16:41.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 -- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f98ec071bd0 msgr2=0x7f98ec074010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f98ec071bd0 0x7f98ec074010 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 shutdown_connections 2024-04-26T21:16:41.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 -- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068450 msgr2=0x7f98ec06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068450 0x7f98ec06a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f98f80ad000 tx=0x7f98f8004740 comp rx=0 tx=0).stop 2024-04-26T21:16:41.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 -- 172.21.15.106:0/2621152083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9904053c40 msgr2=0x7f99040cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 --2- 172.21.15.106:0/2621152083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9904053c40 0x7f99040cc730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f990000b550 tx=0x7f990000ba10 comp rx=0 tx=0).stop 2024-04-26T21:16:41.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 -- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f4c38071bc0 msgr2=0x7f4c38074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f4c38071bc0 0x7f4c38074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7fb759800640 1 -- 172.21.15.106:0/192818460 wait complete. 2024-04-26T21:16:41.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 -- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c38068450 msgr2=0x7f4c3806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c38068450 0x7f4c3806a910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006fd0 tx=0x7f4c4c008040 comp rx=0 tx=0).stop 2024-04-26T21:16:41.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 -- 172.21.15.106:0/1284906378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c5c15f950 msgr2=0x7f4c5c0ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 --2- 172.21.15.106:0/1284906378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c5c15f950 0x7f4c5c0ae8d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4c540af040 tx=0x7f4c54019640 comp rx=0 tx=0).stop 2024-04-26T21:16:41.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f9911600640 1 -- 172.21.15.106:0/2621152083 reap_dead start 2024-04-26T21:16:41.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 -- 172.21.15.106:0/2621152083 shutdown_connections 2024-04-26T21:16:41.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 -- 172.21.15.106:0/2621152083 >> 172.21.15.106:0/2621152083 conn(0x7f9904054b00 msgr2=0x7f99040dd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c5be00640 1 -- 172.21.15.106:0/1284906378 reap_dead start 2024-04-26T21:16:41.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 -- 172.21.15.106:0/1284906378 shutdown_connections 2024-04-26T21:16:41.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 --> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6fe4053d30 con 0x7f6fcc071bc0 2024-04-26T21:16:41.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 -- 172.21.15.106:0/1284906378 >> 172.21.15.106:0/1284906378 conn(0x7f4c5c0689c0 msgr2=0x7f4c5c15c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 -- 172.21.15.106:0/2621152083 shutdown_connections 2024-04-26T21:16:41.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f35f0800640 1 -- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f35cc071bc0 msgr2=0x7f35cc074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f35f0800640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f35cc071bc0 0x7f35cc074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f6fe8c00640 1 -- 172.21.15.106:0/1548692861 <== osd.5 v2:172.21.15.112:6800/2195698135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6fe4053d30 con 0x7f6fcc071bc0 2024-04-26T21:16:41.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f35f0800640 1 -- 172.21.15.106:0/4194021214 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f35cc068450 msgr2=0x7f35cc06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f35f0800640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f35cc068450 0x7f35cc06a910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000f70 tx=0x7f35dc007e90 comp rx=0 tx=0).stop 2024-04-26T21:16:41.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f35f0800640 1 -- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 msgr2=0x7f35e8168dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f35f0800640 1 --2- 172.21.15.106:0/4194021214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815ecf0 0x7f35e8168dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35d800e900 tx=0x7f35d800edc0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f35ee800640 1 -- 172.21.15.106:0/4194021214 reap_dead start 2024-04-26T21:16:41.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f98fe000640 1 -- 172.21.15.106:0/2621152083 wait complete. 2024-04-26T21:16:41.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 -- 172.21.15.106:0/1284906378 shutdown_connections 2024-04-26T21:16:41.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f6fcc071bc0 msgr2=0x7f6fcc074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f6ff3c00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f6fcc071bc0 0x7f6fcc074000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.339+0000 7f4c50c00640 1 -- 172.21.15.106:0/1284906378 wait complete. 2024-04-26T21:16:41.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6fcc068450 msgr2=0x7f6fcc06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f6ff3c00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6fcc068450 0x7f6fcc06a910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6fe403bb10 tx=0x7f6fe0008040 comp rx=0 tx=0).stop 2024-04-26T21:16:41.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6fe40e6cd0 msgr2=0x7f6fe4039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f6ff3c00640 1 --2- 172.21.15.106:0/1548692861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6fe40e6cd0 0x7f6fe4039eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fec06ab10 tx=0x7f6fec064170 comp rx=0 tx=0).stop 2024-04-26T21:16:41.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f6ff1c00640 1 -- 172.21.15.106:0/1548692861 reap_dead start 2024-04-26T21:16:41.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 shutdown_connections 2024-04-26T21:16:41.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 >> 172.21.15.106:0/1548692861 conn(0x7f6fe4058ef0 msgr2=0x7f6fe403db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f35f0800640 1 -- 172.21.15.106:0/4194021214 shutdown_connections 2024-04-26T21:16:41.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f35f0800640 1 -- 172.21.15.106:0/4194021214 >> 172.21.15.106:0/4194021214 conn(0x7f35e80689c0 msgr2=0x7f35e8166190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f35f0800640 1 -- 172.21.15.106:0/4194021214 shutdown_connections 2024-04-26T21:16:41.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f35f0800640 1 -- 172.21.15.106:0/4194021214 wait complete. 2024-04-26T21:16:41.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 shutdown_connections 2024-04-26T21:16:41.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.343+0000 7f6ff3c00640 1 -- 172.21.15.106:0/1548692861 wait complete. 2024-04-26T21:16:41.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.347+0000 7f77df400640 1 -- 172.21.15.106:0/607296897 --> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77cc002de0 con 0x7f77d4071b50 2024-04-26T21:16:41.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.351+0000 7f77ea000640 1 -- 172.21.15.106:0/607296897 <== osd.6 v2:172.21.15.112:6810/3830481749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f77cc002de0 con 0x7f77d4071b50 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.351+0000 7f77df400640 1 -- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7f77d4071b50 msgr2=0x7f77d4073f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.351+0000 7f77df400640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7f77d4071b50 0x7f77d4073f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.355+0000 7f77df400640 1 -- 172.21.15.106:0/607296897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f77d40683d0 msgr2=0x7f77d406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.355+0000 7f77df400640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f77d40683d0 0x7f77d406a890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77f41ffb10 tx=0x7f77e0008040 comp rx=0 tx=0).stop 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.355+0000 7f77df400640 1 -- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77f4071d20 msgr2=0x7f77f4156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.355+0000 7f77df400640 1 --2- 172.21.15.106:0/607296897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77f4071d20 0x7f77f4156610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f77e401abe0 tx=0x7f77e40192d0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.355+0000 7f77f2800640 1 -- 172.21.15.106:0/607296897 reap_dead start 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.355+0000 7f77df400640 1 -- 172.21.15.106:0/607296897 shutdown_connections 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.355+0000 7f77df400640 1 -- 172.21.15.106:0/607296897 >> 172.21.15.106:0/607296897 conn(0x7f77f40d91b0 msgr2=0x7f77f40d5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.359+0000 7f77df400640 1 -- 172.21.15.106:0/607296897 shutdown_connections 2024-04-26T21:16:41.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.359+0000 7f77df400640 1 -- 172.21.15.106:0/607296897 wait complete. 2024-04-26T21:16:41.383 INFO:teuthology.orchestra.run.smithi106.stdout:64424509448 2024-04-26T21:16:41.383 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T21:16:41.384 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:41.384 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T21:16:41.385 INFO:teuthology.orchestra.run.smithi106.stdout:55834574858 2024-04-26T21:16:41.386 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T21:16:41.388 INFO:teuthology.orchestra.run.smithi106.stdout:64424509450 2024-04-26T21:16:41.389 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T21:16:41.390 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:41.390 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T21:16:41.393 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:41.393 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T21:16:41.394 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:41.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T21:16:41.402 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:41.402 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T21:16:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.599+0000 7f79f3600640 1 Processor -- start 2024-04-26T21:16:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.599+0000 7f79f3600640 1 -- start start 2024-04-26T21:16:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.599+0000 7f79f3600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec073110 0x7f79ec16e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.599+0000 7f79f3600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ec0b5420 con 0x7f79ec0706d0 2024-04-26T21:16:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.599+0000 7f79f3600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ec06e020 con 0x7f79ec14c7f0 2024-04-26T21:16:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.599+0000 7f79f3600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec06e630 con 0x7f79ec073110 2024-04-26T21:16:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.603+0000 7f79f1600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec073110 0x7f79ec16e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.603+0000 7f79f0c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f79ec14c7f0 0x7f79ec0b4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:43936/0 (socket says 172.21.15.106:43936) 2024-04-26T21:16:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.603+0000 7f79f0c00640 1 -- 172.21.15.106:0/1889722082 learned_addr learned my addr 172.21.15.106:0/1889722082 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:41.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.603+0000 7f79eb400640 1 -- 172.21.15.106:0/1889722082 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294797139 0 0) 0x7f79ec06e020 con 0x7f79ec14c7f0 2024-04-26T21:16:41.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.603+0000 7f79f1600640 1 -- 172.21.15.106:0/1889722082 >> v1:172.21.15.112:6789/0 conn(0x7f79ec14c7f0 legacy=0x7f79ec0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.603+0000 7f79f1600640 1 -- 172.21.15.106:0/1889722082 >> v1:172.21.15.106:6789/0 conn(0x7f79ec0706d0 legacy=0x7f79ec0b4d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T21:16:41.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.603+0000 7fedd1a00640 1 Processor -- start 2024-04-26T21:16:41.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.603+0000 7fedd1a00640 1 -- start start 2024-04-26T21:16:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedd1a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc146b70 0x7fedcc0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedd1a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedcc163b70 con 0x7fedcc0d1500 2024-04-26T21:16:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedd1a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedcc163e10 con 0x7fedcc1464d0 2024-04-26T21:16:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedd1a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fedcc1468b0 con 0x7fedcc146b70 2024-04-26T21:16:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedcb400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc146b70 0x7fedcc0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedcb400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc146b70 0x7fedcc0b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49426/0 (socket says 172.21.15.106:49426) 2024-04-26T21:16:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedcb400640 1 -- 172.21.15.106:0/435280757 learned_addr learned my addr 172.21.15.106:0/435280757 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedca000640 1 --1- 172.21.15.106:0/435280757 >> v1:172.21.15.106:6789/0 conn(0x7fedcc0d1500 0x7fedcc0b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34886/0 (socket says 172.21.15.106:34886) 2024-04-26T21:16:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedcb400640 1 -- 172.21.15.106:0/435280757 >> v1:172.21.15.112:6789/0 conn(0x7fedcc1464d0 legacy=0x7fedcc0d0df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T21:16:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedcb400640 1 -- 172.21.15.106:0/435280757 >> v1:172.21.15.106:6789/0 conn(0x7fedcc0d1500 legacy=0x7fedcc0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.607+0000 7fedcb400640 1 -- 172.21.15.106:0/435280757 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc1640f0 con 0x7fedcc146b70 2024-04-26T21:16:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.603+0000 7f79f1600640 1 -- 172.21.15.106:0/1889722082 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec06e990 con 0x7f79ec073110 2024-04-26T21:16:41.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedcb400640 1 --2- 172.21.15.106:0/435280757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc146b70 0x7fedcc0b4390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0d1af0 tx=0x7fedc401c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bbbf2d6d198e74f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7f3294e00640 1 Processor -- start 2024-04-26T21:16:41.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedc9600640 1 -- 172.21.15.106:0/435280757 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc40a5720 con 0x7fedcc146b70 2024-04-26T21:16:41.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedc9600640 1 -- 172.21.15.106:0/435280757 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc40a58c0 con 0x7fedcc146b70 2024-04-26T21:16:41.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedc9600640 1 -- 172.21.15.106:0/435280757 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc40a5c90 con 0x7fedcc146b70 2024-04-26T21:16:41.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7f79f1600640 1 --2- 172.21.15.106:0/1889722082 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec073110 0x7f79ec16e4e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f79ec06e7b0 tx=0x7f79e401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6f6567051c308 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7f3294e00640 1 -- start start 2024-04-26T21:16:41.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedd1a00640 1 -- 172.21.15.106:0/435280757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc146b70 msgr2=0x7fedcc0b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7f79eb400640 1 -- 172.21.15.106:0/1889722082 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40b0070 con 0x7f79ec073110 2024-04-26T21:16:41.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7f79eb400640 1 -- 172.21.15.106:0/1889722082 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e40ab600 con 0x7f79ec073110 2024-04-26T21:16:41.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7f79eb400640 1 -- 172.21.15.106:0/1889722082 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40ab9d0 con 0x7f79ec073110 2024-04-26T21:16:41.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedd1a00640 1 --2- 172.21.15.106:0/435280757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc146b70 0x7fedcc0b4390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0d1af0 tx=0x7fedc401c9b0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedd1a00640 1 -- 172.21.15.106:0/435280757 shutdown_connections 2024-04-26T21:16:41.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedd1a00640 1 --2- 172.21.15.106:0/435280757 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc146b70 0x7fedcc0b4390 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedd1a00640 1 -- 172.21.15.106:0/435280757 >> 172.21.15.106:0/435280757 conn(0x7fedcc068340 msgr2=0x7fedcc068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedd1a00640 1 -- 172.21.15.106:0/435280757 shutdown_connections 2024-04-26T21:16:41.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.611+0000 7fedd1a00640 1 -- 172.21.15.106:0/435280757 wait complete. 2024-04-26T21:16:41.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f79f3600640 1 -- 172.21.15.106:0/1889722082 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec073110 msgr2=0x7f79ec16e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f79f3600640 1 --2- 172.21.15.106:0/1889722082 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec073110 0x7f79ec16e4e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f79ec06e7b0 tx=0x7f79e401c350 comp rx=0 tx=0).stop 2024-04-26T21:16:41.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f79f3600640 1 -- 172.21.15.106:0/1889722082 shutdown_connections 2024-04-26T21:16:41.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f79f3600640 1 --2- 172.21.15.106:0/1889722082 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec073110 0x7f79ec16e4e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f79f3600640 1 -- 172.21.15.106:0/1889722082 >> 172.21.15.106:0/1889722082 conn(0x7f79ec0689c0 msgr2=0x7f79ec0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f79f3600640 1 -- 172.21.15.106:0/1889722082 shutdown_connections 2024-04-26T21:16:41.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7efd00000640 1 Processor -- start 2024-04-26T21:16:41.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f79f3600640 1 -- 172.21.15.106:0/1889722082 wait complete. 2024-04-26T21:16:41.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f3294e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290163240 0x7f32900707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7efd00000640 1 -- start start 2024-04-26T21:16:41.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f3294e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f329006cb10 0x7f329006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f328de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290163240 0x7f32900707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7fedd1a00640 1 Processor -- start 2024-04-26T21:16:41.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f328de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290163240 0x7f32900707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49428/0 (socket says 172.21.15.106:49428) 2024-04-26T21:16:41.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7fedd1a00640 1 -- start start 2024-04-26T21:16:41.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7efd00000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efcf81464d0 0x7efcf80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7efd00000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf8163b70 con 0x7efcf80d1330 2024-04-26T21:16:41.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7efd00000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf8163e10 con 0x7efcf8146b70 2024-04-26T21:16:41.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7efd00000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7efcf80d1770 con 0x7efcf81464d0 2024-04-26T21:16:41.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfe000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efcf80d1330 0x7efcf8148c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34888/0 (socket says 172.21.15.106:34888) 2024-04-26T21:16:41.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfe000640 1 -- 172.21.15.106:0/3664673437 learned_addr learned my addr 172.21.15.106:0/3664673437 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:41.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfcc00640 1 --1- 172.21.15.106:0/3664673437 >> v1:172.21.15.112:6789/0 conn(0x7efcf8146b70 0x7efcf80b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:43954/0 (socket says 172.21.15.106:43954) 2024-04-26T21:16:41.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7f79f3600640 1 Processor -- start 2024-04-26T21:16:41.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f3294e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32900d22f0 con 0x7f32900b4c50 2024-04-26T21:16:41.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f3294e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f32900d25b0 con 0x7f329006cb10 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f3294e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f32900d2890 con 0x7f3290163240 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f328e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f329006cb10 0x7f329006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f328de00640 1 -- 172.21.15.106:0/3617553679 learned_addr learned my addr 172.21.15.106:0/3617553679 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f328de00640 1 -- 172.21.15.106:0/3617553679 >> v2:172.21.15.106:3300/0 conn(0x7f329006cb10 msgr2=0x7f329006eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f328de00640 1 --2- 172.21.15.106:0/3617553679 >> v2:172.21.15.106:3300/0 conn(0x7f329006cb10 0x7f329006eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f328de00640 1 -- 172.21.15.106:0/3617553679 >> v1:172.21.15.112:6789/0 conn(0x7f32900b4c50 legacy=0x7f329006c400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.615+0000 7f328de00640 1 -- 172.21.15.106:0/3617553679 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32900b6ae0 con 0x7f3290163240 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7f328e800640 1 --2- 172.21.15.106:0/3617553679 >> v2:172.21.15.106:3300/0 conn(0x7f329006cb10 0x7f329006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406403786 0 0) 0x7efcf8163e10 con 0x7efcf8146b70 2024-04-26T21:16:41.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efce0003530 con 0x7efcf8146b70 2024-04-26T21:16:41.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7f79f3600640 1 -- start start 2024-04-26T21:16:41.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 <== mon.1 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4221809255 0 0) 0x7efce0003530 con 0x7efcf8146b70 2024-04-26T21:16:41.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 >> v2:172.21.15.106:3300/0 conn(0x7efcf81464d0 msgr2=0x7efcf80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 --2- 172.21.15.106:0/3664673437 >> v2:172.21.15.106:3300/0 conn(0x7efcf81464d0 0x7efcf80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 >> v1:172.21.15.106:6789/0 conn(0x7efcf80d1330 legacy=0x7efcf8148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf81640f0 con 0x7efcf8146b70 2024-04-26T21:16:41.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 <== mon.1 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7efce40015b0 con 0x7efcf8146b70 2024-04-26T21:16:41.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 >> v1:172.21.15.112:6789/0 conn(0x7efcf8146b70 legacy=0x7efcf80b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce0003a10 0x7efce0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce0004810 0x7efce0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce00053d0 0x7efce000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efcf80d1770 con 0x7efce0003a10 2024-04-26T21:16:41.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efce000c240 con 0x7efce00053d0 2024-04-26T21:16:41.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efce000c440 con 0x7efce0004810 2024-04-26T21:16:41.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7ff51a200640 1 Processor -- start 2024-04-26T21:16:41.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedd1a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc0d1500 0x7fedcc13dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedd1a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc1464d0 0x7fedcc141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedd1a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc146b70 0x7fedcc165be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedd1a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc170f90 con 0x7fedcc1464d0 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedd1a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc170e10 con 0x7fedcc146b70 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedd1a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fedcc171110 con 0x7fedcc0d1500 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcaa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc0d1500 0x7fedcc13dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcaa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc0d1500 0x7fedcc13dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49434/0 (socket says 172.21.15.106:49434) 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcaa00640 1 -- 172.21.15.106:0/2596231111 learned_addr learned my addr 172.21.15.106:0/2596231111 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcb400640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc146b70 0x7fedcc165be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7ff51a200640 1 -- start start 2024-04-26T21:16:41.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcaa00640 1 -- 172.21.15.106:0/2596231111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc146b70 msgr2=0x7fedcc165be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcaa00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc146b70 0x7fedcc165be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcaa00640 1 -- 172.21.15.106:0/2596231111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc1464d0 msgr2=0x7fedcc141c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:16:41.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcaa00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc1464d0 0x7fedcc141c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcaa00640 1 -- 172.21.15.106:0/2596231111 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc15ab80 con 0x7fedcc0d1500 2024-04-26T21:16:41.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfcc00640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce0004810 0x7efce0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedcaa00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc0d1500 0x7fedcc13dde0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00b4a0 tx=0x7fedbc00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfe000640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce00053d0 0x7efce000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7f79f3600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0706d0 0x7f79ec0aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfd600640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce0003a10 0x7efce0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfcc00640 1 -- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce00053d0 msgr2=0x7efce000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfcc00640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce00053d0 0x7efce000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfcc00640 1 -- 172.21.15.106:0/3664673437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce0003a10 msgr2=0x7efce0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedc2a00640 1 -- 172.21.15.106:0/2596231111 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc014070 con 0x7fedcc0d1500 2024-04-26T21:16:41.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedc2a00640 1 -- 172.21.15.106:0/2596231111 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedbc010610 con 0x7fedcc0d1500 2024-04-26T21:16:41.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7fedc2a00640 1 -- 172.21.15.106:0/2596231111 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc010a40 con 0x7fedcc0d1500 2024-04-26T21:16:41.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7f79f3600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec073110 0x7f79ec161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7f79f3600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec14c7f0 0x7f79ec1383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7f79f3600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec14cbd0 con 0x7f79ec0706d0 2024-04-26T21:16:41.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7f79f3600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec06e2c0 con 0x7f79ec073110 2024-04-26T21:16:41.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7f79f3600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec06ef50 con 0x7f79ec14c7f0 2024-04-26T21:16:41.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f0c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0706d0 0x7f79ec0aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f0c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0706d0 0x7f79ec0aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41072/0 (socket says 172.21.15.106:41072) 2024-04-26T21:16:41.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f1600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec14c7f0 0x7f79ec1383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f1600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec14c7f0 0x7f79ec1383e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49450/0 (socket says 172.21.15.106:49450) 2024-04-26T21:16:41.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f1600640 1 -- 172.21.15.106:0/1948431864 learned_addr learned my addr 172.21.15.106:0/1948431864 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f1600640 1 -- 172.21.15.106:0/1948431864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec073110 msgr2=0x7f79ec161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79ebe00640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec073110 0x7f79ec161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f1600640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec073110 0x7f79ec161ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedcc15ae60 con 0x7fedcc0d1500 2024-04-26T21:16:41.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fedcc15b420 con 0x7fedcc0d1500 2024-04-26T21:16:41.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfcc00640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce0003a10 0x7efce0003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.619+0000 7efcfcc00640 1 -- 172.21.15.106:0/3664673437 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf81640f0 con 0x7efce0004810 2024-04-26T21:16:41.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7efcfe000640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce00053d0 0x7efce000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7ff51a200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff5141415e0 0x7ff5140d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7ff51a200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff5140d1410 0x7ff5140b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f1600640 1 -- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0706d0 msgr2=0x7f79ec0aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f1600640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0706d0 0x7f79ec0aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79f1600640 1 -- 172.21.15.106:0/1948431864 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec162740 con 0x7f79ec14c7f0 2024-04-26T21:16:41.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7efcfe000640 1 -- 172.21.15.106:0/3664673437 reap_dead start 2024-04-26T21:16:41.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedcc069400 con 0x7fedcc0d1500 2024-04-26T21:16:41.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7ff51a200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140b4330 0x7ff51406df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7ff51a200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff51415b710 con 0x7ff5140d1410 2024-04-26T21:16:41.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7ff51a200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff51415c260 con 0x7ff5141415e0 2024-04-26T21:16:41.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7ff51a200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff5140b4b90 con 0x7ff5140b4330 2024-04-26T21:16:41.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f328de00640 1 --2- 172.21.15.106:0/3617553679 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290163240 0x7f32900707d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3288009e50 tx=0x7f328801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b16db1fa6c7671 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.623+0000 7f79ebe00640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec073110 0x7f79ec161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff5141415e0 0x7ff5140d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff5141415e0 0x7ff5140d0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44376/0 (socket says 172.21.15.106:44376) 2024-04-26T21:16:41.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513400640 1 -- 172.21.15.106:0/2194036730 learned_addr learned my addr 172.21.15.106:0/2194036730 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f79f0c00640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0706d0 0x7f79ec0aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:41.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f328ca00640 1 -- 172.21.15.106:0/3617553679 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32880a56b0 con 0x7f3290163240 2024-04-26T21:16:41.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f328ca00640 1 -- 172.21.15.106:0/3617553679 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32880a5850 con 0x7f3290163240 2024-04-26T21:16:41.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f328ca00640 1 -- 172.21.15.106:0/3617553679 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32880a5c20 con 0x7f3290163240 2024-04-26T21:16:41.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f79f1600640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec14c7f0 0x7f79ec1383e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79e4018f60 tx=0x7f79e40190f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513400640 1 -- 172.21.15.106:0/2194036730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140b4330 msgr2=0x7ff51406df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efcfcc00640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce0004810 0x7efce0004c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efcf8146f90 tx=0x7efce401cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f1aaf4ec5a88d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff512a00640 1 --2- 172.21.15.106:0/2194036730 >> v2:172.21.15.106:3300/0 conn(0x7ff5140d1410 0x7ff5140b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce4007bf0 con 0x7efce0004810 2024-04-26T21:16:41.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efcf7e00640 1 -- 172.21.15.106:0/3664673437 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce40a9070 con 0x7efce0004810 2024-04-26T21:16:41.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f79e8c00640 1 -- 172.21.15.106:0/1948431864 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40b0040 con 0x7f79ec14c7f0 2024-04-26T21:16:41.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f3294e00640 1 -- 172.21.15.106:0/3617553679 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290163240 msgr2=0x7f32900707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f3294e00640 1 --2- 172.21.15.106:0/3617553679 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290163240 0x7f32900707d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3288009e50 tx=0x7f328801c920 comp rx=0 tx=0).stop 2024-04-26T21:16:41.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513e00640 1 --2- 172.21.15.106:0/2194036730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140b4330 0x7ff51406df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513400640 1 --2- 172.21.15.106:0/2194036730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140b4330 0x7ff51406df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513400640 1 -- 172.21.15.106:0/2194036730 >> v2:172.21.15.106:3300/0 conn(0x7ff5140d1410 msgr2=0x7ff5140b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513400640 1 --2- 172.21.15.106:0/2194036730 >> v2:172.21.15.106:3300/0 conn(0x7ff5140d1410 0x7ff5140b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f3294e00640 1 -- 172.21.15.106:0/3617553679 shutdown_connections 2024-04-26T21:16:41.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f3294e00640 1 --2- 172.21.15.106:0/3617553679 >> v2:172.21.15.106:3300/0 conn(0x7f329006cb10 0x7f329006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f3294e00640 1 --2- 172.21.15.106:0/3617553679 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3290163240 0x7f32900707d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f3294e00640 1 -- 172.21.15.106:0/3617553679 >> 172.21.15.106:0/3617553679 conn(0x7f3290068140 msgr2=0x7f3290068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513400640 1 -- 172.21.15.106:0/2194036730 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51415c6f0 con 0x7ff5141415e0 2024-04-26T21:16:41.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f3294e00640 1 -- 172.21.15.106:0/3617553679 shutdown_connections 2024-04-26T21:16:41.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff512a00640 1 --2- 172.21.15.106:0/2194036730 >> v2:172.21.15.106:3300/0 conn(0x7ff5140d1410 0x7ff5140b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7ff513e00640 1 --2- 172.21.15.106:0/2194036730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140b4330 0x7ff51406df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f3294e00640 1 -- 172.21.15.106:0/3617553679 wait complete. 2024-04-26T21:16:41.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efd00000640 1 -- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce0004810 msgr2=0x7efce0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efd00000640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce0004810 0x7efce0004c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efcf8146f90 tx=0x7efce401cb60 comp rx=0 tx=0).stop 2024-04-26T21:16:41.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efd00000640 1 -- 172.21.15.106:0/3664673437 shutdown_connections 2024-04-26T21:16:41.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efd00000640 1 --2- 172.21.15.106:0/3664673437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efce0004810 0x7efce0004c90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efd00000640 1 -- 172.21.15.106:0/3664673437 >> 172.21.15.106:0/3664673437 conn(0x7efcf8068340 msgr2=0x7efcf8068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efd00000640 1 -- 172.21.15.106:0/3664673437 shutdown_connections 2024-04-26T21:16:41.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ec162a20 con 0x7f79ec14c7f0 2024-04-26T21:16:41.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ec162fe0 con 0x7f79ec14c7f0 2024-04-26T21:16:41.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7fedc2a00640 1 -- 172.21.15.106:0/2596231111 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fedbc017070 con 0x7fedcc0d1500 2024-04-26T21:16:41.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7fedc2a00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac0683d0 0x7fedac06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7fedc2a00640 1 -- 172.21.15.106:0/2596231111 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fedbc086840 con 0x7fedcc0d1500 2024-04-26T21:16:41.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f79e8c00640 1 -- 172.21.15.106:0/1948431864 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e40bc070 con 0x7f79ec14c7f0 2024-04-26T21:16:41.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7f79e8c00640 1 -- 172.21.15.106:0/1948431864 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40b0040 con 0x7f79ec14c7f0 2024-04-26T21:16:41.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7fedca000640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac0683d0 0x7fedac06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.627+0000 7efd00000640 1 -- 172.21.15.106:0/3664673437 wait complete. 2024-04-26T21:16:41.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f3294e00640 1 Processor -- start 2024-04-26T21:16:41.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f3294e00640 1 -- start start 2024-04-26T21:16:41.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7fedca000640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac0683d0 0x7fedac06a890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0d1430 tx=0x7fedb80079f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c40052a0 con 0x7f79ec14c7f0 2024-04-26T21:16:41.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7efd00000640 1 Processor -- start 2024-04-26T21:16:41.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7efd00000640 1 -- start start 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f3294e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329006cb10 0x7f329014eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f3294e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32900b4c50 0x7f3290155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f3294e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3290163240 0x7f32901524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f3294e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f329006fd80 con 0x7f32900b4c50 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f3294e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f329006fc00 con 0x7f3290163240 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f3294e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f329006ff00 con 0x7f329006cb10 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329006cb10 0x7f329014eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329006cb10 0x7f329014eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49468/0 (socket says 172.21.15.106:49468) 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328de00640 1 -- 172.21.15.106:0/190992161 learned_addr learned my addr 172.21.15.106:0/190992161 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328e800640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3290163240 0x7f32901524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328d400640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32900b4c50 0x7f3290155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7ff513400640 1 --2- 172.21.15.106:0/2194036730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 0x7ff5140d0ed0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff5140d0ad0 tx=0x7ff50401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=167c29ba093e967b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328de00640 1 -- 172.21.15.106:0/190992161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3290163240 msgr2=0x7f32901524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328de00640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3290163240 0x7f32901524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328de00640 1 -- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32900b4c50 msgr2=0x7f3290155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328de00640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32900b4c50 0x7f3290155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.631+0000 7f328de00640 1 -- 172.21.15.106:0/190992161 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3290156080 con 0x7f329006cb10 2024-04-26T21:16:41.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff512000640 1 -- 172.21.15.106:0/2194036730 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040b0070 con 0x7ff5141415e0 2024-04-26T21:16:41.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7fedc2a00640 1 -- 172.21.15.106:0/2596231111 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fedbc056aa0 con 0x7fedcc0d1500 2024-04-26T21:16:41.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efd00000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce0004810 0x7efcf80d0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efd00000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcf8141c70 0x7efcf8164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efd00000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcf813be00 0x7efcf81650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfd600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce0004810 0x7efcf80d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff512000640 1 -- 172.21.15.106:0/2194036730 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5040ab600 con 0x7ff5141415e0 2024-04-26T21:16:41.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff512000640 1 -- 172.21.15.106:0/2194036730 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040ab9d0 con 0x7ff5141415e0 2024-04-26T21:16:41.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfd600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce0004810 0x7efcf80d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44394/0 (socket says 172.21.15.106:44394) 2024-04-26T21:16:41.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7f328de00640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329006cb10 0x7f329014eab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f328801b030 tx=0x7f3288019720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfd600640 1 -- 172.21.15.106:0/3848948381 learned_addr learned my addr 172.21.15.106:0/3848948381 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfe000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcf813be00 0x7efcf81650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efcf80d0f70 con 0x7efcf8141c70 2024-04-26T21:16:41.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efcf80d0df0 con 0x7efce0004810 2024-04-26T21:16:41.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efcf80d10f0 con 0x7efcf813be00 2024-04-26T21:16:41.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff51a200640 1 -- 172.21.15.106:0/2194036730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 msgr2=0x7ff5140d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff51a200640 1 --2- 172.21.15.106:0/2194036730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 0x7ff5140d0ed0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff5140d0ad0 tx=0x7ff50401c490 comp rx=0 tx=0).stop 2024-04-26T21:16:41.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfcc00640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcf8141c70 0x7efcf8164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfe000640 1 -- 172.21.15.106:0/3848948381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce0004810 msgr2=0x7efcf80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfe000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce0004810 0x7efcf80d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfe000640 1 -- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcf8141c70 msgr2=0x7efcf8164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfe000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcf8141c70 0x7efcf8164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7f79e8c00640 1 -- 172.21.15.106:0/1948431864 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79e40b3070 con 0x7f79ec14c7f0 2024-04-26T21:16:41.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff51a200640 1 -- 172.21.15.106:0/2194036730 shutdown_connections 2024-04-26T21:16:41.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff51a200640 1 --2- 172.21.15.106:0/2194036730 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140b4330 0x7ff51406df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff51a200640 1 --2- 172.21.15.106:0/2194036730 >> v2:172.21.15.106:3300/0 conn(0x7ff5140d1410 0x7ff5140b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff51a200640 1 --2- 172.21.15.106:0/2194036730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 0x7ff5140d0ed0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff51a200640 1 -- 172.21.15.106:0/2194036730 >> 172.21.15.106:0/2194036730 conn(0x7ff514068340 msgr2=0x7ff514068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfe000640 1 -- 172.21.15.106:0/3848948381 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf813f680 con 0x7efcf813be00 2024-04-26T21:16:41.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfcc00640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcf8141c70 0x7efcf8164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7efcfe000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcf813be00 0x7efcf81650d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcf8074340 tx=0x7efcf000df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff51a200640 1 -- 172.21.15.106:0/2194036730 shutdown_connections 2024-04-26T21:16:41.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7ff51a200640 1 -- 172.21.15.106:0/2194036730 wait complete. 2024-04-26T21:16:41.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.635+0000 7f79e8c00640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79c80687b0 0x7f79c806ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7f79e8c00640 1 -- 172.21.15.106:0/1948431864 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f79e40b5750 con 0x7f79ec14c7f0 2024-04-26T21:16:41.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7efcf5600640 1 -- 172.21.15.106:0/3848948381 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf000b7a0 con 0x7efcf813be00 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7efcf5600640 1 -- 172.21.15.106:0/3848948381 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf000b960 con 0x7efcf813be00 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7efcf5600640 1 -- 172.21.15.106:0/3848948381 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf000bd50 con 0x7efcf813be00 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf813f3a0 con 0x7efcf813be00 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf81546a0 con 0x7efcf813be00 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7ff51a200640 1 Processor -- start 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7ff51a200640 1 -- start start 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7ff51a200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5140b4330 0x7ff514158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7ff51a200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140d1410 0x7ff5141400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7ff51a200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 0x7ff514140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7ff51a200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff514141b40 con 0x7ff5140b4330 2024-04-26T21:16:41.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7ff51a200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff5141419c0 con 0x7ff5141415e0 2024-04-26T21:16:41.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7ff51a200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff5140b4740 con 0x7ff5140d1410 2024-04-26T21:16:41.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7f79f0c00640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79c80687b0 0x7f79c806ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.639+0000 7f79e8c00640 1 -- 172.21.15.106:0/1948431864 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f79e4015fd0 con 0x7f79ec14c7f0 2024-04-26T21:16:41.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7f3286000640 1 -- 172.21.15.106:0/190992161 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32880bc020 con 0x7f329006cb10 2024-04-26T21:16:41.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff513e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 0x7ff514140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff512a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140d1410 0x7ff5141400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7f3286000640 1 -- 172.21.15.106:0/190992161 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32880b8670 con 0x7f329006cb10 2024-04-26T21:16:41.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7f3286000640 1 -- 172.21.15.106:0/190992161 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32880a56b0 con 0x7f329006cb10 2024-04-26T21:16:41.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff512a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140d1410 0x7ff5141400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49480/0 (socket says 172.21.15.106:49480) 2024-04-26T21:16:41.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff513400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5140b4330 0x7ff514158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff513400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5140b4330 0x7ff514158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41090/0 (socket says 172.21.15.106:41090) 2024-04-26T21:16:41.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff513400640 1 -- 172.21.15.106:0/3797130083 learned_addr learned my addr 172.21.15.106:0/3797130083 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff513e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 0x7ff514140610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44398/0 (socket says 172.21.15.106:44398) 2024-04-26T21:16:41.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3290151430 con 0x7f329006cb10 2024-04-26T21:16:41.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32901519f0 con 0x7f329006cb10 2024-04-26T21:16:41.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7f79f0c00640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79c80687b0 0x7f79c806ac70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79d4000f70 tx=0x7f79d4007df0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff512a00640 1 -- 172.21.15.106:0/3797130083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 msgr2=0x7ff514140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff512a00640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 0x7ff514140610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff512a00640 1 -- 172.21.15.106:0/3797130083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5140b4330 msgr2=0x7ff514158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff512a00640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5140b4330 0x7ff514158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7ff512a00640 1 -- 172.21.15.106:0/3797130083 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5140b36d0 con 0x7ff5140d1410 2024-04-26T21:16:41.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3290069b10 con 0x7f329006cb10 2024-04-26T21:16:41.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7efcf5600640 1 -- 172.21.15.106:0/3848948381 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efcf001b020 con 0x7efcf813be00 2024-04-26T21:16:41.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7efcf5600640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efcd80683d0 0x7efcd806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7efcf5600640 1 -- 172.21.15.106:0/3848948381 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7efcf0086b10 con 0x7efcf813be00 2024-04-26T21:16:41.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.643+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf8069400 con 0x7efcf813be00 2024-04-26T21:16:41.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.647+0000 7efcfd600640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efcd80683d0 0x7efcd806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.647+0000 7ff512a00640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140d1410 0x7ff5141400d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c7f0 tx=0x7ff50000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.647+0000 7f3286000640 1 -- 172.21.15.106:0/190992161 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f32880bf020 con 0x7f329006cb10 2024-04-26T21:16:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.647+0000 7efcfd600640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efcd80683d0 0x7efcd806a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efcec004710 tx=0x7efcec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.647+0000 7f3286000640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f326c068380 0x7f326c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.647+0000 7f3286000640 1 -- 172.21.15.106:0/190992161 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3288121cd0 con 0x7f329006cb10 2024-04-26T21:16:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.647+0000 7f328d400640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f326c068380 0x7f326c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.651+0000 7ff50b400640 1 -- 172.21.15.106:0/3797130083 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500015070 con 0x7ff5140d1410 2024-04-26T21:16:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.651+0000 7f328d400640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f326c068380 0x7f326c06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3290155680 tx=0x7f3280008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.651+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5140b39b0 con 0x7ff5140d1410 2024-04-26T21:16:41.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.651+0000 7efcf5600640 1 -- 172.21.15.106:0/3848948381 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efcf0056e70 con 0x7efcf813be00 2024-04-26T21:16:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.651+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5140b3f70 con 0x7ff5140d1410 2024-04-26T21:16:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.651+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff514069400 con 0x7ff5140d1410 2024-04-26T21:16:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.655+0000 7f3286000640 1 -- 172.21.15.106:0/190992161 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3288127020 con 0x7f329006cb10 2024-04-26T21:16:41.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.659+0000 7ff50b400640 1 -- 172.21.15.106:0/3797130083 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff500004430 con 0x7ff5140d1410 2024-04-26T21:16:41.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.667+0000 7ff50b400640 1 -- 172.21.15.106:0/3797130083 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50001e060 con 0x7ff5140d1410 2024-04-26T21:16:41.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.667+0000 7ff50b400640 1 -- 172.21.15.106:0/3797130083 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5000078e0 con 0x7ff5140d1410 2024-04-26T21:16:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.667+0000 7ff50b400640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff4f40683e0 0x7ff4f406a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.667+0000 7ff50b400640 1 -- 172.21.15.106:0/3797130083 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff500087220 con 0x7ff5140d1410 2024-04-26T21:16:41.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.667+0000 7ff50b400640 1 -- 172.21.15.106:0/3797130083 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff5000875e0 con 0x7ff5140d1410 2024-04-26T21:16:41.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.667+0000 7ff513400640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff4f40683e0 0x7ff4f406a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.671+0000 7ff513400640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff4f40683e0 0x7ff4f406a8a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff50401c4d0 tx=0x7ff5040a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc644800640 1 Processor -- start 2024-04-26T21:16:41.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc644800640 1 -- start start 2024-04-26T21:16:41.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc644800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc63c141600 0x7fc63c0b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc644800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc63c06df80 0x7fc63c15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc644800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 0x7fc63c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc644800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc63c0b5f80 con 0x7fc63c141600 2024-04-26T21:16:41.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc644800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc63c15f670 con 0x7fc63c06df80 2024-04-26T21:16:41.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc641e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc63c141600 0x7fc63c0b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc644800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc63c0b57c0 con 0x7fc63c15f230 2024-04-26T21:16:41.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc641e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc63c141600 0x7fc63c0b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41098/0 (socket says 172.21.15.106:41098) 2024-04-26T21:16:41.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc641e00640 1 -- 172.21.15.106:0/2411321458 learned_addr learned my addr 172.21.15.106:0/2411321458 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc641400640 1 --2- 172.21.15.106:0/2411321458 >> v2:172.21.15.112:3300/0 conn(0x7fc63c06df80 0x7fc63c15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.679+0000 7fc642800640 1 --2- 172.21.15.106:0/2411321458 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 0x7fc63c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.683+0000 7fc641e00640 1 -- 172.21.15.106:0/2411321458 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 msgr2=0x7fc63c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.683+0000 7fc641e00640 1 --2- 172.21.15.106:0/2411321458 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 0x7fc63c15b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.683+0000 7fc641e00640 1 -- 172.21.15.106:0/2411321458 >> v2:172.21.15.112:3300/0 conn(0x7fc63c06df80 msgr2=0x7fc63c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.683+0000 7fc641e00640 1 --2- 172.21.15.106:0/2411321458 >> v2:172.21.15.112:3300/0 conn(0x7fc63c06df80 0x7fc63c15ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.683+0000 7f4bda800640 1 Processor -- start 2024-04-26T21:16:41.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.683+0000 7fc641e00640 1 -- 172.21.15.106:0/2411321458 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c06f4b0 con 0x7fc63c141600 2024-04-26T21:16:41.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bda800640 1 -- start start 2024-04-26T21:16:41.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7fc641e00640 1 --2- 172.21.15.106:0/2411321458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 0x7fc63c0b5280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc63c070b00 tx=0x7fc62c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5271584354ef692d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bda800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 0x7f4bd40b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bda800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4bd40b2ba0 0x7f4bd40b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bda800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd41637d0 con 0x7f4bd40b3640 2024-04-26T21:16:41.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bda800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd406d510 con 0x7f4bd40b2ba0 2024-04-26T21:16:41.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bda800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd40b4170 con 0x7f4bd41633f0 2024-04-26T21:16:41.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bd9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4bd40b2ba0 0x7f4bd40b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bd9e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4bd40b2ba0 0x7f4bd40b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44418/0 (socket says 172.21.15.106:44418) 2024-04-26T21:16:41.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bd9e00640 1 -- 172.21.15.106:0/2213607269 learned_addr learned my addr 172.21.15.106:0/2213607269 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bd9e00640 1 -- 172.21.15.106:0/2213607269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 msgr2=0x7f4bd40b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bd9400640 1 --2- 172.21.15.106:0/2213607269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 0x7f4bd40b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bd9e00640 1 --2- 172.21.15.106:0/2213607269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 0x7f4bd40b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bd9e00640 1 -- 172.21.15.106:0/2213607269 >> v1:172.21.15.112:6789/0 conn(0x7f4bd40b3640 legacy=0x7f4bd40af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bd9e00640 1 -- 172.21.15.106:0/2213607269 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd406d760 con 0x7f4bd40b2ba0 2024-04-26T21:16:41.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7f4bd9400640 1 --2- 172.21.15.106:0/2213607269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 0x7f4bd40b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:41.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7fc640a00640 1 -- 172.21.15.106:0/2411321458 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0b0070 con 0x7fc63c141600 2024-04-26T21:16:41.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7fc640a00640 1 -- 172.21.15.106:0/2411321458 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc62c0ab600 con 0x7fc63c141600 2024-04-26T21:16:41.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7fc644800640 1 -- 172.21.15.106:0/2411321458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 msgr2=0x7fc63c0b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7fc640a00640 1 -- 172.21.15.106:0/2411321458 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0b0070 con 0x7fc63c141600 2024-04-26T21:16:41.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.687+0000 7fc644800640 1 --2- 172.21.15.106:0/2411321458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 0x7fc63c0b5280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc63c070b00 tx=0x7fc62c01c460 comp rx=0 tx=0).stop 2024-04-26T21:16:41.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.691+0000 7fc644800640 1 -- 172.21.15.106:0/2411321458 shutdown_connections 2024-04-26T21:16:41.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.691+0000 7fc644800640 1 --2- 172.21.15.106:0/2411321458 >> v2:172.21.15.112:3300/0 conn(0x7fc63c06df80 0x7fc63c15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.691+0000 7fc644800640 1 --2- 172.21.15.106:0/2411321458 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 0x7fc63c15b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bd9e00640 1 --2- 172.21.15.106:0/2213607269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b2ba0 0x7f4bd40b3030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009e50 tx=0x7f4bcc01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eab195f137136d89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.691+0000 7fc644800640 1 --2- 172.21.15.106:0/2411321458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 0x7fc63c0b5280 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.691+0000 7fc644800640 1 -- 172.21.15.106:0/2411321458 >> 172.21.15.106:0/2411321458 conn(0x7fc63c0689c0 msgr2=0x7fc63c0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.691+0000 7fc644800640 1 -- 172.21.15.106:0/2411321458 shutdown_connections 2024-04-26T21:16:41.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7fc644800640 1 -- 172.21.15.106:0/2411321458 wait complete. 2024-04-26T21:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bd3e00640 1 -- 172.21.15.106:0/2213607269 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0a5700 con 0x7f4bd40b2ba0 2024-04-26T21:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bd3e00640 1 -- 172.21.15.106:0/2213607269 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc0a58a0 con 0x7f4bd40b2ba0 2024-04-26T21:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bd3e00640 1 -- 172.21.15.106:0/2213607269 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0a5c70 con 0x7f4bd40b2ba0 2024-04-26T21:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bda800640 1 -- 172.21.15.106:0/2213607269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b2ba0 msgr2=0x7f4bd40b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bda800640 1 --2- 172.21.15.106:0/2213607269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b2ba0 0x7f4bd40b3030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009e50 tx=0x7f4bcc01c8a0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bda800640 1 -- 172.21.15.106:0/2213607269 shutdown_connections 2024-04-26T21:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bda800640 1 --2- 172.21.15.106:0/2213607269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b2ba0 0x7f4bd40b3030 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bda800640 1 --2- 172.21.15.106:0/2213607269 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 0x7f4bd40b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bda800640 1 -- 172.21.15.106:0/2213607269 >> 172.21.15.106:0/2213607269 conn(0x7f4bd40d2a40 msgr2=0x7f4bd40d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.695+0000 7f4bda800640 1 -- 172.21.15.106:0/2213607269 shutdown_connections 2024-04-26T21:16:41.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc644800640 1 Processor -- start 2024-04-26T21:16:41.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc644800640 1 -- start start 2024-04-26T21:16:41.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7f4bda800640 1 -- 172.21.15.106:0/2213607269 wait complete. 2024-04-26T21:16:41.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc644800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 0x7fc63c1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc644800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 0x7fc63c204ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc644800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63c14b4a0 0x7fc63c072d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc641e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 0x7fc63c1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc641e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 0x7fc63c1594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41114/0 (socket says 172.21.15.106:41114) 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc641e00640 1 -- 172.21.15.106:0/3552486324 learned_addr learned my addr 172.21.15.106:0/3552486324 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c06ef90 con 0x7fc63c141600 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c06ecb0 con 0x7fc63c14b4a0 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc63c1419e0 con 0x7fc63c15f230 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7f4bda800640 1 Processor -- start 2024-04-26T21:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7f4bda800640 1 -- start start 2024-04-26T21:16:41.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc641400640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 0x7fc63c204ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.699+0000 7fc642800640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63c14b4a0 0x7fc63c072d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc641400640 1 -- 172.21.15.106:0/3552486324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63c14b4a0 msgr2=0x7fc63c072d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc641400640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63c14b4a0 0x7fc63c072d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc641400640 1 -- 172.21.15.106:0/3552486324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 msgr2=0x7fc63c1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc641400640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 0x7fc63c1594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc641400640 1 -- 172.21.15.106:0/3552486324 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c14ba60 con 0x7fc63c15f230 2024-04-26T21:16:41.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bda800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bd40b2ba0 0x7f4bd4156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bda800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b3640 0x7f4bd40c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bda800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 0x7f4bd4070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bda800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40b00a0 con 0x7f4bd40b2ba0 2024-04-26T21:16:41.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bda800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40aff20 con 0x7f4bd40b3640 2024-04-26T21:16:41.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bda800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd4170200 con 0x7f4bd41633f0 2024-04-26T21:16:41.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc641400640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 0x7fc63c204ba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc63000e820 tx=0x7fc63000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bd8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b3640 0x7f4bd40c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bd8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b3640 0x7f4bd40c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44424/0 (socket says 172.21.15.106:44424) 2024-04-26T21:16:41.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bd8a00640 1 -- 172.21.15.106:0/3042501867 learned_addr learned my addr 172.21.15.106:0/3042501867 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bd9400640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bd40b2ba0 0x7f4bd4156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc636000640 1 -- 172.21.15.106:0/3552486324 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630017070 con 0x7fc63c15f230 2024-04-26T21:16:41.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc636000640 1 -- 172.21.15.106:0/3552486324 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63000c940 con 0x7fc63c15f230 2024-04-26T21:16:41.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc636000640 1 -- 172.21.15.106:0/3552486324 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63000ccf0 con 0x7fc63c15f230 2024-04-26T21:16:41.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63c14bd40 con 0x7fc63c15f230 2024-04-26T21:16:41.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc63c14c300 con 0x7fc63c15f230 2024-04-26T21:16:41.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bd8a00640 1 -- 172.21.15.106:0/3042501867 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 msgr2=0x7f4bd4070e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:16:41.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bd8a00640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 0x7f4bd4070e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bd8a00640 1 -- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bd40b2ba0 msgr2=0x7f4bd4156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bd8a00640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bd40b2ba0 0x7f4bd4156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.703+0000 7f4bd8a00640 1 -- 172.21.15.106:0/3042501867 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd4162fc0 con 0x7f4bd40b3640 2024-04-26T21:16:41.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.707+0000 7f4bd8a00640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b3640 0x7f4bd40c6570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000c490 tx=0x7f4bc0001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.707+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6180052a0 con 0x7fc63c15f230 2024-04-26T21:16:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.707+0000 7f4bd1600640 1 -- 172.21.15.106:0/3042501867 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0017070 con 0x7f4bd40b3640 2024-04-26T21:16:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.707+0000 7f4bd1600640 1 -- 172.21.15.106:0/3042501867 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc0003600 con 0x7f4bd40b3640 2024-04-26T21:16:41.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.707+0000 7f4bd1600640 1 -- 172.21.15.106:0/3042501867 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0003a30 con 0x7f4bd40b3640 2024-04-26T21:16:41.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.707+0000 7fc636000640 1 -- 172.21.15.106:0/3552486324 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc63001a070 con 0x7fc63c15f230 2024-04-26T21:16:41.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.711+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd4159930 con 0x7f4bd40b3640 2024-04-26T21:16:41.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.711+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd415b530 con 0x7f4bd40b3640 2024-04-26T21:16:41.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.711+0000 7fc636000640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc620068450 0x7fc62006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.711+0000 7fc636000640 1 -- 172.21.15.106:0/3552486324 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc630086e50 con 0x7fc63c15f230 2024-04-26T21:16:41.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.711+0000 7fc641e00640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc620068450 0x7fc62006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.711+0000 7fc641e00640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc620068450 0x7fc62006a910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc62c01cd00 tx=0x7fc62c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.715+0000 7f4bd1600640 1 -- 172.21.15.106:0/3042501867 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4bc0003bd0 con 0x7f4bd40b3640 2024-04-26T21:16:41.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.715+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd4069b10 con 0x7f4bd40b3640 2024-04-26T21:16:41.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.715+0000 7f4bd1600640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4bb4068380 0x7f4bb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.715+0000 7f4bd9400640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4bb4068380 0x7f4bb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.715+0000 7f4bd1600640 1 -- 172.21.15.106:0/3042501867 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4bc0053be0 con 0x7f4bd40b3640 2024-04-26T21:16:41.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.715+0000 7fc636000640 1 -- 172.21.15.106:0/3552486324 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc630056af0 con 0x7fc63c15f230 2024-04-26T21:16:41.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.719+0000 7f4bd9400640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4bb4068380 0x7f4bb406a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800ab60 tx=0x7f4bc8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.723+0000 7f4bd1600640 1 -- 172.21.15.106:0/3042501867 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4bc0055b40 con 0x7f4bd40b3640 2024-04-26T21:16:41.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.747+0000 7f0819e00640 1 Processor -- start 2024-04-26T21:16:41.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.747+0000 7f0819e00640 1 -- start start 2024-04-26T21:16:41.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.747+0000 7f0819e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08140b4390 0x7f08140722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.747+0000 7f0819e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0814073aa0 con 0x7f0814158b10 2024-04-26T21:16:41.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0813e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08140b4390 0x7f08140722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0813e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08140b4390 0x7f08140722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49532/0 (socket says 172.21.15.106:49532) 2024-04-26T21:16:41.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0813e00640 1 -- 172.21.15.106:0/1674764766 learned_addr learned my addr 172.21.15.106:0/1674764766 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0819e00640 1 -- 172.21.15.106:0/1674764766 --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0814072a00 con 0x7f081415b520 2024-04-26T21:16:41.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0819e00640 1 -- 172.21.15.106:0/1674764766 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0814072ce0 con 0x7f08140b4390 2024-04-26T21:16:41.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0813400640 1 -- 172.21.15.106:0/1674764766 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653416424 0 0) 0x7f0814072a00 con 0x7f081415b520 2024-04-26T21:16:41.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0813400640 1 -- 172.21.15.106:0/1674764766 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07fc003530 con 0x7f081415b520 2024-04-26T21:16:41.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0813e00640 1 -- 172.21.15.106:0/1674764766 >> v1:172.21.15.112:6789/0 conn(0x7f081415b520 legacy=0x7f081406dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0813e00640 1 -- 172.21.15.106:0/1674764766 >> v1:172.21.15.106:6789/0 conn(0x7f0814158b10 legacy=0x7f08140b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:41.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.751+0000 7f0813e00640 1 -- 172.21.15.106:0/1674764766 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0814072fc0 con 0x7f08140b4390 2024-04-26T21:16:41.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.755+0000 7f0813e00640 1 --2- 172.21.15.106:0/1674764766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08140b4390 0x7f08140722b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0800009820 tx=0x7f080001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c48842fc89d31ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.759+0000 7f0813400640 1 -- 172.21.15.106:0/1674764766 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000b0070 con 0x7f08140b4390 2024-04-26T21:16:41.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.759+0000 7f0813400640 1 -- 172.21.15.106:0/1674764766 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08000ab400 con 0x7f08140b4390 2024-04-26T21:16:41.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.759+0000 7f0819e00640 1 -- 172.21.15.106:0/1674764766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08140b4390 msgr2=0x7f08140722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.759+0000 7f0819e00640 1 --2- 172.21.15.106:0/1674764766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08140b4390 0x7f08140722b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0800009820 tx=0x7f080001c360 comp rx=0 tx=0).stop 2024-04-26T21:16:41.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.759+0000 7f0819e00640 1 -- 172.21.15.106:0/1674764766 shutdown_connections 2024-04-26T21:16:41.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.759+0000 7f0819e00640 1 --2- 172.21.15.106:0/1674764766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08140b4390 0x7f08140722b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.759+0000 7f0819e00640 1 -- 172.21.15.106:0/1674764766 >> 172.21.15.106:0/1674764766 conn(0x7f08140b26c0 msgr2=0x7f08140b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.759+0000 7f0819e00640 1 -- 172.21.15.106:0/1674764766 shutdown_connections 2024-04-26T21:16:41.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.759+0000 7f0819e00640 1 -- 172.21.15.106:0/1674764766 wait complete. 2024-04-26T21:16:41.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.763+0000 7f0819e00640 1 Processor -- start 2024-04-26T21:16:41.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.763+0000 7f0819e00640 1 -- start start 2024-04-26T21:16:41.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.763+0000 7f0819e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08140b4390 0x7f08142051e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0819e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0814158b10 0x7f081415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0818a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08140b4390 0x7f08142051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0818a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08140b4390 0x7f08142051e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44434/0 (socket says 172.21.15.106:44434) 2024-04-26T21:16:41.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0818a00640 1 -- 172.21.15.106:0/2749293599 learned_addr learned my addr 172.21.15.106:0/2749293599 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:41.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0819e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f081415b520 0x7f081413d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0813e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0814158b10 0x7f081415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0814166fc0 con 0x7f081415b520 2024-04-26T21:16:41.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0819400640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f081415b520 0x7f081413d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0814166e40 con 0x7f08140b4390 2024-04-26T21:16:41.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0814167140 con 0x7f0814158b10 2024-04-26T21:16:41.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0813e00640 1 -- 172.21.15.106:0/2749293599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08140b4390 msgr2=0x7f08142051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0813e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08140b4390 0x7f08142051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0813e00640 1 -- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f081415b520 msgr2=0x7f081413d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0813e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f081415b520 0x7f081413d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.767+0000 7f0813e00640 1 -- 172.21.15.106:0/2749293599 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0814205720 con 0x7f0814158b10 2024-04-26T21:16:41.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.771+0000 7f0813e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0814158b10 0x7f081415a8e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f08000ab000 tx=0x7f0800019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.771+0000 7f0810c00640 1 -- 172.21.15.106:0/2749293599 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c001680 con 0x7f0814158b10 2024-04-26T21:16:41.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.771+0000 7f0810c00640 1 -- 172.21.15.106:0/2749293599 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08000b45b0 con 0x7f0814158b10 2024-04-26T21:16:41.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.771+0000 7f0810c00640 1 -- 172.21.15.106:0/2749293599 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000b49a0 con 0x7f0814158b10 2024-04-26T21:16:41.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.771+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0814167770 con 0x7f0814158b10 2024-04-26T21:16:41.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.771+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f081415a0e0 con 0x7f0814158b10 2024-04-26T21:16:41.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.775+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0814069400 con 0x7f0814158b10 2024-04-26T21:16:41.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.775+0000 7f0810c00640 1 -- 172.21.15.106:0/2749293599 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08000bc020 con 0x7f0814158b10 2024-04-26T21:16:41.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.775+0000 7f0810c00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07f40683d0 0x7f07f406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:41.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.775+0000 7f0810c00640 1 -- 172.21.15.106:0/2749293599 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0800120330 con 0x7f0814158b10 2024-04-26T21:16:41.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.775+0000 7f0818a00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07f40683d0 0x7f07f406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:41.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.779+0000 7f0818a00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07f40683d0 0x7f07f406a890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0814142820 tx=0x7f0808009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:41.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.779+0000 7f0810c00640 1 -- 172.21.15.106:0/2749293599 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f08000c3020 con 0x7f0814158b10 2024-04-26T21:16:41.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.975+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fedcc16e1c0 con 0x7fedcc0d1500 2024-04-26T21:16:41.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.975+0000 7fedc2a00640 1 -- 172.21.15.106:0/2596231111 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fedbc0563a0 con 0x7fedcc0d1500 2024-04-26T21:16:41.979 INFO:teuthology.orchestra.run.smithi106.stdout:55834574857 2024-04-26T21:16:41.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac0683d0 msgr2=0x7fedac06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac0683d0 0x7fedac06a890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0d1430 tx=0x7fedb80079f0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc0d1500 msgr2=0x7fedcc13dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc0d1500 0x7fedcc13dde0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00b4a0 tx=0x7fedbc00b960 comp rx=0 tx=0).stop 2024-04-26T21:16:41.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 shutdown_connections 2024-04-26T21:16:41.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc146b70 0x7fedcc165be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac0683d0 0x7fedac06a890 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc1464d0 0x7fedcc141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 --2- 172.21.15.106:0/2596231111 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc0d1500 0x7fedcc13dde0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.979+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 >> 172.21.15.106:0/2596231111 conn(0x7fedcc068340 msgr2=0x7fedcc1477e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.983+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 shutdown_connections 2024-04-26T21:16:41.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.983+0000 7fedd1a00640 1 -- 172.21.15.106:0/2596231111 wait complete. 2024-04-26T21:16:41.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.983+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f79c4005860 con 0x7f79ec14c7f0 2024-04-26T21:16:41.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.983+0000 7f79e8c00640 1 -- 172.21.15.106:0/1948431864 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79e40f13b0 con 0x7f79ec14c7f0 2024-04-26T21:16:41.990 INFO:teuthology.orchestra.run.smithi106.stdout:64424509448 2024-04-26T21:16:41.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3290073780 con 0x7f329006cb10 2024-04-26T21:16:41.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79c80687b0 msgr2=0x7f79c806ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79c80687b0 0x7f79c806ac70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79d4000f70 tx=0x7f79d4007df0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec14c7f0 msgr2=0x7f79ec1383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:41.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec14c7f0 0x7f79ec1383e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79e4018f60 tx=0x7f79e40190f0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 shutdown_connections 2024-04-26T21:16:41.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ec073110 0x7f79ec161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79c80687b0 0x7f79c806ac70 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79d4000f70 tx=0x7f79d4007df0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ec14c7f0 0x7f79ec1383e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 --2- 172.21.15.106:0/1948431864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0706d0 0x7f79ec0aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:41.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.991+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 >> 172.21.15.106:0/1948431864 conn(0x7f79ec0689c0 msgr2=0x7f79ec0d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:41.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.995+0000 7f3286000640 1 -- 172.21.15.106:0/190992161 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32880c6030 con 0x7f329006cb10 2024-04-26T21:16:41.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.995+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7efcf816f1d0 con 0x7efcf813be00 2024-04-26T21:16:42.000 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:42.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.995+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 shutdown_connections 2024-04-26T21:16:42.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.995+0000 7f79f3600640 1 -- 172.21.15.106:0/1948431864 wait complete. 2024-04-26T21:16:42.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.995+0000 7efcf5600640 1 -- 172.21.15.106:0/3848948381 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efcf0056770 con 0x7efcf813be00 2024-04-26T21:16:42.001 INFO:teuthology.orchestra.run.smithi106.stdout:64424509448 2024-04-26T21:16:42.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f326c068380 msgr2=0x7f326c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f326c068380 0x7f326c06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3290155680 tx=0x7f3280008040 comp rx=0 tx=0).stop 2024-04-26T21:16:42.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329006cb10 msgr2=0x7f329014eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329006cb10 0x7f329014eab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f328801b030 tx=0x7f3288019720 comp rx=0 tx=0).stop 2024-04-26T21:16:42.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 shutdown_connections 2024-04-26T21:16:42.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3290163240 0x7f32901524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f326c068380 0x7f326c06a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32900b4c50 0x7f3290155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 --2- 172.21.15.106:0/190992161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f329006cb10 0x7f329014eab0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 >> 172.21.15.106:0/190992161 conn(0x7f3290068140 msgr2=0x7f32900d16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:42.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 shutdown_connections 2024-04-26T21:16:42.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7f3294e00640 1 -- 172.21.15.106:0/190992161 wait complete. 2024-04-26T21:16:42.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efcd80683d0 msgr2=0x7efcd806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7efd00000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efcd80683d0 0x7efcd806a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efcec004710 tx=0x7efcec008040 comp rx=0 tx=0).stop 2024-04-26T21:16:42.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcf813be00 msgr2=0x7efcf81650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7efd00000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcf813be00 0x7efcf81650d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcf8074340 tx=0x7efcf000df70 comp rx=0 tx=0).stop 2024-04-26T21:16:42.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 shutdown_connections 2024-04-26T21:16:42.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7efd00000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efcd80683d0 0x7efcd806a890 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7efd00000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcf813be00 0x7efcf81650d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7efd00000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcf8141c70 0x7efcf8164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:41.999+0000 7efd00000640 1 --2- 172.21.15.106:0/3848948381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efce0004810 0x7efcf80d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.003+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 >> 172.21.15.106:0/3848948381 conn(0x7efcf8068340 msgr2=0x7efcf81432e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:42.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.003+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 shutdown_connections 2024-04-26T21:16:42.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.003+0000 7efd00000640 1 -- 172.21.15.106:0/3848948381 wait complete. 2024-04-26T21:16:42.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.003+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff5140cd700 con 0x7ff5140d1410 2024-04-26T21:16:42.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.003+0000 7ff50b400640 1 -- 172.21.15.106:0/3797130083 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff500056e30 con 0x7ff5140d1410 2024-04-26T21:16:42.009 INFO:teuthology.orchestra.run.smithi106.stdout:64424509447 2024-04-26T21:16:42.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff4f40683e0 msgr2=0x7ff4f406a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff4f40683e0 0x7ff4f406a8a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff50401c4d0 tx=0x7ff5040a6000 comp rx=0 tx=0).stop 2024-04-26T21:16:42.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140d1410 msgr2=0x7ff5141400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140d1410 0x7ff5141400d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c7f0 tx=0x7ff50000ccb0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 shutdown_connections 2024-04-26T21:16:42.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5141415e0 0x7ff514140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff4f40683e0 0x7ff4f406a8a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff5140d1410 0x7ff5141400d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 --2- 172.21.15.106:0/3797130083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5140b4330 0x7ff514158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 >> 172.21.15.106:0/3797130083 conn(0x7ff514068340 msgr2=0x7ff5140cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:42.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 shutdown_connections 2024-04-26T21:16:42.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.011+0000 7ff51a200640 1 -- 172.21.15.106:0/3797130083 wait complete. 2024-04-26T21:16:42.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-04-26T21:16:42.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2024-04-26T21:16:42.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-04-26T21:16:42.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-04-26T21:16:42.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-04-26T21:16:42.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc618005590 con 0x7fc63c15f230 2024-04-26T21:16:42.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc636000640 1 -- 172.21.15.106:0/3552486324 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc63005adf0 con 0x7fc63c15f230 2024-04-26T21:16:42.053 INFO:teuthology.orchestra.run.smithi106.stdout:64424509448 2024-04-26T21:16:42.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc620068450 msgr2=0x7fc62006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc620068450 0x7fc62006a910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc62c01cd00 tx=0x7fc62c0a6000 comp rx=0 tx=0).stop 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 msgr2=0x7fc63c204ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 0x7fc63c204ba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc63000e820 tx=0x7fc63000ece0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 shutdown_connections 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63c14b4a0 0x7fc63c072d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc620068450 0x7fc62006a910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc63c15f230 0x7fc63c204ba0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 --2- 172.21.15.106:0/3552486324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc63c141600 0x7fc63c1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 >> 172.21.15.106:0/3552486324 conn(0x7fc63c0689c0 msgr2=0x7fc63c1543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 shutdown_connections 2024-04-26T21:16:42.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7fc644800640 1 -- 172.21.15.106:0/3552486324 wait complete. 2024-04-26T21:16:42.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.051+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4bd40b89c0 con 0x7f4bd40b3640 2024-04-26T21:16:42.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bd1600640 1 -- 172.21.15.106:0/3042501867 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4bc005e670 con 0x7f4bd40b3640 2024-04-26T21:16:42.057 INFO:teuthology.orchestra.run.smithi106.stdout:64424509448 2024-04-26T21:16:42.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4bb4068380 msgr2=0x7f4bb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4bb4068380 0x7f4bb406a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800ab60 tx=0x7f4bc8008040 comp rx=0 tx=0).stop 2024-04-26T21:16:42.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b3640 msgr2=0x7f4bd40c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b3640 0x7f4bd40c6570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000c490 tx=0x7f4bc0001e80 comp rx=0 tx=0).stop 2024-04-26T21:16:42.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 shutdown_connections 2024-04-26T21:16:42.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd40b3640 0x7f4bd40c6570 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4bb4068380 0x7f4bb406a840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4bd41633f0 0x7f4bd4070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 --2- 172.21.15.106:0/3042501867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bd40b2ba0 0x7f4bd4156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 >> 172.21.15.106:0/3042501867 conn(0x7f4bd40d2a40 msgr2=0x7f4bd40b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:42.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 shutdown_connections 2024-04-26T21:16:42.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.055+0000 7f4bda800640 1 -- 172.21.15.106:0/3042501867 wait complete. 2024-04-26T21:16:42.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2024-04-26T21:16:42.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-04-26T21:16:42.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.079+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0814071e00 con 0x7f0814158b10 2024-04-26T21:16:42.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.079+0000 7f0810c00640 1 -- 172.21.15.106:0/2749293599 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08000c3020 con 0x7f0814158b10 2024-04-26T21:16:42.084 INFO:teuthology.orchestra.run.smithi106.stdout:64424509448 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07f40683d0 msgr2=0x7f07f406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07f40683d0 0x7f07f406a890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0814142820 tx=0x7f0808009040 comp rx=0 tx=0).stop 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0814158b10 msgr2=0x7f081415a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0814158b10 0x7f081415a8e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f08000ab000 tx=0x7f0800019100 comp rx=0 tx=0).stop 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 shutdown_connections 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07f40683d0 0x7f07f406a890 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f081415b520 0x7f081413d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0814158b10 0x7f081415a8e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 --2- 172.21.15.106:0/2749293599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08140b4390 0x7f08142051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:42.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 >> 172.21.15.106:0/2749293599 conn(0x7f08140b26c0 msgr2=0x7f08141411a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:42.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 shutdown_connections 2024-04-26T21:16:42.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:42.083+0000 7f0819e00640 1 -- 172.21.15.106:0/2749293599 wait complete. 2024-04-26T21:16:42.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.6 2024-04-26T21:16:43.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T21:16:43.033 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T21:16:43.043 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T21:16:43.045 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T21:16:43.052 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T21:16:43.078 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T21:16:43.081 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T21:16:43.106 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T21:16:43.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.215+0000 7f9b09800640 1 Processor -- start 2024-04-26T21:16:43.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.215+0000 7f9b09800640 1 -- start start 2024-04-26T21:16:43.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b09800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b040b3c20 0x7f9b0406dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b09800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9b04073b60 0x7f9b04176670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b09800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b040733d0 con 0x7f9b0406f4c0 2024-04-26T21:16:43.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b09800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0416cf50 con 0x7f9b04073b60 2024-04-26T21:16:43.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b09800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0406e420 con 0x7f9b040b3c20 2024-04-26T21:16:43.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b02a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b040b3c20 0x7f9b0406dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b02a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b040b3c20 0x7f9b0406dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49550/0 (socket says 172.21.15.106:49550) 2024-04-26T21:16:43.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b02a00640 1 -- 172.21.15.106:0/600686958 learned_addr learned my addr 172.21.15.106:0/600686958 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b01600640 1 -- 172.21.15.106:0/600686958 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467147405 0 0) 0x7f9b040733d0 con 0x7f9b0406f4c0 2024-04-26T21:16:43.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b01600640 1 -- 172.21.15.106:0/600686958 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae8003530 con 0x7f9b0406f4c0 2024-04-26T21:16:43.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b02a00640 1 -- 172.21.15.106:0/600686958 >> v2:172.21.15.106:3300/0 conn(0x7f9b04073b60 msgr2=0x7f9b04176670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b02a00640 1 --2- 172.21.15.106:0/600686958 >> v2:172.21.15.106:3300/0 conn(0x7f9b04073b60 0x7f9b04176670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b02a00640 1 -- 172.21.15.106:0/600686958 >> v1:172.21.15.112:6789/0 conn(0x7f9b0406f4c0 legacy=0x7f9b040721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.219+0000 7f9b02a00640 1 -- 172.21.15.106:0/600686958 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0406e700 con 0x7f9b040b3c20 2024-04-26T21:16:43.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b02a00640 1 --2- 172.21.15.106:0/600686958 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b040b3c20 0x7f9b0406dd90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009870 tx=0x7f9af401c570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101ae7bbec5c8284 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b01600640 1 -- 172.21.15.106:0/600686958 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af40a9630 con 0x7f9b040b3c20 2024-04-26T21:16:43.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b01600640 1 -- 172.21.15.106:0/600686958 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af40a97d0 con 0x7f9b040b3c20 2024-04-26T21:16:43.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b01600640 1 -- 172.21.15.106:0/600686958 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af40a9be0 con 0x7f9b040b3c20 2024-04-26T21:16:43.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b09800640 1 -- 172.21.15.106:0/600686958 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b040b3c20 msgr2=0x7f9b0406dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b09800640 1 --2- 172.21.15.106:0/600686958 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b040b3c20 0x7f9b0406dd90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009870 tx=0x7f9af401c570 comp rx=0 tx=0).stop 2024-04-26T21:16:43.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b09800640 1 -- 172.21.15.106:0/600686958 shutdown_connections 2024-04-26T21:16:43.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b09800640 1 --2- 172.21.15.106:0/600686958 >> v2:172.21.15.106:3300/0 conn(0x7f9b04073b60 0x7f9b04176670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b09800640 1 --2- 172.21.15.106:0/600686958 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b040b3c20 0x7f9b0406dd90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b09800640 1 -- 172.21.15.106:0/600686958 >> 172.21.15.106:0/600686958 conn(0x7f9b040b26c0 msgr2=0x7f9b040b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b09800640 1 -- 172.21.15.106:0/600686958 shutdown_connections 2024-04-26T21:16:43.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.227+0000 7f9b09800640 1 -- 172.21.15.106:0/600686958 wait complete. 2024-04-26T21:16:43.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.231+0000 7f9b09800640 1 Processor -- start 2024-04-26T21:16:43.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.231+0000 7f9b09800640 1 -- start start 2024-04-26T21:16:43.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.231+0000 7f9b09800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406f4c0 0x7f9b04163700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.231+0000 7f9b09800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b04073b60 0x7f9b041644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.231+0000 7f9b09800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b040b3c20 0x7f9b0416a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.231+0000 7f9b02000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b04073b60 0x7f9b041644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b02000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b04073b60 0x7f9b041644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44438/0 (socket says 172.21.15.106:44438) 2024-04-26T21:16:43.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b03400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b040b3c20 0x7f9b0416a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b03400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b040b3c20 0x7f9b0416a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41164/0 (socket says 172.21.15.106:41164) 2024-04-26T21:16:43.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b02000640 1 -- 172.21.15.106:0/1941996224 learned_addr learned my addr 172.21.15.106:0/1941996224 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b09800640 1 -- 172.21.15.106:0/1941996224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9b04176d30 con 0x7f9b040b3c20 2024-04-26T21:16:43.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b09800640 1 -- 172.21.15.106:0/1941996224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9b04176bb0 con 0x7f9b04073b60 2024-04-26T21:16:43.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b09800640 1 -- 172.21.15.106:0/1941996224 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9b04176eb0 con 0x7f9b0406f4c0 2024-04-26T21:16:43.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b03400640 1 -- 172.21.15.106:0/1941996224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406f4c0 msgr2=0x7f9b04163700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b02a00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406f4c0 0x7f9b04163700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b03400640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406f4c0 0x7f9b04163700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b03400640 1 -- 172.21.15.106:0/1941996224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b04073b60 msgr2=0x7f9b041644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b03400640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b04073b60 0x7f9b041644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b03400640 1 -- 172.21.15.106:0/1941996224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b04164b30 con 0x7f9b040b3c20 2024-04-26T21:16:43.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b02000640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b04073b60 0x7f9b041644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:43.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b02a00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406f4c0 0x7f9b04163700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:43.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b03400640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b040b3c20 0x7f9b0416a920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00be20 tx=0x7f9afc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9afaa00640 1 -- 172.21.15.106:0/1941996224 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc019070 con 0x7f9b040b3c20 2024-04-26T21:16:43.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b09800640 1 -- 172.21.15.106:0/1941996224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b04162c20 con 0x7f9b040b3c20 2024-04-26T21:16:43.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.235+0000 7f9b09800640 1 -- 172.21.15.106:0/1941996224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b04162910 con 0x7f9b040b3c20 2024-04-26T21:16:43.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.239+0000 7f9afaa00640 1 -- 172.21.15.106:0/1941996224 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc01e440 con 0x7f9b040b3c20 2024-04-26T21:16:43.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.239+0000 7f9afaa00640 1 -- 172.21.15.106:0/1941996224 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc023060 con 0x7f9b040b3c20 2024-04-26T21:16:43.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.239+0000 7f9b09800640 1 -- 172.21.15.106:0/1941996224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9adc0052a0 con 0x7f9b040b3c20 2024-04-26T21:16:43.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.243+0000 7f9afaa00640 1 -- 172.21.15.106:0/1941996224 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9afc01c070 con 0x7f9b040b3c20 2024-04-26T21:16:43.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.243+0000 7f9afaa00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ae40683b0 0x7f9ae406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.247+0000 7f9b02a00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ae40683b0 0x7f9ae406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.255+0000 7f9afaa00640 1 -- 172.21.15.106:0/1941996224 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9afc054a40 con 0x7f9b040b3c20 2024-04-26T21:16:43.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.255+0000 7f9b02a00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ae40683b0 0x7f9ae406a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9af40ae000 tx=0x7f9af40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.255+0000 7f9afaa00640 1 -- 172.21.15.106:0/1941996224 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9afc0569a0 con 0x7f9b040b3c20 2024-04-26T21:16:43.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.291+0000 7f60e3e00640 1 Processor -- start 2024-04-26T21:16:43.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.291+0000 7f60e3e00640 1 -- start start 2024-04-26T21:16:43.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.291+0000 7fb42ca00640 1 Processor -- start 2024-04-26T21:16:43.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.291+0000 7fb42ca00640 1 -- start start 2024-04-26T21:16:43.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe278a00640 1 Processor -- start 2024-04-26T21:16:43.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f60e4141420 0x7f60e406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f60e4144270 0x7f60e40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 0x7f60e415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f60e40b4660 con 0x7f60e4141420 2024-04-26T21:16:43.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f60e406efd0 con 0x7f60e4144270 2024-04-26T21:16:43.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f60e406f2b0 con 0x7f60e40b4210 2024-04-26T21:16:43.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f60e4141420 0x7f60e406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f60e4141420 0x7f60e406e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41178/0 (socket says 172.21.15.106:41178) 2024-04-26T21:16:43.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e2a00640 1 -- 172.21.15.106:0/2151903456 learned_addr learned my addr 172.21.15.106:0/2151903456 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe278a00640 1 -- start start 2024-04-26T21:16:43.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3400640 1 --2- 172.21.15.106:0/2151903456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 0x7f60e415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e2000640 1 --2- 172.21.15.106:0/2151903456 >> v2:172.21.15.112:3300/0 conn(0x7f60e4144270 0x7f60e40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb42ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb42814cc80 0x7fb4280b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb42ca00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb4280b3f00 0x7fb428071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb42ca00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb428072680 con 0x7fb428072270 2024-04-26T21:16:43.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb42ca00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fb428072940 con 0x7fb4280b3f00 2024-04-26T21:16:43.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb42ca00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb428072c20 con 0x7fb42814cc80 2024-04-26T21:16:43.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb426800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb42814cc80 0x7fb4280b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb427200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb428072270 0x7fb42806dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:43990/0 (socket says 172.21.15.106:43990) 2024-04-26T21:16:43.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb427200640 1 -- 172.21.15.106:0/2984640075 learned_addr learned my addr 172.21.15.106:0/2984640075 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:43.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb425e00640 1 --2- 172.21.15.106:0/2984640075 >> v2:172.21.15.106:3300/0 conn(0x7fb4280b3f00 0x7fb428071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb426800640 1 -- 172.21.15.106:0/2984640075 >> v2:172.21.15.106:3300/0 conn(0x7fb4280b3f00 msgr2=0x7fb428071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb426800640 1 --2- 172.21.15.106:0/2984640075 >> v2:172.21.15.106:3300/0 conn(0x7fb4280b3f00 0x7fb428071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb426800640 1 -- 172.21.15.106:0/2984640075 >> v1:172.21.15.112:6789/0 conn(0x7fb428072270 legacy=0x7fb42806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fb426800640 1 -- 172.21.15.106:0/2984640075 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb428072f00 con 0x7fb42814cc80 2024-04-26T21:16:43.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe278a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2740d38f0 0x7fe2740d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe278a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2740b5700 0x7fe2740d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe278a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2740d5940 con 0x7fe2740b5020 2024-04-26T21:16:43.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe278a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe2740c8750 con 0x7fe2740d38f0 2024-04-26T21:16:43.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe278a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe2740d56f0 con 0x7fe2740b5700 2024-04-26T21:16:43.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe272a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2740d38f0 0x7fe2740d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe272a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2740d38f0 0x7fe2740d29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41196/0 (socket says 172.21.15.106:41196) 2024-04-26T21:16:43.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe272a00640 1 -- 172.21.15.106:0/2756074206 learned_addr learned my addr 172.21.15.106:0/2756074206 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7fe273e00640 1 --2- 172.21.15.106:0/2756074206 >> v2:172.21.15.112:3300/0 conn(0x7fe2740b5700 0x7fe2740d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.299+0000 7fe272a00640 1 -- 172.21.15.106:0/2756074206 >> v2:172.21.15.112:3300/0 conn(0x7fe2740b5700 msgr2=0x7fe2740d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.299+0000 7fe272a00640 1 --2- 172.21.15.106:0/2756074206 >> v2:172.21.15.112:3300/0 conn(0x7fe2740b5700 0x7fe2740d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.299+0000 7fe272a00640 1 -- 172.21.15.106:0/2756074206 >> v1:172.21.15.106:6789/0 conn(0x7fe2740b5020 legacy=0x7fe2740d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.299+0000 7fe272a00640 1 -- 172.21.15.106:0/2756074206 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2740d0450 con 0x7fe2740d38f0 2024-04-26T21:16:43.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3400640 1 -- 172.21.15.106:0/2151903456 >> v2:172.21.15.112:3300/0 conn(0x7f60e4144270 msgr2=0x7f60e40b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3400640 1 --2- 172.21.15.106:0/2151903456 >> v2:172.21.15.112:3300/0 conn(0x7f60e4144270 0x7f60e40b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3400640 1 -- 172.21.15.106:0/2151903456 >> v2:172.21.15.106:3300/0 conn(0x7f60e4141420 msgr2=0x7f60e406e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3400640 1 --2- 172.21.15.106:0/2151903456 >> v2:172.21.15.106:3300/0 conn(0x7f60e4141420 0x7f60e406e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.295+0000 7f60e3400640 1 -- 172.21.15.106:0/2151903456 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e406f590 con 0x7f60e40b4210 2024-04-26T21:16:43.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.299+0000 7fb426800640 1 --2- 172.21.15.106:0/2984640075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb42814cc80 0x7fb4280b39c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb42806fdc0 tx=0x7fb41802d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1942280427cd00d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb425400640 1 -- 172.21.15.106:0/2984640075 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4180c1070 con 0x7fb42814cc80 2024-04-26T21:16:43.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb425400640 1 -- 172.21.15.106:0/2984640075 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4180bc600 con 0x7fb42814cc80 2024-04-26T21:16:43.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb425400640 1 -- 172.21.15.106:0/2984640075 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4180bc9d0 con 0x7fb42814cc80 2024-04-26T21:16:43.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb42ca00640 1 -- 172.21.15.106:0/2984640075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb42814cc80 msgr2=0x7fb4280b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb42ca00640 1 --2- 172.21.15.106:0/2984640075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb42814cc80 0x7fb4280b39c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb42806fdc0 tx=0x7fb41802d490 comp rx=0 tx=0).stop 2024-04-26T21:16:43.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fe272a00640 1 --2- 172.21.15.106:0/2756074206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740d38f0 0x7fe2740d29e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe27408e570 tx=0x7fe25c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f73a5d4856145 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb42ca00640 1 -- 172.21.15.106:0/2984640075 shutdown_connections 2024-04-26T21:16:43.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb42ca00640 1 --2- 172.21.15.106:0/2984640075 >> v2:172.21.15.106:3300/0 conn(0x7fb4280b3f00 0x7fb428071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb42ca00640 1 --2- 172.21.15.106:0/2984640075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb42814cc80 0x7fb4280b39c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb42ca00640 1 -- 172.21.15.106:0/2984640075 >> 172.21.15.106:0/2984640075 conn(0x7fb4280b26c0 msgr2=0x7fb4280b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7f60e3400640 1 --2- 172.21.15.106:0/2151903456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 0x7f60e415ead0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f60e40b60b0 tx=0x7f60dc01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=639e895bec1f3560 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb42ca00640 1 -- 172.21.15.106:0/2984640075 shutdown_connections 2024-04-26T21:16:43.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fb42ca00640 1 -- 172.21.15.106:0/2984640075 wait complete. 2024-04-26T21:16:43.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7f60e1600640 1 -- 172.21.15.106:0/2151903456 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0b0070 con 0x7f60e40b4210 2024-04-26T21:16:43.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7f60e1600640 1 -- 172.21.15.106:0/2151903456 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60dc0ab600 con 0x7f60e40b4210 2024-04-26T21:16:43.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7f60e1600640 1 -- 172.21.15.106:0/2151903456 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0ab9d0 con 0x7f60e40b4210 2024-04-26T21:16:43.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7f60e3e00640 1 -- 172.21.15.106:0/2151903456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 msgr2=0x7f60e415ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7f60e3e00640 1 --2- 172.21.15.106:0/2151903456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 0x7f60e415ead0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f60e40b60b0 tx=0x7f60dc01c410 comp rx=0 tx=0).stop 2024-04-26T21:16:43.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.303+0000 7fe272000640 1 -- 172.21.15.106:0/2756074206 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0b0070 con 0x7fe2740d38f0 2024-04-26T21:16:43.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe272000640 1 -- 172.21.15.106:0/2756074206 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c0ab600 con 0x7fe2740d38f0 2024-04-26T21:16:43.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe272000640 1 -- 172.21.15.106:0/2756074206 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0a4e60 con 0x7fe2740d38f0 2024-04-26T21:16:43.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7f60e3e00640 1 -- 172.21.15.106:0/2151903456 shutdown_connections 2024-04-26T21:16:43.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7f60e3e00640 1 --2- 172.21.15.106:0/2151903456 >> v2:172.21.15.112:3300/0 conn(0x7f60e4144270 0x7f60e40b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7f60e3e00640 1 --2- 172.21.15.106:0/2151903456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 0x7f60e415ead0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7f60e3e00640 1 --2- 172.21.15.106:0/2151903456 >> v2:172.21.15.106:3300/0 conn(0x7f60e4141420 0x7f60e406e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7f60e3e00640 1 -- 172.21.15.106:0/2151903456 >> 172.21.15.106:0/2151903456 conn(0x7f60e40b26c0 msgr2=0x7f60e40b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7f60e3e00640 1 -- 172.21.15.106:0/2151903456 shutdown_connections 2024-04-26T21:16:43.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7f60e3e00640 1 -- 172.21.15.106:0/2151903456 wait complete. 2024-04-26T21:16:43.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fb42ca00640 1 Processor -- start 2024-04-26T21:16:43.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe278a00640 1 -- 172.21.15.106:0/2756074206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740d38f0 msgr2=0x7fe2740d29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe278a00640 1 --2- 172.21.15.106:0/2756074206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740d38f0 0x7fe2740d29e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe27408e570 tx=0x7fe25c01c4e0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe278a00640 1 -- 172.21.15.106:0/2756074206 shutdown_connections 2024-04-26T21:16:43.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe278a00640 1 --2- 172.21.15.106:0/2756074206 >> v2:172.21.15.112:3300/0 conn(0x7fe2740b5700 0x7fe2740d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe278a00640 1 --2- 172.21.15.106:0/2756074206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740d38f0 0x7fe2740d29e0 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe27408e570 tx=0x7fe25c01c4e0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe278a00640 1 -- 172.21.15.106:0/2756074206 >> 172.21.15.106:0/2756074206 conn(0x7fe2740d4c00 msgr2=0x7fe2740d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fb42ca00640 1 -- start start 2024-04-26T21:16:43.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe278a00640 1 -- 172.21.15.106:0/2756074206 shutdown_connections 2024-04-26T21:16:43.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fe278a00640 1 -- 172.21.15.106:0/2756074206 wait complete. 2024-04-26T21:16:43.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7f60e3e00640 1 Processor -- start 2024-04-26T21:16:43.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e3e00640 1 -- start start 2024-04-26T21:16:43.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.307+0000 7fb42ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb428072270 0x7fb428147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb42ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280b3f00 0x7fb4280ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb426800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb428072270 0x7fb428147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb426800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb428072270 0x7fb428147ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:49590/0 (socket says 172.21.15.106:49590) 2024-04-26T21:16:43.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb425e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280b3f00 0x7fb4280ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb426800640 1 -- 172.21.15.106:0/1499005633 learned_addr learned my addr 172.21.15.106:0/1499005633 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb42ca00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb42814cc80 0x7fb4281f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb42812baf0 con 0x7fb42814cc80 2024-04-26T21:16:43.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb42812b970 con 0x7fb4280b3f00 2024-04-26T21:16:43.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb42812bc70 con 0x7fb428072270 2024-04-26T21:16:43.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fe278a00640 1 Processor -- start 2024-04-26T21:16:43.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb427200640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb42814cc80 0x7fb4281f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 0x7f60e4168880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e4141420 0x7f60e415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e4144270 0x7f60e41ffcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e3e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f60e40729c0 con 0x7f60e4144270 2024-04-26T21:16:43.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f60e4072840 con 0x7f60e4141420 2024-04-26T21:16:43.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f60e4072b40 con 0x7f60e40b4210 2024-04-26T21:16:43.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 0x7f60e4168880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e4141420 0x7f60e415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb426800640 1 -- 172.21.15.106:0/1499005633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280b3f00 msgr2=0x7fb4280ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb426800640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280b3f00 0x7fb4280ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb426800640 1 -- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb42814cc80 msgr2=0x7fb4281f3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb426800640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb42814cc80 0x7fb4281f3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb426800640 1 -- 172.21.15.106:0/1499005633 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4281f3760 con 0x7fb428072270 2024-04-26T21:16:43.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb425e00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280b3f00 0x7fb4280ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:43.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fe278a00640 1 -- start start 2024-04-26T21:16:43.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e2000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e4141420 0x7f60e415a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44488/0 (socket says 172.21.15.106:44488) 2024-04-26T21:16:43.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e2000640 1 -- 172.21.15.106:0/1224881360 learned_addr learned my addr 172.21.15.106:0/1224881360 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fe278a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740b5020 0x7fe2741520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7f60e3400640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e4144270 0x7f60e41ffcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fe278a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2740b5700 0x7fe27415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fe278a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740b3de0 0x7fe2740cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fb426800640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb428072270 0x7fb428147ce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb4180bf040 tx=0x7fb41802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fe278a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe2740d2590 con 0x7fe2740b5020 2024-04-26T21:16:43.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fe278a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2740d2410 con 0x7fe2740b3de0 2024-04-26T21:16:43.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.311+0000 7fe278a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe27416c0a0 con 0x7fe2740b5700 2024-04-26T21:16:43.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60e2000640 1 -- 172.21.15.106:0/1224881360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 msgr2=0x7f60e4168880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60e2000640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 0x7f60e4168880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60e2000640 1 -- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e4144270 msgr2=0x7f60e41ffcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60e2000640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e4144270 0x7f60e41ffcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60e2000640 1 -- 172.21.15.106:0/1224881360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e406fb50 con 0x7f60e4141420 2024-04-26T21:16:43.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60e3400640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e4144270 0x7f60e41ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:43.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe273e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740b3de0 0x7fe2740cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe273e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740b3de0 0x7fe2740cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44502/0 (socket says 172.21.15.106:44502) 2024-04-26T21:16:43.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe273e00640 1 -- 172.21.15.106:0/2900791949 learned_addr learned my addr 172.21.15.106:0/2900791949 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe273400640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740b5020 0x7fe2741520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe272a00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2740b5700 0x7fe27415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe272a00640 1 -- 172.21.15.106:0/2900791949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740b3de0 msgr2=0x7fe2740cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe272a00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740b3de0 0x7fe2740cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe272a00640 1 -- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740b5020 msgr2=0x7fe2741520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe272a00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740b5020 0x7fe2741520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe272a00640 1 -- 172.21.15.106:0/2900791949 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe274152610 con 0x7fe2740b5700 2024-04-26T21:16:43.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe273400640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740b5020 0x7fe2741520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:43.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60e2000640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e4141420 0x7f60e415a660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00a770 tx=0x7f60cc00ac30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fb41ea00640 1 -- 172.21.15.106:0/1499005633 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4180c1040 con 0x7fb428072270 2024-04-26T21:16:43.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fb41ea00640 1 -- 172.21.15.106:0/1499005633 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4180cb070 con 0x7fb428072270 2024-04-26T21:16:43.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fb41ea00640 1 -- 172.21.15.106:0/1499005633 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4180c5610 con 0x7fb428072270 2024-04-26T21:16:43.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60db400640 1 -- 172.21.15.106:0/1224881360 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc017020 con 0x7f60e4141420 2024-04-26T21:16:43.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60db400640 1 -- 172.21.15.106:0/1224881360 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60cc00d8a0 con 0x7f60e4141420 2024-04-26T21:16:43.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60db400640 1 -- 172.21.15.106:0/1224881360 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00dc50 con 0x7f60e4141420 2024-04-26T21:16:43.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4280ad570 con 0x7fb428072270 2024-04-26T21:16:43.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4280adaf0 con 0x7fb428072270 2024-04-26T21:16:43.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fe272a00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2740b5700 0x7fe27415aab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe27408d3e0 tx=0x7fe25c019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e413e550 con 0x7f60e4141420 2024-04-26T21:16:43.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e413eb10 con 0x7f60e4141420 2024-04-26T21:16:43.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.315+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4000052a0 con 0x7fb428072270 2024-04-26T21:16:43.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7fe26b400640 1 -- 172.21.15.106:0/2900791949 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0bb070 con 0x7fe2740b5700 2024-04-26T21:16:43.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7fe26b400640 1 -- 172.21.15.106:0/2900791949 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c0a4e60 con 0x7fe2740b5700 2024-04-26T21:16:43.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7fe26b400640 1 -- 172.21.15.106:0/2900791949 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0b0040 con 0x7fe2740b5700 2024-04-26T21:16:43.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7fe278a00640 1 -- 172.21.15.106:0/2900791949 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27415a010 con 0x7fe2740b5700 2024-04-26T21:16:43.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7f60db400640 1 -- 172.21.15.106:0/1224881360 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f60cc01a020 con 0x7f60e4141420 2024-04-26T21:16:43.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7fe278a00640 1 -- 172.21.15.106:0/2900791949 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2740b4520 con 0x7fe2740b5700 2024-04-26T21:16:43.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7fb41ea00640 1 -- 172.21.15.106:0/1499005633 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb4180c57b0 con 0x7fb428072270 2024-04-26T21:16:43.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7fe268c00640 1 -- 172.21.15.106:0/2900791949 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe274069b10 con 0x7fe2740b5700 2024-04-26T21:16:43.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7f2df0a00640 1 Processor -- start 2024-04-26T21:16:43.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e4069400 con 0x7f60e4141420 2024-04-26T21:16:43.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7f60db400640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f60c0068450 0x7f60c006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7f60db400640 1 -- 172.21.15.106:0/1224881360 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f60cc086b10 con 0x7f60e4141420 2024-04-26T21:16:43.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7f60e2a00640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f60c0068450 0x7f60c006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7f2df0a00640 1 -- start start 2024-04-26T21:16:43.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7fb41ea00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb408068450 0x7fb40806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.319+0000 7fb41ea00640 1 -- 172.21.15.106:0/1499005633 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb418132430 con 0x7fb428072270 2024-04-26T21:16:43.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7fb425e00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb408068450 0x7fb40806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f60e2a00640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f60c0068450 0x7f60c006a910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f60d4003f50 tx=0x7f60d40091b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7fb41ea00640 1 -- 172.21.15.106:0/1499005633 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb4180270a0 con 0x7fb428072270 2024-04-26T21:16:43.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2df0a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2dec1464d0 0x7f2dec0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2df0a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 0x7f2dec0d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2df0a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2dec0b3c80 0x7f2dec0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2df0a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f2dec1468b0 con 0x7f2dec1464d0 2024-04-26T21:16:43.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2df0a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2dec163b70 con 0x7f2dec0b3c80 2024-04-26T21:16:43.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2df0a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2dec163e10 con 0x7f2dec146b70 2024-04-26T21:16:43.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2de9e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2dec1464d0 0x7f2dec0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2de9e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2dec1464d0 0x7f2dec0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41238/0 (socket says 172.21.15.106:41238) 2024-04-26T21:16:43.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2de9e00640 1 -- 172.21.15.106:0/781100307 learned_addr learned my addr 172.21.15.106:0/781100307 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2de9400640 1 --2- 172.21.15.106:0/781100307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 0x7f2dec0d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7fb425e00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb408068450 0x7fb40806a910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4280acde0 tx=0x7fb414008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2dea800640 1 --2- 172.21.15.106:0/781100307 >> v2:172.21.15.112:3300/0 conn(0x7f2dec0b3c80 0x7f2dec0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2de9400640 1 -- 172.21.15.106:0/781100307 >> v2:172.21.15.112:3300/0 conn(0x7f2dec0b3c80 msgr2=0x7f2dec0b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2de9400640 1 --2- 172.21.15.106:0/781100307 >> v2:172.21.15.112:3300/0 conn(0x7f2dec0b3c80 0x7f2dec0b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2de9400640 1 -- 172.21.15.106:0/781100307 >> v2:172.21.15.106:3300/0 conn(0x7f2dec1464d0 msgr2=0x7f2dec0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2de9400640 1 --2- 172.21.15.106:0/781100307 >> v2:172.21.15.106:3300/0 conn(0x7f2dec1464d0 0x7f2dec0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7f2de9400640 1 -- 172.21.15.106:0/781100307 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dec1640f0 con 0x7f2dec146b70 2024-04-26T21:16:43.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.323+0000 7fe26b400640 1 -- 172.21.15.106:0/2900791949 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe25c0be070 con 0x7fe2740b5700 2024-04-26T21:16:43.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.327+0000 7f60db400640 1 -- 172.21.15.106:0/1224881360 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f60cc021020 con 0x7f60e4141420 2024-04-26T21:16:43.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.327+0000 7fe26b400640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2500683d0 0x7fe25006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.327+0000 7fe26b400640 1 -- 172.21.15.106:0/2900791949 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe25c11fd80 con 0x7fe2740b5700 2024-04-26T21:16:43.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.327+0000 7fe273400640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2500683d0 0x7fe25006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.327+0000 7fe26b400640 1 -- 172.21.15.106:0/2900791949 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe25c0c6080 con 0x7fe2740b5700 2024-04-26T21:16:43.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2de9400640 1 --2- 172.21.15.106:0/781100307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 0x7f2dec0d1330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2dec074400 tx=0x7f2dd801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70723e46f6e6111c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7fe273400640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2500683d0 0x7fe25006a890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009cb0 tx=0x7fe26c009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2de8a00640 1 -- 172.21.15.106:0/781100307 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80ab610 con 0x7f2dec146b70 2024-04-26T21:16:43.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2de8a00640 1 -- 172.21.15.106:0/781100307 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd80b0070 con 0x7f2dec146b70 2024-04-26T21:16:43.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2de8a00640 1 -- 172.21.15.106:0/781100307 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80ab9d0 con 0x7f2dec146b70 2024-04-26T21:16:43.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2df0a00640 1 -- 172.21.15.106:0/781100307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 msgr2=0x7f2dec0d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2df0a00640 1 --2- 172.21.15.106:0/781100307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 0x7f2dec0d1330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2dec074400 tx=0x7f2dd801c450 comp rx=0 tx=0).stop 2024-04-26T21:16:43.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2df0a00640 1 -- 172.21.15.106:0/781100307 shutdown_connections 2024-04-26T21:16:43.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2df0a00640 1 --2- 172.21.15.106:0/781100307 >> v2:172.21.15.112:3300/0 conn(0x7f2dec0b3c80 0x7f2dec0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2df0a00640 1 --2- 172.21.15.106:0/781100307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 0x7f2dec0d1330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2df0a00640 1 --2- 172.21.15.106:0/781100307 >> v2:172.21.15.106:3300/0 conn(0x7f2dec1464d0 0x7f2dec0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2df0a00640 1 -- 172.21.15.106:0/781100307 >> 172.21.15.106:0/781100307 conn(0x7f2dec068340 msgr2=0x7f2dec068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2df0a00640 1 -- 172.21.15.106:0/781100307 shutdown_connections 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.331+0000 7f2df0a00640 1 -- 172.21.15.106:0/781100307 wait complete. 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.335+0000 7f2df0a00640 1 Processor -- start 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.335+0000 7f2df0a00640 1 -- start start 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.335+0000 7f2df0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dec0b3c80 0x7f2dec1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.335+0000 7f2df0a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dec1464d0 0x7f2dec1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.335+0000 7f2df0a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 0x7f2dec141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.335+0000 7f2df0a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec072760 con 0x7f2dec1464d0 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.335+0000 7f2df0a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec0728e0 con 0x7f2dec0b3c80 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.335+0000 7f2df0a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2dec072a60 con 0x7f2dec146b70 2024-04-26T21:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dec0b3c80 0x7f2dec1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dec0b3c80 0x7f2dec1583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44518/0 (socket says 172.21.15.106:44518) 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9e00640 1 -- 172.21.15.106:0/2967326440 learned_addr learned my addr 172.21.15.106:0/2967326440 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9400640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dec1464d0 0x7f2dec1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9e00640 1 -- 172.21.15.106:0/2967326440 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 msgr2=0x7f2dec141ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9e00640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 0x7f2dec141ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9e00640 1 -- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dec1464d0 msgr2=0x7f2dec1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9e00640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dec1464d0 0x7f2dec1415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9e00640 1 -- 172.21.15.106:0/2967326440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dec13f720 con 0x7f2dec0b3c80 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de9e00640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dec0b3c80 0x7f2dec1583b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e8c0 tx=0x7f2ddc00ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de2000640 1 -- 172.21.15.106:0/2967326440 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc017070 con 0x7f2dec0b3c80 2024-04-26T21:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de2000640 1 -- 172.21.15.106:0/2967326440 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00c940 con 0x7f2dec0b3c80 2024-04-26T21:16:43.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2de2000640 1 -- 172.21.15.106:0/2967326440 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00cd30 con 0x7f2dec0b3c80 2024-04-26T21:16:43.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dec13f440 con 0x7f2dec0b3c80 2024-04-26T21:16:43.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.339+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dec135610 con 0x7f2dec0b3c80 2024-04-26T21:16:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.343+0000 7f2de2000640 1 -- 172.21.15.106:0/2967326440 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ddc01a070 con 0x7f2dec0b3c80 2024-04-26T21:16:43.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.343+0000 7f2de2000640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2dcc068380 0x7f2dcc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.343+0000 7f2de2000640 1 -- 172.21.15.106:0/2967326440 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2ddc054ba0 con 0x7f2dec0b3c80 2024-04-26T21:16:43.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.347+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dec069400 con 0x7f2dec0b3c80 2024-04-26T21:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.347+0000 7f2de9400640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2dcc068380 0x7f2dcc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.351+0000 7f2de9400640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2dcc068380 0x7f2dcc06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80af000 tx=0x7f2dd8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.351+0000 7f01efc00640 1 Processor -- start 2024-04-26T21:16:43.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.351+0000 7f01efc00640 1 -- start start 2024-04-26T21:16:43.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.351+0000 7f2de2000640 1 -- 172.21.15.106:0/2967326440 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2ddc057200 con 0x7f2dec0b3c80 2024-04-26T21:16:43.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.351+0000 7f01efc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f01e80d1500 0x7f01e80b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.351+0000 7f01efc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e8146b70 0x7f01e80b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.351+0000 7f01efc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e8163b70 con 0x7f01e81464d0 2024-04-26T21:16:43.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.351+0000 7f01efc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f01e81468b0 con 0x7f01e80d1500 2024-04-26T21:16:43.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.351+0000 7f01efc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f01e8163e10 con 0x7f01e8146b70 2024-04-26T21:16:43.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01ed200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f01e81464d0 0x7f01e80d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34910/0 (socket says 172.21.15.106:34910) 2024-04-26T21:16:43.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01edc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e8146b70 0x7f01e80b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01ed200640 1 -- 172.21.15.106:0/1989614878 learned_addr learned my addr 172.21.15.106:0/1989614878 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:43.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01e7e00640 1 --2- 172.21.15.106:0/1989614878 >> v2:172.21.15.112:3300/0 conn(0x7f01e80d1500 0x7f01e80b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01e7400640 1 -- 172.21.15.106:0/1989614878 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890452399 0 0) 0x7f01e8163b70 con 0x7f01e81464d0 2024-04-26T21:16:43.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01e7400640 1 -- 172.21.15.106:0/1989614878 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01cc003530 con 0x7f01e81464d0 2024-04-26T21:16:43.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01e7400640 1 -- 172.21.15.106:0/1989614878 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3253575566 0 0) 0x7f01cc003530 con 0x7f01e81464d0 2024-04-26T21:16:43.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01e7e00640 1 -- 172.21.15.106:0/1989614878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e8146b70 msgr2=0x7f01e80b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01e7e00640 1 --2- 172.21.15.106:0/1989614878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e8146b70 0x7f01e80b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01e7e00640 1 -- 172.21.15.106:0/1989614878 >> v1:172.21.15.106:6789/0 conn(0x7f01e81464d0 legacy=0x7f01e80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01e7e00640 1 -- 172.21.15.106:0/1989614878 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e81640f0 con 0x7f01e80d1500 2024-04-26T21:16:43.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.355+0000 7f01edc00640 1 --2- 172.21.15.106:0/1989614878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e8146b70 0x7f01e80b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:43.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.359+0000 7f01e7e00640 1 --2- 172.21.15.106:0/1989614878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 0x7f01e80b3c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01e00097c0 tx=0x7f01e001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acdf47bcba42f080 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01e7400640 1 -- 172.21.15.106:0/1989614878 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e00b0070 con 0x7f01e80d1500 2024-04-26T21:16:43.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01e7400640 1 -- 172.21.15.106:0/1989614878 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e00ab400 con 0x7f01e80d1500 2024-04-26T21:16:43.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01e7400640 1 -- 172.21.15.106:0/1989614878 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d40016a0 con 0x7f01e80d1500 2024-04-26T21:16:43.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01efc00640 1 -- 172.21.15.106:0/1989614878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 msgr2=0x7f01e80b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01efc00640 1 --2- 172.21.15.106:0/1989614878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 0x7f01e80b3c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01e00097c0 tx=0x7f01e001c390 comp rx=0 tx=0).stop 2024-04-26T21:16:43.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f18dcc00640 1 Processor -- start 2024-04-26T21:16:43.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01efc00640 1 -- 172.21.15.106:0/1989614878 shutdown_connections 2024-04-26T21:16:43.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01efc00640 1 --2- 172.21.15.106:0/1989614878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e8146b70 0x7f01e80b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01efc00640 1 --2- 172.21.15.106:0/1989614878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 0x7f01e80b3c80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01efc00640 1 -- 172.21.15.106:0/1989614878 >> 172.21.15.106:0/1989614878 conn(0x7f01e8068340 msgr2=0x7f01e8068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01efc00640 1 -- 172.21.15.106:0/1989614878 shutdown_connections 2024-04-26T21:16:43.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f18dcc00640 1 -- start start 2024-04-26T21:16:43.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.363+0000 7f01efc00640 1 -- 172.21.15.106:0/1989614878 wait complete. 2024-04-26T21:16:43.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01efc00640 1 Processor -- start 2024-04-26T21:16:43.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f18dcc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f18d815d060 0x7f18d80cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01efc00640 1 -- start start 2024-04-26T21:16:43.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f18dcc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f18d80b3a40 0x7f18d80cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7fc1aee00640 1 Processor -- start 2024-04-26T21:16:43.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01efc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 0x7f01e815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01efc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e81464d0 0x7f01e813ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01efc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e8146b70 0x7f01e815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01efc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f01e8149620 con 0x7f01e8146b70 2024-04-26T21:16:43.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01efc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01e81494a0 con 0x7f01e80d1500 2024-04-26T21:16:43.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01efc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f01e81497a0 con 0x7f01e81464d0 2024-04-26T21:16:43.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f18dcc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d80b2250 con 0x7f18d80cfb70 2024-04-26T21:16:43.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f18dcc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f18d80b25a0 con 0x7f18d815d060 2024-04-26T21:16:43.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f18dcc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f18d80ce660 con 0x7f18d80b3a40 2024-04-26T21:16:43.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f18d6800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f18d80b3a40 0x7f18d80cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f18d6800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f18d80b3a40 0x7f18d80cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44540/0 (socket says 172.21.15.106:44540) 2024-04-26T21:16:43.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f18d6800640 1 -- 172.21.15.106:0/2773781870 learned_addr learned my addr 172.21.15.106:0/2773781870 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01ed200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 0x7f01e815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01ed200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 0x7f01e815c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44544/0 (socket says 172.21.15.106:44544) 2024-04-26T21:16:43.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01ed200640 1 -- 172.21.15.106:0/289424595 learned_addr learned my addr 172.21.15.106:0/289424595 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f01e7e00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e81464d0 0x7f01e813ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7fc1aee00640 1 -- start start 2024-04-26T21:16:43.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1aee00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1a815d060 0x7fc1a80cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1aee00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a80b2250 con 0x7fc1a80cfb70 2024-04-26T21:16:43.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1aee00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a80ce660 con 0x7fc1a80b3a40 2024-04-26T21:16:43.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1aee00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a80b25a0 con 0x7fc1a815d060 2024-04-26T21:16:43.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01ed200640 1 -- 172.21.15.106:0/289424595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e81464d0 msgr2=0x7f01e813ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01ed200640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e81464d0 0x7f01e813ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01ed200640 1 -- 172.21.15.106:0/289424595 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e8146b70 msgr2=0x7f01e815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01ed200640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e8146b70 0x7f01e815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01ed200640 1 -- 172.21.15.106:0/289424595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e815b630 con 0x7f01e80d1500 2024-04-26T21:16:43.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1ace00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc1a80b3a40 0x7fc1a80d0f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:43992/0 (socket says 172.21.15.106:43992) 2024-04-26T21:16:43.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1ace00640 1 -- 172.21.15.106:0/348411918 learned_addr learned my addr 172.21.15.106:0/348411918 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:43.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1a7e00640 1 --2- 172.21.15.106:0/348411918 >> v2:172.21.15.112:3300/0 conn(0x7fc1a815d060 0x7fc1a80cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.367+0000 7f18d5e00640 1 --2- 172.21.15.106:0/2773781870 >> v2:172.21.15.106:3300/0 conn(0x7f18d815d060 0x7f18d80cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01ed200640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 0x7f01e815c660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01d4001210 tx=0x7f01d400cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f18d5e00640 1 -- 172.21.15.106:0/2773781870 >> v2:172.21.15.112:3300/0 conn(0x7f18d80b3a40 msgr2=0x7f18d80cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f18d5e00640 1 --2- 172.21.15.106:0/2773781870 >> v2:172.21.15.112:3300/0 conn(0x7f18d80b3a40 0x7f18d80cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f18d5e00640 1 -- 172.21.15.106:0/2773781870 >> v1:172.21.15.106:6789/0 conn(0x7f18d80cfb70 legacy=0x7f18d80d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f18d5e00640 1 -- 172.21.15.106:0/2773781870 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d80ce940 con 0x7f18d815d060 2024-04-26T21:16:43.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01e4c00640 1 -- 172.21.15.106:0/289424595 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4018070 con 0x7f01e80d1500 2024-04-26T21:16:43.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01e4c00640 1 -- 172.21.15.106:0/289424595 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d40072d0 con 0x7f01e80d1500 2024-04-26T21:16:43.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01e4c00640 1 -- 172.21.15.106:0/289424595 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d40047f0 con 0x7f01e80d1500 2024-04-26T21:16:43.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1a7e00640 1 -- 172.21.15.106:0/348411918 >> v1:172.21.15.112:6789/0 conn(0x7fc1a80b3a40 legacy=0x7fc1a80d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1a7e00640 1 -- 172.21.15.106:0/348411918 >> v1:172.21.15.106:6789/0 conn(0x7fc1a80cfb70 legacy=0x7fc1a80d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7fc1a7e00640 1 -- 172.21.15.106:0/348411918 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a80ce940 con 0x7fc1a815d060 2024-04-26T21:16:43.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e815b8a0 con 0x7f01e80d1500 2024-04-26T21:16:43.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.371+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e815be60 con 0x7f01e80d1500 2024-04-26T21:16:43.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.375+0000 7f01e4c00640 1 -- 172.21.15.106:0/289424595 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01d4004990 con 0x7f01e80d1500 2024-04-26T21:16:43.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.375+0000 7f18d5e00640 1 --2- 172.21.15.106:0/2773781870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d815d060 0x7f18d80cf630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18d8073ec0 tx=0x7f18c801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3f82ce604cdf63 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.375+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e8069400 con 0x7f01e80d1500 2024-04-26T21:16:43.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.375+0000 7f18d4a00640 1 -- 172.21.15.106:0/2773781870 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80b1070 con 0x7f18d815d060 2024-04-26T21:16:43.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.375+0000 7f18d4a00640 1 -- 172.21.15.106:0/2773781870 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c80ac5f0 con 0x7f18d815d060 2024-04-26T21:16:43.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.375+0000 7f01e4c00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f01c80683b0 0x7f01c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.375+0000 7fc1a7e00640 1 --2- 172.21.15.106:0/348411918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 0x7fc1a80cf630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1940097c0 tx=0x7fc19401c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c513974d7e19bf8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.375+0000 7f01e4c00640 1 -- 172.21.15.106:0/289424595 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f01d40861b0 con 0x7f01e80d1500 2024-04-26T21:16:43.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f01e7e00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f01c80683b0 0x7f01c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f18d4a00640 1 -- 172.21.15.106:0/2773781870 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80ac9c0 con 0x7f18d815d060 2024-04-26T21:16:43.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f18dcc00640 1 -- 172.21.15.106:0/2773781870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d815d060 msgr2=0x7f18d80cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f18dcc00640 1 --2- 172.21.15.106:0/2773781870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d815d060 0x7f18d80cf630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18d8073ec0 tx=0x7f18c801c480 comp rx=0 tx=0).stop 2024-04-26T21:16:43.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f18dcc00640 1 -- 172.21.15.106:0/2773781870 shutdown_connections 2024-04-26T21:16:43.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f18dcc00640 1 --2- 172.21.15.106:0/2773781870 >> v2:172.21.15.112:3300/0 conn(0x7f18d80b3a40 0x7f18d80cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f18dcc00640 1 --2- 172.21.15.106:0/2773781870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d815d060 0x7f18d80cf630 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f18dcc00640 1 -- 172.21.15.106:0/2773781870 >> 172.21.15.106:0/2773781870 conn(0x7f18d80d2c60 msgr2=0x7f18d80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f18dcc00640 1 -- 172.21.15.106:0/2773781870 shutdown_connections 2024-04-26T21:16:43.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f01e7e00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f01c80683b0 0x7f01c806a870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f01e00ad000 tx=0x7f01e00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.379+0000 7f18dcc00640 1 -- 172.21.15.106:0/2773781870 wait complete. 2024-04-26T21:16:43.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7f18dcc00640 1 Processor -- start 2024-04-26T21:16:43.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1a6a00640 1 -- 172.21.15.106:0/348411918 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1940ab620 con 0x7fc1a815d060 2024-04-26T21:16:43.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7f18dcc00640 1 -- start start 2024-04-26T21:16:43.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1a6a00640 1 -- 172.21.15.106:0/348411918 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1940b0070 con 0x7fc1a815d060 2024-04-26T21:16:43.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1a6a00640 1 -- 172.21.15.106:0/348411918 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1940ab9e0 con 0x7fc1a815d060 2024-04-26T21:16:43.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1aee00640 1 -- 172.21.15.106:0/348411918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 msgr2=0x7fc1a80cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1aee00640 1 --2- 172.21.15.106:0/348411918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 0x7fc1a80cf630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1940097c0 tx=0x7fc19401c420 comp rx=0 tx=0).stop 2024-04-26T21:16:43.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1aee00640 1 -- 172.21.15.106:0/348411918 shutdown_connections 2024-04-26T21:16:43.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1aee00640 1 --2- 172.21.15.106:0/348411918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 0x7fc1a80cf630 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1aee00640 1 -- 172.21.15.106:0/348411918 >> 172.21.15.106:0/348411918 conn(0x7fc1a80d2c60 msgr2=0x7fc1a80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7f01e4c00640 1 -- 172.21.15.106:0/289424595 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f01d4056300 con 0x7f01e80d1500 2024-04-26T21:16:43.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1aee00640 1 -- 172.21.15.106:0/348411918 shutdown_connections 2024-04-26T21:16:43.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7fc1aee00640 1 -- 172.21.15.106:0/348411918 wait complete. 2024-04-26T21:16:43.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7f18dcc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d80b3a40 0x7f18d8152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7f18dcc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d80cfb70 0x7f18d80c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7f18dcc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18d815d060 0x7f18d80b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7f18dcc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f18d8169d80 con 0x7f18d80b3a40 2024-04-26T21:16:43.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7f18dcc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18d8169c00 con 0x7f18d80cfb70 2024-04-26T21:16:43.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.383+0000 7f18dcc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f18d8169f00 con 0x7f18d815d060 2024-04-26T21:16:43.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7f18d5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d80b3a40 0x7f18d8152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7f18d5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d80b3a40 0x7f18d8152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41278/0 (socket says 172.21.15.106:41278) 2024-04-26T21:16:43.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7f18d5e00640 1 -- 172.21.15.106:0/2772088962 learned_addr learned my addr 172.21.15.106:0/2772088962 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7f18d5e00640 1 -- 172.21.15.106:0/2772088962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18d815d060 msgr2=0x7f18d80b09b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:16:43.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7f18d5e00640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18d815d060 0x7f18d80b09b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7f18d5e00640 1 -- 172.21.15.106:0/2772088962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d80cfb70 msgr2=0x7f18d80c8ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:16:43.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7f18d5e00640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d80cfb70 0x7f18d80c8ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7f18d5e00640 1 -- 172.21.15.106:0/2772088962 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d815e7f0 con 0x7f18d80b3a40 2024-04-26T21:16:43.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7f18d5e00640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d80b3a40 0x7f18d8152c10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18c801ab30 tx=0x7f18c8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1aee00640 1 Processor -- start 2024-04-26T21:16:43.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1aee00640 1 -- start start 2024-04-26T21:16:43.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1aee00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1a80b3a40 0x7fc1a8157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1aee00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1a80cfb70 0x7fc1a80b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1aee00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 0x7fc1a80b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1a7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1a80b3a40 0x7fc1a8157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1a7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1a80b3a40 0x7fc1a8157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41294/0 (socket says 172.21.15.106:41294) 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1ace00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 0x7fc1a80b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80ce400 con 0x7fc1a80b3a40 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80ce280 con 0x7fc1a815d060 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1a7e00640 1 -- 172.21.15.106:0/4248807119 learned_addr learned my addr 172.21.15.106:0/4248807119 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1a7400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1a80cfb70 0x7fc1a80b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.387+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a80d1650 con 0x7fc1a80cfb70 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc1ace00640 1 -- 172.21.15.106:0/4248807119 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1a80cfb70 msgr2=0x7fc1a80b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc1ace00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1a80cfb70 0x7fc1a80b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc1ace00640 1 -- 172.21.15.106:0/4248807119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1a80b3a40 msgr2=0x7fc1a8157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc1ace00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1a80b3a40 0x7fc1a8157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc1ace00640 1 -- 172.21.15.106:0/4248807119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a81563b0 con 0x7fc1a815d060 2024-04-26T21:16:43.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7f18ce000640 1 -- 172.21.15.106:0/2772088962 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80b9070 con 0x7f18d80b3a40 2024-04-26T21:16:43.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7f18ce000640 1 -- 172.21.15.106:0/2772088962 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c80b5410 con 0x7f18d80b3a40 2024-04-26T21:16:43.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7f18ce000640 1 -- 172.21.15.106:0/2772088962 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80b1040 con 0x7f18d80b3a40 2024-04-26T21:16:43.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc1ace00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 0x7fc1a80b0540 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1a002de10 tx=0x7fc1a002df00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d815ead0 con 0x7f18d80b3a40 2024-04-26T21:16:43.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc19fe00640 1 -- 172.21.15.106:0/4248807119 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0033710 con 0x7fc1a815d060 2024-04-26T21:16:43.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc19fe00640 1 -- 172.21.15.106:0/4248807119 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a00338d0 con 0x7fc1a815d060 2024-04-26T21:16:43.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d8153150 con 0x7f18d80b3a40 2024-04-26T21:16:43.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a8156650 con 0x7fc1a815d060 2024-04-26T21:16:43.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc19fe00640 1 -- 172.21.15.106:0/4248807119 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0033cc0 con 0x7fc1a815d060 2024-04-26T21:16:43.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.391+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a8156c10 con 0x7fc1a815d060 2024-04-26T21:16:43.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.395+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1800052a0 con 0x7fc1a815d060 2024-04-26T21:16:43.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.395+0000 7f18ce000640 1 -- 172.21.15.106:0/2772088962 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18c80bc070 con 0x7f18d80b3a40 2024-04-26T21:16:43.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.395+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d8069400 con 0x7f18d80b3a40 2024-04-26T21:16:43.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.395+0000 7fc19fe00640 1 -- 172.21.15.106:0/4248807119 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc1a003e400 con 0x7fc1a815d060 2024-04-26T21:16:43.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.399+0000 7f18ce000640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18b80683b0 0x7f18b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.399+0000 7f18d5400640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18b80683b0 0x7f18b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.399+0000 7fc19fe00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc188068380 0x7fc18806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.399+0000 7fc19fe00640 1 -- 172.21.15.106:0/4248807119 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc1a00a9a10 con 0x7fc1a815d060 2024-04-26T21:16:43.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.399+0000 7f18d5400640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18b80683b0 0x7f18b806a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18d806db10 tx=0x7f18c40079e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.399+0000 7f18ce000640 1 -- 172.21.15.106:0/2772088962 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f18c8120730 con 0x7f18d80b3a40 2024-04-26T21:16:43.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.399+0000 7fc1a7e00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc188068380 0x7fc18806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.403+0000 7fc1a7e00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc188068380 0x7fc18806a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc1940097c0 tx=0x7fc1940a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.403+0000 7fc19fe00640 1 -- 172.21.15.106:0/4248807119 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc1a0079c80 con 0x7fc1a815d060 2024-04-26T21:16:43.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.411+0000 7f18ce000640 1 -- 172.21.15.106:0/2772088962 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f18c80a9070 con 0x7f18d80b3a40 2024-04-26T21:16:43.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.607+0000 7f9b09800640 1 -- 172.21.15.106:0/1941996224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9adc005860 con 0x7f9b040b3c20 2024-04-26T21:16:43.610 INFO:teuthology.orchestra.run.smithi106.stdout:55834574858 2024-04-26T21:16:43.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.667+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb400005860 con 0x7fb428072270 2024-04-26T21:16:43.672 INFO:teuthology.orchestra.run.smithi106.stdout:64424509450 2024-04-26T21:16:43.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.671+0000 7fe268c00640 1 -- 172.21.15.106:0/2900791949 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe2740d1790 con 0x7fe2740b5700 2024-04-26T21:16:43.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.671+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f60e4141ef0 con 0x7f60e4141420 2024-04-26T21:16:43.675 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:43.675 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:43.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.607+0000 7f9afaa00640 1 -- 172.21.15.106:0/1941996224 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9afc05aca0 con 0x7f9b040b3c20 2024-04-26T21:16:43.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 -- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ae40683b0 msgr2=0x7f9ae406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ae40683b0 0x7f9ae406a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9af40ae000 tx=0x7f9af40a7000 comp rx=0 tx=0).stop 2024-04-26T21:16:43.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.671+0000 7fb41ea00640 1 -- 172.21.15.106:0/1499005633 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb418102690 con 0x7fb428072270 2024-04-26T21:16:43.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.671+0000 7fe26b400640 1 -- 172.21.15.106:0/2900791949 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe25c0f4e20 con 0x7fe2740b5700 2024-04-26T21:16:43.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 -- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b040b3c20 msgr2=0x7f9b0416a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b040b3c20 0x7f9b0416a920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00be20 tx=0x7f9afc00bf10 comp rx=0 tx=0).stop 2024-04-26T21:16:43.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 -- 172.21.15.106:0/1941996224 shutdown_connections 2024-04-26T21:16:43.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b04073b60 0x7f9b041644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9ae40683b0 0x7f9ae406a870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b040b3c20 0x7f9b0416a920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 --2- 172.21.15.106:0/1941996224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9b0406f4c0 0x7f9b04163700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 -- 172.21.15.106:0/1941996224 >> 172.21.15.106:0/1941996224 conn(0x7f9b040b26c0 msgr2=0x7f9b040b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 -- 172.21.15.106:0/1941996224 shutdown_connections 2024-04-26T21:16:43.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.611+0000 7f9aefe00640 1 -- 172.21.15.106:0/1941996224 wait complete. 2024-04-26T21:16:43.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.671+0000 7f60db400640 1 -- 172.21.15.106:0/1224881360 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f60cc021020 con 0x7f60e4141420 2024-04-26T21:16:43.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb408068450 msgr2=0x7fb40806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb408068450 0x7fb40806a910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4280acde0 tx=0x7fb414008040 comp rx=0 tx=0).stop 2024-04-26T21:16:43.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb428072270 msgr2=0x7fb428147ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb428072270 0x7fb428147ce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb4180bf040 tx=0x7fb41802a230 comp rx=0 tx=0).stop 2024-04-26T21:16:43.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 shutdown_connections 2024-04-26T21:16:43.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4280b3f00 0x7fb4280ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb408068450 0x7fb40806a910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb42814cc80 0x7fb4281f3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 --2- 172.21.15.106:0/1499005633 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb428072270 0x7fb428147ce0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 >> 172.21.15.106:0/1499005633 conn(0x7fb4280b26c0 msgr2=0x7fb4280b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc180005590 con 0x7fc1a815d060 2024-04-26T21:16:43.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fc19fe00640 1 -- 172.21.15.106:0/4248807119 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc1a0079580 con 0x7fc1a815d060 2024-04-26T21:16:43.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 shutdown_connections 2024-04-26T21:16:43.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fb42ca00640 1 -- 172.21.15.106:0/1499005633 wait complete. 2024-04-26T21:16:43.681 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:43.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f60c0068450 msgr2=0x7f60c006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7f60e3e00640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f60c0068450 0x7f60c006a910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f60d4003f50 tx=0x7f60d40091b0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e4141420 msgr2=0x7f60e415a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7f60e3e00640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e4141420 0x7f60e415a660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00a770 tx=0x7f60cc00ac30 comp rx=0 tx=0).stop 2024-04-26T21:16:43.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fe268c00640 1 -- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2500683d0 msgr2=0x7fe25006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fe268c00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2500683d0 0x7fe25006a890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009cb0 tx=0x7fe26c009060 comp rx=0 tx=0).stop 2024-04-26T21:16:43.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fe268c00640 1 -- 172.21.15.106:0/2900791949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2740b5700 msgr2=0x7fe27415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.675+0000 7fe268c00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2740b5700 0x7fe27415aab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe27408d3e0 tx=0x7fe25c019280 comp rx=0 tx=0).stop 2024-04-26T21:16:43.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 shutdown_connections 2024-04-26T21:16:43.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7f60e3e00640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60e4141420 0x7f60e415a660 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7f60e3e00640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f60c0068450 0x7f60c006a910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7f60e3e00640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e4144270 0x7f60e41ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7f60e3e00640 1 --2- 172.21.15.106:0/1224881360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60e40b4210 0x7f60e4168880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 >> 172.21.15.106:0/1224881360 conn(0x7f60e40b26c0 msgr2=0x7f60e413a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 shutdown_connections 2024-04-26T21:16:43.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7f60e3e00640 1 -- 172.21.15.106:0/1224881360 wait complete. 2024-04-26T21:16:43.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fe268c00640 1 -- 172.21.15.106:0/2900791949 shutdown_connections 2024-04-26T21:16:43.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fe268c00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740b3de0 0x7fe2740cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fe268c00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2500683d0 0x7fe25006a890 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fe268c00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2740b5700 0x7fe27415aab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fe268c00640 1 --2- 172.21.15.106:0/2900791949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2740b5020 0x7fe2741520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fe268c00640 1 -- 172.21.15.106:0/2900791949 >> 172.21.15.106:0/2900791949 conn(0x7fe2740d4c00 msgr2=0x7fe2740c90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fe268c00640 1 -- 172.21.15.106:0/2900791949 shutdown_connections 2024-04-26T21:16:43.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fe268c00640 1 -- 172.21.15.106:0/2900791949 wait complete. 2024-04-26T21:16:43.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc188068380 msgr2=0x7fc18806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc188068380 0x7fc18806a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc1940097c0 tx=0x7fc1940a7000 comp rx=0 tx=0).stop 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 msgr2=0x7fc1a80b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 0x7fc1a80b0540 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1a002de10 tx=0x7fc1a002df00 comp rx=0 tx=0).stop 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 shutdown_connections 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815d060 0x7fc1a80b0540 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc188068380 0x7fc18806a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc1a80cfb70 0x7fc1a80b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 --2- 172.21.15.106:0/4248807119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc1a80b3a40 0x7fc1a8157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 >> 172.21.15.106:0/4248807119 conn(0x7fc1a80d2c60 msgr2=0x7fc1a80712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 shutdown_connections 2024-04-26T21:16:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.679+0000 7fc1aee00640 1 -- 172.21.15.106:0/4248807119 wait complete. 2024-04-26T21:16:43.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.691+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2dec0b3550 con 0x7f2dec0b3c80 2024-04-26T21:16:43.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.695+0000 7f2de2000640 1 -- 172.21.15.106:0/2967326440 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ddc056b00 con 0x7f2dec0b3c80 2024-04-26T21:16:43.701 INFO:teuthology.orchestra.run.smithi106.stdout:64424509448 2024-04-26T21:16:43.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2dcc068380 msgr2=0x7f2dcc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2dcc068380 0x7f2dcc06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80af000 tx=0x7f2dd8008040 comp rx=0 tx=0).stop 2024-04-26T21:16:43.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dec0b3c80 msgr2=0x7f2dec1583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dec0b3c80 0x7f2dec1583b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e8c0 tx=0x7f2ddc00ed80 comp rx=0 tx=0).stop 2024-04-26T21:16:43.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 shutdown_connections 2024-04-26T21:16:43.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2dcc068380 0x7f2dcc06a840 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80af000 tx=0x7f2dd8008040 comp rx=0 tx=0).stop 2024-04-26T21:16:43.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2dec146b70 0x7f2dec141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dec1464d0 0x7f2dec1415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 --2- 172.21.15.106:0/2967326440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dec0b3c80 0x7f2dec1583b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 >> 172.21.15.106:0/2967326440 conn(0x7f2dec068340 msgr2=0x7f2dec166fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 shutdown_connections 2024-04-26T21:16:43.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.699+0000 7f2df0a00640 1 -- 172.21.15.106:0/2967326440 wait complete. 2024-04-26T21:16:43.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-04-26T21:16:43.717 DEBUG:teuthology.parallel:result is None 2024-04-26T21:16:43.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-04-26T21:16:43.723 DEBUG:teuthology.parallel:result is None 2024-04-26T21:16:43.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-04-26T21:16:43.724 DEBUG:teuthology.parallel:result is None 2024-04-26T21:16:43.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-04-26T21:16:43.726 DEBUG:teuthology.parallel:result is None 2024-04-26T21:16:43.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-04-26T21:16:43.727 DEBUG:teuthology.parallel:result is None 2024-04-26T21:16:43.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.723+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f01e8074020 con 0x7f01e80d1500 2024-04-26T21:16:43.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.723+0000 7f01e4c00640 1 -- 172.21.15.106:0/289424595 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f01d4055c00 con 0x7f01e80d1500 2024-04-26T21:16:43.728 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:43.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f01c80683b0 msgr2=0x7f01c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f01c80683b0 0x7f01c806a870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f01e00ad000 tx=0x7f01e00a6000 comp rx=0 tx=0).stop 2024-04-26T21:16:43.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 msgr2=0x7f01e815c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 0x7f01e815c660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01d4001210 tx=0x7f01d400cb90 comp rx=0 tx=0).stop 2024-04-26T21:16:43.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 shutdown_connections 2024-04-26T21:16:43.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f01c80683b0 0x7f01c806a870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e8146b70 0x7f01e815cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01e81464d0 0x7f01e813ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 --2- 172.21.15.106:0/289424595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e80d1500 0x7f01e815c660 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 >> 172.21.15.106:0/289424595 conn(0x7f01e8068340 msgr2=0x7f01e806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 shutdown_connections 2024-04-26T21:16:43.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.727+0000 7f01efc00640 1 -- 172.21.15.106:0/289424595 wait complete. 2024-04-26T21:16:43.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-04-26T21:16:43.732 DEBUG:teuthology.parallel:result is None 2024-04-26T21:16:43.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f18d8069d20 con 0x7f18d80b3a40 2024-04-26T21:16:43.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18ce000640 1 -- 172.21.15.106:0/2772088962 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18c8016070 con 0x7f18d80b3a40 2024-04-26T21:16:43.742 INFO:teuthology.orchestra.run.smithi106.stdout:64424509449 2024-04-26T21:16:43.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18b80683b0 msgr2=0x7f18b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18b80683b0 0x7f18b806a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18d806db10 tx=0x7f18c40079e0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d80b3a40 msgr2=0x7f18d8152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d80b3a40 0x7f18d8152c10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18c801ab30 tx=0x7f18c8019220 comp rx=0 tx=0).stop 2024-04-26T21:16:43.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 shutdown_connections 2024-04-26T21:16:43.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18d80cfb70 0x7f18d80c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18b80683b0 0x7f18b806a870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18d815d060 0x7f18d80b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 --2- 172.21.15.106:0/2772088962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18d80b3a40 0x7f18d8152c10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 >> 172.21.15.106:0/2772088962 conn(0x7f18d80d2c60 msgr2=0x7f18d80d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 shutdown_connections 2024-04-26T21:16:43.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.739+0000 7f18dcc00640 1 -- 172.21.15.106:0/2772088962 wait complete. 2024-04-26T21:16:43.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2024-04-26T21:16:43.751 DEBUG:teuthology.parallel:result is None 2024-04-26T21:16:43.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-04-26T21:16:43.764 DEBUG:teuthology.parallel:result is None 2024-04-26T21:16:43.764 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T21:16:43.764 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:16:43.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dfe00640 1 Processor -- start 2024-04-26T21:16:43.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dfe00640 1 -- start start 2024-04-26T21:16:43.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dfe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98d8160ac0 0x7f98d815df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dfe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f98d8146870 0x7f98d80d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dfe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d80b3da0 con 0x7f98d8146490 2024-04-26T21:16:43.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dfe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f98d8160fa0 con 0x7f98d8146870 2024-04-26T21:16:43.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dfe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f98d8161280 con 0x7f98d8160ac0 2024-04-26T21:16:43.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dde00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f98d8146870 0x7f98d80d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dde00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f98d8146870 0x7f98d80d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41298/0 (socket says 172.21.15.106:41298) 2024-04-26T21:16:43.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dde00640 1 -- 172.21.15.106:0/538331438 learned_addr learned my addr 172.21.15.106:0/538331438 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dca00640 1 --2- 172.21.15.106:0/538331438 >> v2:172.21.15.112:3300/0 conn(0x7f98d8160ac0 0x7f98d815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dde00640 1 -- 172.21.15.106:0/538331438 >> v2:172.21.15.112:3300/0 conn(0x7f98d8160ac0 msgr2=0x7f98d815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dde00640 1 --2- 172.21.15.106:0/538331438 >> v2:172.21.15.112:3300/0 conn(0x7f98d8160ac0 0x7f98d815df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.935+0000 7f98dde00640 1 -- 172.21.15.106:0/538331438 >> v1:172.21.15.112:6789/0 conn(0x7f98d8146490 legacy=0x7f98d80cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:43.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dde00640 1 -- 172.21.15.106:0/538331438 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d8161560 con 0x7f98d8146870 2024-04-26T21:16:43.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dca00640 1 --2- 172.21.15.106:0/538331438 >> v2:172.21.15.112:3300/0 conn(0x7f98d8160ac0 0x7f98d815df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:43.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dde00640 1 --2- 172.21.15.106:0/538331438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8146870 0x7f98d80d0da0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98d815d4d0 tx=0x7f98d001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e94cf01fcf44ac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98d7e00640 1 -- 172.21.15.106:0/538331438 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00a5650 con 0x7f98d8146870 2024-04-26T21:16:43.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98d7e00640 1 -- 172.21.15.106:0/538331438 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d00a57f0 con 0x7f98d8146870 2024-04-26T21:16:43.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98d7e00640 1 -- 172.21.15.106:0/538331438 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00a5bc0 con 0x7f98d8146870 2024-04-26T21:16:43.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dfe00640 1 -- 172.21.15.106:0/538331438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8146870 msgr2=0x7f98d80d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dfe00640 1 --2- 172.21.15.106:0/538331438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8146870 0x7f98d80d0da0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98d815d4d0 tx=0x7f98d001c990 comp rx=0 tx=0).stop 2024-04-26T21:16:43.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dfe00640 1 -- 172.21.15.106:0/538331438 shutdown_connections 2024-04-26T21:16:43.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dfe00640 1 --2- 172.21.15.106:0/538331438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8146870 0x7f98d80d0da0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dfe00640 1 --2- 172.21.15.106:0/538331438 >> v2:172.21.15.112:3300/0 conn(0x7f98d8160ac0 0x7f98d815df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dfe00640 1 -- 172.21.15.106:0/538331438 >> 172.21.15.106:0/538331438 conn(0x7f98d8068340 msgr2=0x7f98d8068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:43.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dfe00640 1 -- 172.21.15.106:0/538331438 shutdown_connections 2024-04-26T21:16:43.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.939+0000 7f98dfe00640 1 -- 172.21.15.106:0/538331438 wait complete. 2024-04-26T21:16:43.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dfe00640 1 Processor -- start 2024-04-26T21:16:43.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dfe00640 1 -- start start 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dfe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d8146490 0x7f98d8151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dfe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98d8146870 0x7f98d8154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8160ac0 0x7f98d80cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dfe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f98d80b5150 con 0x7f98d8160ac0 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dfe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98d80b4fd0 con 0x7f98d8146490 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dfe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f98d8169e60 con 0x7f98d8146870 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8160ac0 0x7f98d80cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8160ac0 0x7f98d80cf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41308/0 (socket says 172.21.15.106:41308) 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dde00640 1 -- 172.21.15.106:0/3988430444 learned_addr learned my addr 172.21.15.106:0/3988430444 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dd400640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d8146490 0x7f98d8151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dca00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98d8146870 0x7f98d8154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dde00640 1 -- 172.21.15.106:0/3988430444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98d8146870 msgr2=0x7f98d8154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dde00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98d8146870 0x7f98d8154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dde00640 1 -- 172.21.15.106:0/3988430444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d8146490 msgr2=0x7f98d8151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:43.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dde00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d8146490 0x7f98d8151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:43.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dde00640 1 -- 172.21.15.106:0/3988430444 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d81604e0 con 0x7f98d8160ac0 2024-04-26T21:16:43.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.943+0000 7f98dde00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8160ac0 0x7f98d80cf6e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98d001a5c0 tx=0x7f98d0019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98d5600640 1 -- 172.21.15.106:0/3988430444 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00b8470 con 0x7f98d8160ac0 2024-04-26T21:16:43.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98d5600640 1 -- 172.21.15.106:0/3988430444 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d00b8630 con 0x7f98d8160ac0 2024-04-26T21:16:43.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d8154ce0 con 0x7f98d8160ac0 2024-04-26T21:16:43.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98d5600640 1 -- 172.21.15.106:0/3988430444 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d00b8a20 con 0x7f98d8160ac0 2024-04-26T21:16:43.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d8157100 con 0x7f98d8160ac0 2024-04-26T21:16:43.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d8069400 con 0x7f98d8160ac0 2024-04-26T21:16:43.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98d5600640 1 -- 172.21.15.106:0/3988430444 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98d00c0020 con 0x7f98d8160ac0 2024-04-26T21:16:43.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98d5600640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98b8068380 0x7f98b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:43.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98d5600640 1 -- 172.21.15.106:0/3988430444 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f98d01219c0 con 0x7f98d8160ac0 2024-04-26T21:16:43.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98dd400640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98b8068380 0x7f98b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:43.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.947+0000 7f98dd400640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98b8068380 0x7f98b806a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f98cc007fd0 tx=0x7f98cc007e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:43.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:43.951+0000 7f98d5600640 1 -- 172.21.15.106:0/3988430444 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f98d0016580 con 0x7f98d8160ac0 2024-04-26T21:16:44.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.107+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f98d8073d70 con 0x7f98b8068380 2024-04-26T21:16:44.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.115+0000 7f98d5600640 1 -- 172.21.15.106:0/3988430444 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7f98d8073d70 con 0x7f98b8068380 2024-04-26T21:16:44.122 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:44.124 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:16:44.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98b8068380 msgr2=0x7f98b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98b8068380 0x7f98b806a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f98cc007fd0 tx=0x7f98cc007e40 comp rx=0 tx=0).stop 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8160ac0 msgr2=0x7f98d80cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8160ac0 0x7f98d80cf6e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98d001a5c0 tx=0x7f98d0019730 comp rx=0 tx=0).stop 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 shutdown_connections 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98b8068380 0x7f98b806a840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98d8160ac0 0x7f98d80cf6e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98d8146870 0x7f98d8154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 --2- 172.21.15.106:0/3988430444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98d8146490 0x7f98d8151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 >> 172.21.15.106:0/3988430444 conn(0x7f98d8068340 msgr2=0x7f98d813df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 shutdown_connections 2024-04-26T21:16:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.119+0000 7f98dfe00640 1 -- 172.21.15.106:0/3988430444 wait complete. 2024-04-26T21:16:44.143 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-26T21:16:42.294881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219604,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755116,"statfs":{"total":773094113280,"available":772869238784,"internally_reserved":0,"allocated":3514368,"data_stored":2074472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002794"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817484+0000","last_change":"2024-04-26T21:16:19.412305+0000","last_active":"2024-04-26T21:16:25.817484+0000","last_peered":"2024-04-26T21:16:25.817484+0000","last_clean":"2024-04-26T21:16:25.817484+0000","last_became_active":"2024-04-26T21:16:19.411559+0000","last_became_peered":"2024-04-26T21:16:19.411559+0000","last_unstale":"2024-04-26T21:16:25.817484+0000","last_undegraded":"2024-04-26T21:16:25.817484+0000","last_fullsized":"2024-04-26T21:16:25.817484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:31.811132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815514+0000","last_change":"2024-04-26T21:16:20.411882+0000","last_active":"2024-04-26T21:16:25.815514+0000","last_peered":"2024-04-26T21:16:25.815514+0000","last_clean":"2024-04-26T21:16:25.815514+0000","last_became_active":"2024-04-26T21:16:20.411587+0000","last_became_peered":"2024-04-26T21:16:20.411587+0000","last_unstale":"2024-04-26T21:16:25.815514+0000","last_undegraded":"2024-04-26T21:16:25.815514+0000","last_fullsized":"2024-04-26T21:16:25.815514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814423+0000","last_change":"2024-04-26T21:16:24.448323+0000","last_active":"2024-04-26T21:16:25.814423+0000","last_peered":"2024-04-26T21:16:25.814423+0000","last_clean":"2024-04-26T21:16:25.814423+0000","last_became_active":"2024-04-26T21:16:24.447718+0000","last_became_peered":"2024-04-26T21:16:24.447718+0000","last_unstale":"2024-04-26T21:16:25.814423+0000","last_undegraded":"2024-04-26T21:16:25.814423+0000","last_fullsized":"2024-04-26T21:16:25.814423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:58.709336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815628+0000","last_change":"2024-04-26T21:16:19.413460+0000","last_active":"2024-04-26T21:16:25.815628+0000","last_peered":"2024-04-26T21:16:25.815628+0000","last_clean":"2024-04-26T21:16:25.815628+0000","last_became_active":"2024-04-26T21:16:19.413146+0000","last_became_peered":"2024-04-26T21:16:19.413146+0000","last_unstale":"2024-04-26T21:16:25.815628+0000","last_undegraded":"2024-04-26T21:16:25.815628+0000","last_fullsized":"2024-04-26T21:16:25.815628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817398+0000","last_change":"2024-04-26T21:16:20.424236+0000","last_active":"2024-04-26T21:16:25.817398+0000","last_peered":"2024-04-26T21:16:25.817398+0000","last_clean":"2024-04-26T21:16:25.817398+0000","last_became_active":"2024-04-26T21:16:20.423996+0000","last_became_peered":"2024-04-26T21:16:20.423996+0000","last_unstale":"2024-04-26T21:16:25.817398+0000","last_undegraded":"2024-04-26T21:16:25.817398+0000","last_fullsized":"2024-04-26T21:16:25.817398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434335+0000","last_change":"2024-04-26T21:16:24.463491+0000","last_active":"2024-04-26T21:16:25.434335+0000","last_peered":"2024-04-26T21:16:25.434335+0000","last_clean":"2024-04-26T21:16:25.434335+0000","last_became_active":"2024-04-26T21:16:24.463053+0000","last_became_peered":"2024-04-26T21:16:24.463053+0000","last_unstale":"2024-04-26T21:16:25.434335+0000","last_undegraded":"2024-04-26T21:16:25.434335+0000","last_fullsized":"2024-04-26T21:16:25.434335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:29.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436569+0000","last_change":"2024-04-26T21:16:19.411595+0000","last_active":"2024-04-26T21:16:25.436569+0000","last_peered":"2024-04-26T21:16:25.436569+0000","last_clean":"2024-04-26T21:16:25.436569+0000","last_became_active":"2024-04-26T21:16:19.411220+0000","last_became_peered":"2024-04-26T21:16:19.411220+0000","last_unstale":"2024-04-26T21:16:25.436569+0000","last_undegraded":"2024-04-26T21:16:25.436569+0000","last_fullsized":"2024-04-26T21:16:25.436569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816434+0000","last_change":"2024-04-26T21:16:20.426594+0000","last_active":"2024-04-26T21:16:25.816434+0000","last_peered":"2024-04-26T21:16:25.816434+0000","last_clean":"2024-04-26T21:16:25.816434+0000","last_became_active":"2024-04-26T21:16:20.426300+0000","last_became_peered":"2024-04-26T21:16:20.426300+0000","last_unstale":"2024-04-26T21:16:25.816434+0000","last_undegraded":"2024-04-26T21:16:25.816434+0000","last_fullsized":"2024-04-26T21:16:25.816434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435135+0000","last_change":"2024-04-26T21:16:24.461980+0000","last_active":"2024-04-26T21:16:25.435135+0000","last_peered":"2024-04-26T21:16:25.435135+0000","last_clean":"2024-04-26T21:16:25.435135+0000","last_became_active":"2024-04-26T21:16:24.461244+0000","last_became_peered":"2024-04-26T21:16:24.461244+0000","last_unstale":"2024-04-26T21:16:25.435135+0000","last_undegraded":"2024-04-26T21:16:25.435135+0000","last_fullsized":"2024-04-26T21:16:25.435135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:49.007056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436320+0000","last_change":"2024-04-26T21:16:19.413076+0000","last_active":"2024-04-26T21:16:25.436320+0000","last_peered":"2024-04-26T21:16:25.436320+0000","last_clean":"2024-04-26T21:16:25.436320+0000","last_became_active":"2024-04-26T21:16:19.412710+0000","last_became_peered":"2024-04-26T21:16:19.412710+0000","last_unstale":"2024-04-26T21:16:25.436320+0000","last_undegraded":"2024-04-26T21:16:25.436320+0000","last_fullsized":"2024-04-26T21:16:25.436320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:56.575835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816409+0000","last_change":"2024-04-26T21:16:20.421335+0000","last_active":"2024-04-26T21:16:25.816409+0000","last_peered":"2024-04-26T21:16:25.816409+0000","last_clean":"2024-04-26T21:16:25.816409+0000","last_became_active":"2024-04-26T21:16:20.420893+0000","last_became_peered":"2024-04-26T21:16:20.420893+0000","last_unstale":"2024-04-26T21:16:25.816409+0000","last_undegraded":"2024-04-26T21:16:25.816409+0000","last_fullsized":"2024-04-26T21:16:25.816409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:09.604970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434983+0000","last_change":"2024-04-26T21:16:24.457306+0000","last_active":"2024-04-26T21:16:25.434983+0000","last_peered":"2024-04-26T21:16:25.434983+0000","last_clean":"2024-04-26T21:16:25.434983+0000","last_became_active":"2024-04-26T21:16:24.456786+0000","last_became_peered":"2024-04-26T21:16:24.456786+0000","last_unstale":"2024-04-26T21:16:25.434983+0000","last_undegraded":"2024-04-26T21:16:25.434983+0000","last_fullsized":"2024-04-26T21:16:25.434983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:07.354698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433876+0000","last_change":"2024-04-26T21:16:20.407919+0000","last_active":"2024-04-26T21:16:25.433876+0000","last_peered":"2024-04-26T21:16:25.433876+0000","last_clean":"2024-04-26T21:16:25.433876+0000","last_became_active":"2024-04-26T21:16:20.405803+0000","last_became_peered":"2024-04-26T21:16:20.405803+0000","last_unstale":"2024-04-26T21:16:25.433876+0000","last_undegraded":"2024-04-26T21:16:25.433876+0000","last_fullsized":"2024-04-26T21:16:25.433876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436225+0000","last_change":"2024-04-26T21:16:19.408886+0000","last_active":"2024-04-26T21:16:25.436225+0000","last_peered":"2024-04-26T21:16:25.436225+0000","last_clean":"2024-04-26T21:16:25.436225+0000","last_became_active":"2024-04-26T21:16:19.408563+0000","last_became_peered":"2024-04-26T21:16:19.408563+0000","last_unstale":"2024-04-26T21:16:25.436225+0000","last_undegraded":"2024-04-26T21:16:25.436225+0000","last_fullsized":"2024-04-26T21:16:25.436225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436044+0000","last_change":"2024-04-26T21:16:24.463322+0000","last_active":"2024-04-26T21:16:25.436044+0000","last_peered":"2024-04-26T21:16:25.436044+0000","last_clean":"2024-04-26T21:16:25.436044+0000","last_became_active":"2024-04-26T21:16:24.462885+0000","last_became_peered":"2024-04-26T21:16:24.462885+0000","last_unstale":"2024-04-26T21:16:25.436044+0000","last_undegraded":"2024-04-26T21:16:25.436044+0000","last_fullsized":"2024-04-26T21:16:25.436044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814971+0000","last_change":"2024-04-26T21:16:20.417586+0000","last_active":"2024-04-26T21:16:25.814971+0000","last_peered":"2024-04-26T21:16:25.814971+0000","last_clean":"2024-04-26T21:16:25.814971+0000","last_became_active":"2024-04-26T21:16:20.417195+0000","last_became_peered":"2024-04-26T21:16:20.417195+0000","last_unstale":"2024-04-26T21:16:25.814971+0000","last_undegraded":"2024-04-26T21:16:25.814971+0000","last_fullsized":"2024-04-26T21:16:25.814971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801200+0000","last_change":"2024-04-26T21:16:19.402526+0000","last_active":"2024-04-26T21:16:25.801200+0000","last_peered":"2024-04-26T21:16:25.801200+0000","last_clean":"2024-04-26T21:16:25.801200+0000","last_became_active":"2024-04-26T21:16:19.399544+0000","last_became_peered":"2024-04-26T21:16:19.399544+0000","last_unstale":"2024-04-26T21:16:25.801200+0000","last_undegraded":"2024-04-26T21:16:25.801200+0000","last_fullsized":"2024-04-26T21:16:25.801200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434800+0000","last_change":"2024-04-26T21:16:24.462467+0000","last_active":"2024-04-26T21:16:25.434800+0000","last_peered":"2024-04-26T21:16:25.434800+0000","last_clean":"2024-04-26T21:16:25.434800+0000","last_became_active":"2024-04-26T21:16:24.461966+0000","last_became_peered":"2024-04-26T21:16:24.461966+0000","last_unstale":"2024-04-26T21:16:25.434800+0000","last_undegraded":"2024-04-26T21:16:25.434800+0000","last_fullsized":"2024-04-26T21:16:25.434800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:44.228248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814368+0000","last_change":"2024-04-26T21:16:20.404811+0000","last_active":"2024-04-26T21:16:25.814368+0000","last_peered":"2024-04-26T21:16:25.814368+0000","last_clean":"2024-04-26T21:16:25.814368+0000","last_became_active":"2024-04-26T21:16:20.403360+0000","last_became_peered":"2024-04-26T21:16:20.403360+0000","last_unstale":"2024-04-26T21:16:25.814368+0000","last_undegraded":"2024-04-26T21:16:25.814368+0000","last_fullsized":"2024-04-26T21:16:25.814368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800884+0000","last_change":"2024-04-26T21:16:19.400626+0000","last_active":"2024-04-26T21:16:25.800884+0000","last_peered":"2024-04-26T21:16:25.800884+0000","last_clean":"2024-04-26T21:16:25.800884+0000","last_became_active":"2024-04-26T21:16:19.400194+0000","last_became_peered":"2024-04-26T21:16:19.400194+0000","last_unstale":"2024-04-26T21:16:25.800884+0000","last_undegraded":"2024-04-26T21:16:25.800884+0000","last_fullsized":"2024-04-26T21:16:25.800884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801658+0000","last_change":"2024-04-26T21:16:24.461234+0000","last_active":"2024-04-26T21:16:25.801658+0000","last_peered":"2024-04-26T21:16:25.801658+0000","last_clean":"2024-04-26T21:16:25.801658+0000","last_became_active":"2024-04-26T21:16:24.460911+0000","last_became_peered":"2024-04-26T21:16:24.460911+0000","last_unstale":"2024-04-26T21:16:25.801658+0000","last_undegraded":"2024-04-26T21:16:25.801658+0000","last_fullsized":"2024-04-26T21:16:25.801658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:45.803476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434606+0000","last_change":"2024-04-26T21:16:20.418241+0000","last_active":"2024-04-26T21:16:25.434606+0000","last_peered":"2024-04-26T21:16:25.434606+0000","last_clean":"2024-04-26T21:16:25.434606+0000","last_became_active":"2024-04-26T21:16:20.417710+0000","last_became_peered":"2024-04-26T21:16:20.417710+0000","last_unstale":"2024-04-26T21:16:25.434606+0000","last_undegraded":"2024-04-26T21:16:25.434606+0000","last_fullsized":"2024-04-26T21:16:25.434606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:46.750974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435669+0000","last_change":"2024-04-26T21:16:19.417003+0000","last_active":"2024-04-26T21:16:25.435669+0000","last_peered":"2024-04-26T21:16:25.435669+0000","last_clean":"2024-04-26T21:16:25.435669+0000","last_became_active":"2024-04-26T21:16:19.416648+0000","last_became_peered":"2024-04-26T21:16:19.416648+0000","last_unstale":"2024-04-26T21:16:25.435669+0000","last_undegraded":"2024-04-26T21:16:25.435669+0000","last_fullsized":"2024-04-26T21:16:25.435669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434863+0000","last_change":"2024-04-26T21:16:24.462876+0000","last_active":"2024-04-26T21:16:25.434863+0000","last_peered":"2024-04-26T21:16:25.434863+0000","last_clean":"2024-04-26T21:16:25.434863+0000","last_became_active":"2024-04-26T21:16:24.462460+0000","last_became_peered":"2024-04-26T21:16:24.462460+0000","last_unstale":"2024-04-26T21:16:25.434863+0000","last_undegraded":"2024-04-26T21:16:25.434863+0000","last_fullsized":"2024-04-26T21:16:25.434863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:21.311855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817334+0000","last_change":"2024-04-26T21:16:20.408076+0000","last_active":"2024-04-26T21:16:25.817334+0000","last_peered":"2024-04-26T21:16:25.817334+0000","last_clean":"2024-04-26T21:16:25.817334+0000","last_became_active":"2024-04-26T21:16:20.407656+0000","last_became_peered":"2024-04-26T21:16:20.407656+0000","last_unstale":"2024-04-26T21:16:25.817334+0000","last_undegraded":"2024-04-26T21:16:25.817334+0000","last_fullsized":"2024-04-26T21:16:25.817334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435249+0000","last_change":"2024-04-26T21:16:19.411480+0000","last_active":"2024-04-26T21:16:25.435249+0000","last_peered":"2024-04-26T21:16:25.435249+0000","last_clean":"2024-04-26T21:16:25.435249+0000","last_became_active":"2024-04-26T21:16:19.410829+0000","last_became_peered":"2024-04-26T21:16:19.410829+0000","last_unstale":"2024-04-26T21:16:25.435249+0000","last_undegraded":"2024-04-26T21:16:25.435249+0000","last_fullsized":"2024-04-26T21:16:25.435249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434466+0000","last_change":"2024-04-26T21:16:24.456850+0000","last_active":"2024-04-26T21:16:25.434466+0000","last_peered":"2024-04-26T21:16:25.434466+0000","last_clean":"2024-04-26T21:16:25.434466+0000","last_became_active":"2024-04-26T21:16:24.456404+0000","last_became_peered":"2024-04-26T21:16:24.456404+0000","last_unstale":"2024-04-26T21:16:25.434466+0000","last_undegraded":"2024-04-26T21:16:25.434466+0000","last_fullsized":"2024-04-26T21:16:25.434466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:35.587426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815768+0000","last_change":"2024-04-26T21:16:20.427731+0000","last_active":"2024-04-26T21:16:25.815768+0000","last_peered":"2024-04-26T21:16:25.815768+0000","last_clean":"2024-04-26T21:16:25.815768+0000","last_became_active":"2024-04-26T21:16:20.427425+0000","last_became_peered":"2024-04-26T21:16:20.427425+0000","last_unstale":"2024-04-26T21:16:25.815768+0000","last_undegraded":"2024-04-26T21:16:25.815768+0000","last_fullsized":"2024-04-26T21:16:25.815768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801527+0000","last_change":"2024-04-26T21:16:19.406450+0000","last_active":"2024-04-26T21:16:25.801527+0000","last_peered":"2024-04-26T21:16:25.801527+0000","last_clean":"2024-04-26T21:16:25.801527+0000","last_became_active":"2024-04-26T21:16:19.405911+0000","last_became_peered":"2024-04-26T21:16:19.405911+0000","last_unstale":"2024-04-26T21:16:25.801527+0000","last_undegraded":"2024-04-26T21:16:25.801527+0000","last_fullsized":"2024-04-26T21:16:25.801527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814203+0000","last_change":"2024-04-26T21:16:24.458420+0000","last_active":"2024-04-26T21:16:25.814203+0000","last_peered":"2024-04-26T21:16:25.814203+0000","last_clean":"2024-04-26T21:16:25.814203+0000","last_became_active":"2024-04-26T21:16:24.458033+0000","last_became_peered":"2024-04-26T21:16:24.458033+0000","last_unstale":"2024-04-26T21:16:25.814203+0000","last_undegraded":"2024-04-26T21:16:25.814203+0000","last_fullsized":"2024-04-26T21:16:25.814203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:45.881928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801205+0000","last_change":"2024-04-26T21:16:20.410112+0000","last_active":"2024-04-26T21:16:25.801205+0000","last_peered":"2024-04-26T21:16:25.801205+0000","last_clean":"2024-04-26T21:16:25.801205+0000","last_became_active":"2024-04-26T21:16:20.406760+0000","last_became_peered":"2024-04-26T21:16:20.406760+0000","last_unstale":"2024-04-26T21:16:25.801205+0000","last_undegraded":"2024-04-26T21:16:25.801205+0000","last_fullsized":"2024-04-26T21:16:25.801205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436719+0000","last_change":"2024-04-26T21:16:19.415298+0000","last_active":"2024-04-26T21:16:25.436719+0000","last_peered":"2024-04-26T21:16:25.436719+0000","last_clean":"2024-04-26T21:16:25.436719+0000","last_became_active":"2024-04-26T21:16:19.414712+0000","last_became_peered":"2024-04-26T21:16:19.414712+0000","last_unstale":"2024-04-26T21:16:25.436719+0000","last_undegraded":"2024-04-26T21:16:25.436719+0000","last_fullsized":"2024-04-26T21:16:25.436719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:38.445207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816864+0000","last_change":"2024-04-26T21:16:24.454307+0000","last_active":"2024-04-26T21:16:25.816864+0000","last_peered":"2024-04-26T21:16:25.816864+0000","last_clean":"2024-04-26T21:16:25.816864+0000","last_became_active":"2024-04-26T21:16:24.453880+0000","last_became_peered":"2024-04-26T21:16:24.453880+0000","last_unstale":"2024-04-26T21:16:25.816864+0000","last_undegraded":"2024-04-26T21:16:25.816864+0000","last_fullsized":"2024-04-26T21:16:25.816864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:02.451831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816509+0000","last_change":"2024-04-26T21:16:20.421987+0000","last_active":"2024-04-26T21:16:25.816509+0000","last_peered":"2024-04-26T21:16:25.816509+0000","last_clean":"2024-04-26T21:16:25.816509+0000","last_became_active":"2024-04-26T21:16:20.421708+0000","last_became_peered":"2024-04-26T21:16:20.421708+0000","last_unstale":"2024-04-26T21:16:25.816509+0000","last_undegraded":"2024-04-26T21:16:25.816509+0000","last_fullsized":"2024-04-26T21:16:25.816509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:03.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801261+0000","last_change":"2024-04-26T21:16:19.411246+0000","last_active":"2024-04-26T21:16:25.801261+0000","last_peered":"2024-04-26T21:16:25.801261+0000","last_clean":"2024-04-26T21:16:25.801261+0000","last_became_active":"2024-04-26T21:16:19.410899+0000","last_became_peered":"2024-04-26T21:16:19.410899+0000","last_unstale":"2024-04-26T21:16:25.801261+0000","last_undegraded":"2024-04-26T21:16:25.801261+0000","last_fullsized":"2024-04-26T21:16:25.801261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:38.445207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800985+0000","last_change":"2024-04-26T21:16:24.460849+0000","last_active":"2024-04-26T21:16:25.800985+0000","last_peered":"2024-04-26T21:16:25.800985+0000","last_clean":"2024-04-26T21:16:25.800985+0000","last_became_active":"2024-04-26T21:16:24.460317+0000","last_became_peered":"2024-04-26T21:16:24.460317+0000","last_unstale":"2024-04-26T21:16:25.800985+0000","last_undegraded":"2024-04-26T21:16:25.800985+0000","last_fullsized":"2024-04-26T21:16:25.800985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435239+0000","last_change":"2024-04-26T21:16:20.418564+0000","last_active":"2024-04-26T21:16:25.435239+0000","last_peered":"2024-04-26T21:16:25.435239+0000","last_clean":"2024-04-26T21:16:25.435239+0000","last_became_active":"2024-04-26T21:16:20.417882+0000","last_became_peered":"2024-04-26T21:16:20.417882+0000","last_unstale":"2024-04-26T21:16:25.435239+0000","last_undegraded":"2024-04-26T21:16:25.435239+0000","last_fullsized":"2024-04-26T21:16:25.435239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:40.649173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816239+0000","last_change":"2024-04-26T21:16:19.399034+0000","last_active":"2024-04-26T21:16:25.816239+0000","last_peered":"2024-04-26T21:16:25.816239+0000","last_clean":"2024-04-26T21:16:25.816239+0000","last_became_active":"2024-04-26T21:16:19.398765+0000","last_became_peered":"2024-04-26T21:16:19.398765+0000","last_unstale":"2024-04-26T21:16:25.816239+0000","last_undegraded":"2024-04-26T21:16:25.816239+0000","last_fullsized":"2024-04-26T21:16:25.816239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801228+0000","last_change":"2024-04-26T21:16:24.458228+0000","last_active":"2024-04-26T21:16:25.801228+0000","last_peered":"2024-04-26T21:16:25.801228+0000","last_clean":"2024-04-26T21:16:25.801228+0000","last_became_active":"2024-04-26T21:16:24.457891+0000","last_became_peered":"2024-04-26T21:16:24.457891+0000","last_unstale":"2024-04-26T21:16:25.801228+0000","last_undegraded":"2024-04-26T21:16:25.801228+0000","last_fullsized":"2024-04-26T21:16:25.801228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:02.451831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800959+0000","last_change":"2024-04-26T21:16:20.403928+0000","last_active":"2024-04-26T21:16:25.800959+0000","last_peered":"2024-04-26T21:16:25.800959+0000","last_clean":"2024-04-26T21:16:25.800959+0000","last_became_active":"2024-04-26T21:16:20.403679+0000","last_became_peered":"2024-04-26T21:16:20.403679+0000","last_unstale":"2024-04-26T21:16:25.800959+0000","last_undegraded":"2024-04-26T21:16:25.800959+0000","last_fullsized":"2024-04-26T21:16:25.800959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814353+0000","last_change":"2024-04-26T21:16:19.401004+0000","last_active":"2024-04-26T21:16:25.814353+0000","last_peered":"2024-04-26T21:16:25.814353+0000","last_clean":"2024-04-26T21:16:25.814353+0000","last_became_active":"2024-04-26T21:16:19.400735+0000","last_became_peered":"2024-04-26T21:16:19.400735+0000","last_unstale":"2024-04-26T21:16:25.814353+0000","last_undegraded":"2024-04-26T21:16:25.814353+0000","last_fullsized":"2024-04-26T21:16:25.814353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:10.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801692+0000","last_change":"2024-04-26T21:16:24.455241+0000","last_active":"2024-04-26T21:16:25.801692+0000","last_peered":"2024-04-26T21:16:25.801692+0000","last_clean":"2024-04-26T21:16:25.801692+0000","last_became_active":"2024-04-26T21:16:24.454846+0000","last_became_peered":"2024-04-26T21:16:24.454846+0000","last_unstale":"2024-04-26T21:16:25.801692+0000","last_undegraded":"2024-04-26T21:16:25.801692+0000","last_fullsized":"2024-04-26T21:16:25.801692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:31.330251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816525+0000","last_change":"2024-04-26T21:16:20.410135+0000","last_active":"2024-04-26T21:16:25.816525+0000","last_peered":"2024-04-26T21:16:25.816525+0000","last_clean":"2024-04-26T21:16:25.816525+0000","last_became_active":"2024-04-26T21:16:20.409798+0000","last_became_peered":"2024-04-26T21:16:20.409798+0000","last_unstale":"2024-04-26T21:16:25.816525+0000","last_undegraded":"2024-04-26T21:16:25.816525+0000","last_fullsized":"2024-04-26T21:16:25.816525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:11.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435791+0000","last_change":"2024-04-26T21:16:19.412309+0000","last_active":"2024-04-26T21:16:25.435791+0000","last_peered":"2024-04-26T21:16:25.435791+0000","last_clean":"2024-04-26T21:16:25.435791+0000","last_became_active":"2024-04-26T21:16:19.412073+0000","last_became_peered":"2024-04-26T21:16:19.412073+0000","last_unstale":"2024-04-26T21:16:25.435791+0000","last_undegraded":"2024-04-26T21:16:25.435791+0000","last_fullsized":"2024-04-26T21:16:25.435791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817236+0000","last_change":"2024-04-26T21:16:24.458176+0000","last_active":"2024-04-26T21:16:25.817236+0000","last_peered":"2024-04-26T21:16:25.817236+0000","last_clean":"2024-04-26T21:16:25.817236+0000","last_became_active":"2024-04-26T21:16:24.457774+0000","last_became_peered":"2024-04-26T21:16:24.457774+0000","last_unstale":"2024-04-26T21:16:25.817236+0000","last_undegraded":"2024-04-26T21:16:25.817236+0000","last_fullsized":"2024-04-26T21:16:25.817236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:45.881928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814481+0000","last_change":"2024-04-26T21:16:20.425327+0000","last_active":"2024-04-26T21:16:25.814481+0000","last_peered":"2024-04-26T21:16:25.814481+0000","last_clean":"2024-04-26T21:16:25.814481+0000","last_became_active":"2024-04-26T21:16:20.425071+0000","last_became_peered":"2024-04-26T21:16:20.425071+0000","last_unstale":"2024-04-26T21:16:25.814481+0000","last_undegraded":"2024-04-26T21:16:25.814481+0000","last_fullsized":"2024-04-26T21:16:25.814481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816253+0000","last_change":"2024-04-26T21:16:19.408668+0000","last_active":"2024-04-26T21:16:25.816253+0000","last_peered":"2024-04-26T21:16:25.816253+0000","last_clean":"2024-04-26T21:16:25.816253+0000","last_became_active":"2024-04-26T21:16:19.408363+0000","last_became_peered":"2024-04-26T21:16:19.408363+0000","last_unstale":"2024-04-26T21:16:25.816253+0000","last_undegraded":"2024-04-26T21:16:25.816253+0000","last_fullsized":"2024-04-26T21:16:25.816253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435906+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:16:25.435906+0000","last_peered":"2024-04-26T21:16:25.435906+0000","last_clean":"2024-04-26T21:16:25.435906+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:16:25.435906+0000","last_undegraded":"2024-04-26T21:16:25.435906+0000","last_fullsized":"2024-04-26T21:16:25.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434338+0000","last_change":"2024-04-26T21:16:24.452049+0000","last_active":"2024-04-26T21:16:25.434338+0000","last_peered":"2024-04-26T21:16:25.434338+0000","last_clean":"2024-04-26T21:16:25.434338+0000","last_became_active":"2024-04-26T21:16:24.451479+0000","last_became_peered":"2024-04-26T21:16:24.451479+0000","last_unstale":"2024-04-26T21:16:25.434338+0000","last_undegraded":"2024-04-26T21:16:25.434338+0000","last_fullsized":"2024-04-26T21:16:25.434338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:49.007056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436447+0000","last_change":"2024-04-26T21:16:20.425471+0000","last_active":"2024-04-26T21:16:25.436447+0000","last_peered":"2024-04-26T21:16:25.436447+0000","last_clean":"2024-04-26T21:16:25.436447+0000","last_became_active":"2024-04-26T21:16:20.425139+0000","last_became_peered":"2024-04-26T21:16:20.425139+0000","last_unstale":"2024-04-26T21:16:25.436447+0000","last_undegraded":"2024-04-26T21:16:25.436447+0000","last_fullsized":"2024-04-26T21:16:25.436447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:44.971333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815036+0000","last_change":"2024-04-26T21:16:19.405872+0000","last_active":"2024-04-26T21:16:25.815036+0000","last_peered":"2024-04-26T21:16:25.815036+0000","last_clean":"2024-04-26T21:16:25.815036+0000","last_became_active":"2024-04-26T21:16:19.405574+0000","last_became_peered":"2024-04-26T21:16:19.405574+0000","last_unstale":"2024-04-26T21:16:25.815036+0000","last_undegraded":"2024-04-26T21:16:25.815036+0000","last_fullsized":"2024-04-26T21:16:25.815036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:11.405759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433802+0000","last_change":"2024-04-26T21:16:24.452916+0000","last_active":"2024-04-26T21:16:25.433802+0000","last_peered":"2024-04-26T21:16:25.433802+0000","last_clean":"2024-04-26T21:16:25.433802+0000","last_became_active":"2024-04-26T21:16:24.452500+0000","last_became_peered":"2024-04-26T21:16:24.452500+0000","last_unstale":"2024-04-26T21:16:25.433802+0000","last_undegraded":"2024-04-26T21:16:25.433802+0000","last_fullsized":"2024-04-26T21:16:25.433802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:07.354698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816437+0000","last_change":"2024-04-26T21:16:20.434192+0000","last_active":"2024-04-26T21:16:25.816437+0000","last_peered":"2024-04-26T21:16:25.816437+0000","last_clean":"2024-04-26T21:16:25.816437+0000","last_became_active":"2024-04-26T21:16:20.433657+0000","last_became_peered":"2024-04-26T21:16:20.433657+0000","last_unstale":"2024-04-26T21:16:25.816437+0000","last_undegraded":"2024-04-26T21:16:25.816437+0000","last_fullsized":"2024-04-26T21:16:25.816437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:54.005276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801434+0000","last_change":"2024-04-26T21:16:19.403457+0000","last_active":"2024-04-26T21:16:25.801434+0000","last_peered":"2024-04-26T21:16:25.801434+0000","last_clean":"2024-04-26T21:16:25.801434+0000","last_became_active":"2024-04-26T21:16:19.402886+0000","last_became_peered":"2024-04-26T21:16:19.402886+0000","last_unstale":"2024-04-26T21:16:25.801434+0000","last_undegraded":"2024-04-26T21:16:25.801434+0000","last_fullsized":"2024-04-26T21:16:25.801434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816954+0000","last_change":"2024-04-26T21:16:24.454078+0000","last_active":"2024-04-26T21:16:25.816954+0000","last_peered":"2024-04-26T21:16:25.816954+0000","last_clean":"2024-04-26T21:16:25.816954+0000","last_became_active":"2024-04-26T21:16:24.453726+0000","last_became_peered":"2024-04-26T21:16:24.453726+0000","last_unstale":"2024-04-26T21:16:25.816954+0000","last_undegraded":"2024-04-26T21:16:25.816954+0000","last_fullsized":"2024-04-26T21:16:25.816954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:45.803476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436898+0000","last_change":"2024-04-26T21:16:20.415657+0000","last_active":"2024-04-26T21:16:25.436898+0000","last_peered":"2024-04-26T21:16:25.436898+0000","last_clean":"2024-04-26T21:16:25.436898+0000","last_became_active":"2024-04-26T21:16:20.415241+0000","last_became_peered":"2024-04-26T21:16:20.415241+0000","last_unstale":"2024-04-26T21:16:25.436898+0000","last_undegraded":"2024-04-26T21:16:25.436898+0000","last_fullsized":"2024-04-26T21:16:25.436898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:27.294527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815326+0000","last_change":"2024-04-26T21:16:19.398067+0000","last_active":"2024-04-26T21:16:25.815326+0000","last_peered":"2024-04-26T21:16:25.815326+0000","last_clean":"2024-04-26T21:16:25.815326+0000","last_became_active":"2024-04-26T21:16:19.397685+0000","last_became_peered":"2024-04-26T21:16:19.397685+0000","last_unstale":"2024-04-26T21:16:25.815326+0000","last_undegraded":"2024-04-26T21:16:25.815326+0000","last_fullsized":"2024-04-26T21:16:25.815326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:38.089679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815875+0000","last_change":"2024-04-26T21:16:24.450492+0000","last_active":"2024-04-26T21:16:25.815875+0000","last_peered":"2024-04-26T21:16:25.815875+0000","last_clean":"2024-04-26T21:16:25.815875+0000","last_became_active":"2024-04-26T21:16:24.450086+0000","last_became_peered":"2024-04-26T21:16:24.450086+0000","last_unstale":"2024-04-26T21:16:25.815875+0000","last_undegraded":"2024-04-26T21:16:25.815875+0000","last_fullsized":"2024-04-26T21:16:25.815875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436736+0000","last_change":"2024-04-26T21:16:20.422919+0000","last_active":"2024-04-26T21:16:25.436736+0000","last_peered":"2024-04-26T21:16:25.436736+0000","last_clean":"2024-04-26T21:16:25.436736+0000","last_became_active":"2024-04-26T21:16:20.422606+0000","last_became_peered":"2024-04-26T21:16:20.422606+0000","last_unstale":"2024-04-26T21:16:25.436736+0000","last_undegraded":"2024-04-26T21:16:25.436736+0000","last_fullsized":"2024-04-26T21:16:25.436736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:54.005276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434221+0000","last_change":"2024-04-26T21:16:19.409935+0000","last_active":"2024-04-26T21:16:25.434221+0000","last_peered":"2024-04-26T21:16:25.434221+0000","last_clean":"2024-04-26T21:16:25.434221+0000","last_became_active":"2024-04-26T21:16:19.409636+0000","last_became_peered":"2024-04-26T21:16:19.409636+0000","last_unstale":"2024-04-26T21:16:25.434221+0000","last_undegraded":"2024-04-26T21:16:25.434221+0000","last_fullsized":"2024-04-26T21:16:25.434221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:24.652333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434240+0000","last_change":"2024-04-26T21:16:24.462022+0000","last_active":"2024-04-26T21:16:25.434240+0000","last_peered":"2024-04-26T21:16:25.434240+0000","last_clean":"2024-04-26T21:16:25.434240+0000","last_became_active":"2024-04-26T21:16:24.461691+0000","last_became_peered":"2024-04-26T21:16:24.461691+0000","last_unstale":"2024-04-26T21:16:25.434240+0000","last_undegraded":"2024-04-26T21:16:25.434240+0000","last_fullsized":"2024-04-26T21:16:25.434240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:35.967648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435773+0000","last_change":"2024-04-26T21:16:20.406585+0000","last_active":"2024-04-26T21:16:25.435773+0000","last_peered":"2024-04-26T21:16:25.435773+0000","last_clean":"2024-04-26T21:16:25.435773+0000","last_became_active":"2024-04-26T21:16:20.406265+0000","last_became_peered":"2024-04-26T21:16:20.406265+0000","last_unstale":"2024-04-26T21:16:25.435773+0000","last_undegraded":"2024-04-26T21:16:25.435773+0000","last_fullsized":"2024-04-26T21:16:25.435773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814382+0000","last_change":"2024-04-26T21:16:19.395551+0000","last_active":"2024-04-26T21:16:25.814382+0000","last_peered":"2024-04-26T21:16:25.814382+0000","last_clean":"2024-04-26T21:16:25.814382+0000","last_became_active":"2024-04-26T21:16:19.393831+0000","last_became_peered":"2024-04-26T21:16:19.393831+0000","last_unstale":"2024-04-26T21:16:25.814382+0000","last_undegraded":"2024-04-26T21:16:25.814382+0000","last_fullsized":"2024-04-26T21:16:25.814382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:53.258420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817267+0000","last_change":"2024-04-26T21:16:24.452943+0000","last_active":"2024-04-26T21:16:25.817267+0000","last_peered":"2024-04-26T21:16:25.817267+0000","last_clean":"2024-04-26T21:16:25.817267+0000","last_became_active":"2024-04-26T21:16:24.452603+0000","last_became_peered":"2024-04-26T21:16:24.452603+0000","last_unstale":"2024-04-26T21:16:25.817267+0000","last_undegraded":"2024-04-26T21:16:25.817267+0000","last_fullsized":"2024-04-26T21:16:25.817267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433930+0000","last_change":"2024-04-26T21:16:20.410601+0000","last_active":"2024-04-26T21:16:25.433930+0000","last_peered":"2024-04-26T21:16:25.433930+0000","last_clean":"2024-04-26T21:16:25.433930+0000","last_became_active":"2024-04-26T21:16:20.410197+0000","last_became_peered":"2024-04-26T21:16:20.410197+0000","last_unstale":"2024-04-26T21:16:25.433930+0000","last_undegraded":"2024-04-26T21:16:25.433930+0000","last_fullsized":"2024-04-26T21:16:25.433930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433955+0000","last_change":"2024-04-26T21:16:19.413099+0000","last_active":"2024-04-26T21:16:25.433955+0000","last_peered":"2024-04-26T21:16:25.433955+0000","last_clean":"2024-04-26T21:16:25.433955+0000","last_became_active":"2024-04-26T21:16:19.412695+0000","last_became_peered":"2024-04-26T21:16:19.412695+0000","last_unstale":"2024-04-26T21:16:25.433955+0000","last_undegraded":"2024-04-26T21:16:25.433955+0000","last_fullsized":"2024-04-26T21:16:25.433955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815773+0000","last_change":"2024-04-26T21:16:24.446231+0000","last_active":"2024-04-26T21:16:25.815773+0000","last_peered":"2024-04-26T21:16:25.815773+0000","last_clean":"2024-04-26T21:16:25.815773+0000","last_became_active":"2024-04-26T21:16:24.445743+0000","last_became_peered":"2024-04-26T21:16:24.445743+0000","last_unstale":"2024-04-26T21:16:25.815773+0000","last_undegraded":"2024-04-26T21:16:25.815773+0000","last_fullsized":"2024-04-26T21:16:25.815773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:27.238080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436166+0000","last_change":"2024-04-26T21:16:20.423076+0000","last_active":"2024-04-26T21:16:25.436166+0000","last_peered":"2024-04-26T21:16:25.436166+0000","last_clean":"2024-04-26T21:16:25.436166+0000","last_became_active":"2024-04-26T21:16:20.422476+0000","last_became_peered":"2024-04-26T21:16:20.422476+0000","last_unstale":"2024-04-26T21:16:25.436166+0000","last_undegraded":"2024-04-26T21:16:25.436166+0000","last_fullsized":"2024-04-26T21:16:25.436166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816169+0000","last_change":"2024-04-26T21:16:19.406614+0000","last_active":"2024-04-26T21:16:25.816169+0000","last_peered":"2024-04-26T21:16:25.816169+0000","last_clean":"2024-04-26T21:16:25.816169+0000","last_became_active":"2024-04-26T21:16:19.403274+0000","last_became_peered":"2024-04-26T21:16:19.403274+0000","last_unstale":"2024-04-26T21:16:25.816169+0000","last_undegraded":"2024-04-26T21:16:25.816169+0000","last_fullsized":"2024-04-26T21:16:25.816169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815305+0000","last_change":"2024-04-26T21:16:24.451820+0000","last_active":"2024-04-26T21:16:25.815305+0000","last_peered":"2024-04-26T21:16:25.815305+0000","last_clean":"2024-04-26T21:16:25.815305+0000","last_became_active":"2024-04-26T21:16:24.451472+0000","last_became_peered":"2024-04-26T21:16:24.451472+0000","last_unstale":"2024-04-26T21:16:25.815305+0000","last_undegraded":"2024-04-26T21:16:25.815305+0000","last_fullsized":"2024-04-26T21:16:25.815305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:09.977865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816825+0000","last_change":"2024-04-26T21:16:20.425068+0000","last_active":"2024-04-26T21:16:25.816825+0000","last_peered":"2024-04-26T21:16:25.816825+0000","last_clean":"2024-04-26T21:16:25.816825+0000","last_became_active":"2024-04-26T21:16:20.424773+0000","last_became_peered":"2024-04-26T21:16:20.424773+0000","last_unstale":"2024-04-26T21:16:25.816825+0000","last_undegraded":"2024-04-26T21:16:25.816825+0000","last_fullsized":"2024-04-26T21:16:25.816825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817008+0000","last_change":"2024-04-26T21:16:19.413580+0000","last_active":"2024-04-26T21:16:25.817008+0000","last_peered":"2024-04-26T21:16:25.817008+0000","last_clean":"2024-04-26T21:16:25.817008+0000","last_became_active":"2024-04-26T21:16:19.412636+0000","last_became_peered":"2024-04-26T21:16:19.412636+0000","last_unstale":"2024-04-26T21:16:25.817008+0000","last_undegraded":"2024-04-26T21:16:25.817008+0000","last_fullsized":"2024-04-26T21:16:25.817008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:06.128835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816582+0000","last_change":"2024-04-26T21:16:24.456301+0000","last_active":"2024-04-26T21:16:25.816582+0000","last_peered":"2024-04-26T21:16:25.816582+0000","last_clean":"2024-04-26T21:16:25.816582+0000","last_became_active":"2024-04-26T21:16:24.455115+0000","last_became_peered":"2024-04-26T21:16:24.455115+0000","last_unstale":"2024-04-26T21:16:25.816582+0000","last_undegraded":"2024-04-26T21:16:25.816582+0000","last_fullsized":"2024-04-26T21:16:25.816582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:58.709336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436405+0000","last_change":"2024-04-26T21:16:20.404787+0000","last_active":"2024-04-26T21:16:25.436405+0000","last_peered":"2024-04-26T21:16:25.436405+0000","last_clean":"2024-04-26T21:16:25.436405+0000","last_became_active":"2024-04-26T21:16:20.404355+0000","last_became_peered":"2024-04-26T21:16:20.404355+0000","last_unstale":"2024-04-26T21:16:25.436405+0000","last_undegraded":"2024-04-26T21:16:25.436405+0000","last_fullsized":"2024-04-26T21:16:25.436405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:03.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:35.742110+0000","last_change":"2024-04-26T21:16:19.407394+0000","last_active":"2024-04-26T21:16:35.742110+0000","last_peered":"2024-04-26T21:16:35.742110+0000","last_clean":"2024-04-26T21:16:35.742110+0000","last_became_active":"2024-04-26T21:16:19.407056+0000","last_became_peered":"2024-04-26T21:16:19.407056+0000","last_unstale":"2024-04-26T21:16:35.742110+0000","last_undegraded":"2024-04-26T21:16:35.742110+0000","last_fullsized":"2024-04-26T21:16:35.742110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801146+0000","last_change":"2024-04-26T21:16:24.460241+0000","last_active":"2024-04-26T21:16:25.801146+0000","last_peered":"2024-04-26T21:16:25.801146+0000","last_clean":"2024-04-26T21:16:25.801146+0000","last_became_active":"2024-04-26T21:16:24.459738+0000","last_became_peered":"2024-04-26T21:16:24.459738+0000","last_unstale":"2024-04-26T21:16:25.801146+0000","last_undegraded":"2024-04-26T21:16:25.801146+0000","last_fullsized":"2024-04-26T21:16:25.801146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:13.640693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434981+0000","last_change":"2024-04-26T21:16:20.430119+0000","last_active":"2024-04-26T21:16:25.434981+0000","last_peered":"2024-04-26T21:16:25.434981+0000","last_clean":"2024-04-26T21:16:25.434981+0000","last_became_active":"2024-04-26T21:16:20.429573+0000","last_became_peered":"2024-04-26T21:16:20.429573+0000","last_unstale":"2024-04-26T21:16:25.434981+0000","last_undegraded":"2024-04-26T21:16:25.434981+0000","last_fullsized":"2024-04-26T21:16:25.434981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:39.450737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801403+0000","last_change":"2024-04-26T21:16:19.405677+0000","last_active":"2024-04-26T21:16:25.801403+0000","last_peered":"2024-04-26T21:16:25.801403+0000","last_clean":"2024-04-26T21:16:25.801403+0000","last_became_active":"2024-04-26T21:16:19.405168+0000","last_became_peered":"2024-04-26T21:16:19.405168+0000","last_unstale":"2024-04-26T21:16:25.801403+0000","last_undegraded":"2024-04-26T21:16:25.801403+0000","last_fullsized":"2024-04-26T21:16:25.801403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434637+0000","last_change":"2024-04-26T21:16:24.462415+0000","last_active":"2024-04-26T21:16:25.434637+0000","last_peered":"2024-04-26T21:16:25.434637+0000","last_clean":"2024-04-26T21:16:25.434637+0000","last_became_active":"2024-04-26T21:16:24.462047+0000","last_became_peered":"2024-04-26T21:16:24.462047+0000","last_unstale":"2024-04-26T21:16:25.434637+0000","last_undegraded":"2024-04-26T21:16:25.434637+0000","last_fullsized":"2024-04-26T21:16:25.434637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:50.269287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817452+0000","last_change":"2024-04-26T21:16:20.423947+0000","last_active":"2024-04-26T21:16:25.817452+0000","last_peered":"2024-04-26T21:16:25.817452+0000","last_clean":"2024-04-26T21:16:25.817452+0000","last_became_active":"2024-04-26T21:16:20.423647+0000","last_became_peered":"2024-04-26T21:16:20.423647+0000","last_unstale":"2024-04-26T21:16:25.817452+0000","last_undegraded":"2024-04-26T21:16:25.817452+0000","last_fullsized":"2024-04-26T21:16:25.817452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816645+0000","last_change":"2024-04-26T21:16:19.403292+0000","last_active":"2024-04-26T21:16:25.816645+0000","last_peered":"2024-04-26T21:16:25.816645+0000","last_clean":"2024-04-26T21:16:25.816645+0000","last_became_active":"2024-04-26T21:16:19.402784+0000","last_became_peered":"2024-04-26T21:16:19.402784+0000","last_unstale":"2024-04-26T21:16:25.816645+0000","last_undegraded":"2024-04-26T21:16:25.816645+0000","last_fullsized":"2024-04-26T21:16:25.816645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814330+0000","last_change":"2024-04-26T21:16:24.456302+0000","last_active":"2024-04-26T21:16:25.814330+0000","last_peered":"2024-04-26T21:16:25.814330+0000","last_clean":"2024-04-26T21:16:25.814330+0000","last_became_active":"2024-04-26T21:16:24.456017+0000","last_became_peered":"2024-04-26T21:16:24.456017+0000","last_unstale":"2024-04-26T21:16:25.814330+0000","last_undegraded":"2024-04-26T21:16:25.814330+0000","last_fullsized":"2024-04-26T21:16:25.814330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816540+0000","last_change":"2024-04-26T21:16:20.425747+0000","last_active":"2024-04-26T21:16:25.816540+0000","last_peered":"2024-04-26T21:16:25.816540+0000","last_clean":"2024-04-26T21:16:25.816540+0000","last_became_active":"2024-04-26T21:16:20.425488+0000","last_became_peered":"2024-04-26T21:16:20.425488+0000","last_unstale":"2024-04-26T21:16:25.816540+0000","last_undegraded":"2024-04-26T21:16:25.816540+0000","last_fullsized":"2024-04-26T21:16:25.816540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:44.971333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435140+0000","last_change":"2024-04-26T21:16:19.406087+0000","last_active":"2024-04-26T21:16:25.435140+0000","last_peered":"2024-04-26T21:16:25.435140+0000","last_clean":"2024-04-26T21:16:25.435140+0000","last_became_active":"2024-04-26T21:16:19.405864+0000","last_became_peered":"2024-04-26T21:16:19.405864+0000","last_unstale":"2024-04-26T21:16:25.435140+0000","last_undegraded":"2024-04-26T21:16:25.435140+0000","last_fullsized":"2024-04-26T21:16:25.435140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814623+0000","last_change":"2024-04-26T21:16:24.448037+0000","last_active":"2024-04-26T21:16:25.814623+0000","last_peered":"2024-04-26T21:16:25.814623+0000","last_clean":"2024-04-26T21:16:25.814623+0000","last_became_active":"2024-04-26T21:16:24.447296+0000","last_became_peered":"2024-04-26T21:16:24.447296+0000","last_unstale":"2024-04-26T21:16:25.814623+0000","last_undegraded":"2024-04-26T21:16:25.814623+0000","last_fullsized":"2024-04-26T21:16:25.814623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:07.159212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817154+0000","last_change":"2024-04-26T21:16:24.459333+0000","last_active":"2024-04-26T21:16:25.817154+0000","last_peered":"2024-04-26T21:16:25.817154+0000","last_clean":"2024-04-26T21:16:25.817154+0000","last_became_active":"2024-04-26T21:16:24.458880+0000","last_became_peered":"2024-04-26T21:16:24.458880+0000","last_unstale":"2024-04-26T21:16:25.817154+0000","last_undegraded":"2024-04-26T21:16:25.817154+0000","last_fullsized":"2024-04-26T21:16:25.817154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:31.330251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800771+0000","last_change":"2024-04-26T21:16:20.403324+0000","last_active":"2024-04-26T21:16:25.800771+0000","last_peered":"2024-04-26T21:16:25.800771+0000","last_clean":"2024-04-26T21:16:25.800771+0000","last_became_active":"2024-04-26T21:16:20.403028+0000","last_became_peered":"2024-04-26T21:16:20.403028+0000","last_unstale":"2024-04-26T21:16:25.800771+0000","last_undegraded":"2024-04-26T21:16:25.800771+0000","last_fullsized":"2024-04-26T21:16:25.800771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816007+0000","last_change":"2024-04-26T21:16:19.399594+0000","last_active":"2024-04-26T21:16:25.816007+0000","last_peered":"2024-04-26T21:16:25.816007+0000","last_clean":"2024-04-26T21:16:25.816007+0000","last_became_active":"2024-04-26T21:16:19.399283+0000","last_became_peered":"2024-04-26T21:16:19.399283+0000","last_unstale":"2024-04-26T21:16:25.816007+0000","last_undegraded":"2024-04-26T21:16:25.816007+0000","last_fullsized":"2024-04-26T21:16:25.816007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435033+0000","last_change":"2024-04-26T21:16:24.452081+0000","last_active":"2024-04-26T21:16:25.435033+0000","last_peered":"2024-04-26T21:16:25.435033+0000","last_clean":"2024-04-26T21:16:25.435033+0000","last_became_active":"2024-04-26T21:16:24.451654+0000","last_became_peered":"2024-04-26T21:16:24.451654+0000","last_unstale":"2024-04-26T21:16:25.435033+0000","last_undegraded":"2024-04-26T21:16:25.435033+0000","last_fullsized":"2024-04-26T21:16:25.435033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814302+0000","last_change":"2024-04-26T21:16:20.412643+0000","last_active":"2024-04-26T21:16:25.814302+0000","last_peered":"2024-04-26T21:16:25.814302+0000","last_clean":"2024-04-26T21:16:25.814302+0000","last_became_active":"2024-04-26T21:16:20.412229+0000","last_became_peered":"2024-04-26T21:16:20.412229+0000","last_unstale":"2024-04-26T21:16:25.814302+0000","last_undegraded":"2024-04-26T21:16:25.814302+0000","last_fullsized":"2024-04-26T21:16:25.814302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814684+0000","last_change":"2024-04-26T21:16:19.404756+0000","last_active":"2024-04-26T21:16:25.814684+0000","last_peered":"2024-04-26T21:16:25.814684+0000","last_clean":"2024-04-26T21:16:25.814684+0000","last_became_active":"2024-04-26T21:16:19.404480+0000","last_became_peered":"2024-04-26T21:16:19.404480+0000","last_unstale":"2024-04-26T21:16:25.814684+0000","last_undegraded":"2024-04-26T21:16:25.814684+0000","last_fullsized":"2024-04-26T21:16:25.814684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:06.128835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434093+0000","last_change":"2024-04-26T21:16:19.409681+0000","last_active":"2024-04-26T21:16:25.434093+0000","last_peered":"2024-04-26T21:16:25.434093+0000","last_clean":"2024-04-26T21:16:25.434093+0000","last_became_active":"2024-04-26T21:16:19.409425+0000","last_became_peered":"2024-04-26T21:16:19.409425+0000","last_unstale":"2024-04-26T21:16:25.434093+0000","last_undegraded":"2024-04-26T21:16:25.434093+0000","last_fullsized":"2024-04-26T21:16:25.434093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816993+0000","last_change":"2024-04-26T21:16:20.414103+0000","last_active":"2024-04-26T21:16:25.816993+0000","last_peered":"2024-04-26T21:16:25.816993+0000","last_clean":"2024-04-26T21:16:25.816993+0000","last_became_active":"2024-04-26T21:16:20.413448+0000","last_became_peered":"2024-04-26T21:16:20.413448+0000","last_unstale":"2024-04-26T21:16:25.816993+0000","last_undegraded":"2024-04-26T21:16:25.816993+0000","last_fullsized":"2024-04-26T21:16:25.816993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814945+0000","last_change":"2024-04-26T21:16:24.460713+0000","last_active":"2024-04-26T21:16:25.814945+0000","last_peered":"2024-04-26T21:16:25.814945+0000","last_clean":"2024-04-26T21:16:25.814945+0000","last_became_active":"2024-04-26T21:16:24.460386+0000","last_became_peered":"2024-04-26T21:16:24.460386+0000","last_unstale":"2024-04-26T21:16:25.814945+0000","last_undegraded":"2024-04-26T21:16:25.814945+0000","last_fullsized":"2024-04-26T21:16:25.814945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:04.230303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815685+0000","last_change":"2024-04-26T21:16:19.406024+0000","last_active":"2024-04-26T21:16:25.815685+0000","last_peered":"2024-04-26T21:16:25.815685+0000","last_clean":"2024-04-26T21:16:25.815685+0000","last_became_active":"2024-04-26T21:16:19.405711+0000","last_became_peered":"2024-04-26T21:16:19.405711+0000","last_unstale":"2024-04-26T21:16:25.815685+0000","last_undegraded":"2024-04-26T21:16:25.815685+0000","last_fullsized":"2024-04-26T21:16:25.815685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:36.055875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435119+0000","last_change":"2024-04-26T21:16:20.418241+0000","last_active":"2024-04-26T21:16:25.435119+0000","last_peered":"2024-04-26T21:16:25.435119+0000","last_clean":"2024-04-26T21:16:25.435119+0000","last_became_active":"2024-04-26T21:16:20.417321+0000","last_became_peered":"2024-04-26T21:16:20.417321+0000","last_unstale":"2024-04-26T21:16:25.435119+0000","last_undegraded":"2024-04-26T21:16:25.435119+0000","last_fullsized":"2024-04-26T21:16:25.435119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:11.862489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815612+0000","last_change":"2024-04-26T21:16:24.459831+0000","last_active":"2024-04-26T21:16:25.815612+0000","last_peered":"2024-04-26T21:16:25.815612+0000","last_clean":"2024-04-26T21:16:25.815612+0000","last_became_active":"2024-04-26T21:16:24.459065+0000","last_became_peered":"2024-04-26T21:16:24.459065+0000","last_unstale":"2024-04-26T21:16:25.815612+0000","last_undegraded":"2024-04-26T21:16:25.815612+0000","last_fullsized":"2024-04-26T21:16:25.815612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:22.852921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433775+0000","last_change":"2024-04-26T21:16:20.409734+0000","last_active":"2024-04-26T21:16:25.433775+0000","last_peered":"2024-04-26T21:16:25.433775+0000","last_clean":"2024-04-26T21:16:25.433775+0000","last_became_active":"2024-04-26T21:16:20.409468+0000","last_became_peered":"2024-04-26T21:16:20.409468+0000","last_unstale":"2024-04-26T21:16:25.433775+0000","last_undegraded":"2024-04-26T21:16:25.433775+0000","last_fullsized":"2024-04-26T21:16:25.433775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814266+0000","last_change":"2024-04-26T21:16:20.415585+0000","last_active":"2024-04-26T21:16:25.814266+0000","last_peered":"2024-04-26T21:16:25.814266+0000","last_clean":"2024-04-26T21:16:25.814266+0000","last_became_active":"2024-04-26T21:16:20.415303+0000","last_became_peered":"2024-04-26T21:16:20.415303+0000","last_unstale":"2024-04-26T21:16:25.814266+0000","last_undegraded":"2024-04-26T21:16:25.814266+0000","last_fullsized":"2024-04-26T21:16:25.814266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:19:56.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816116+0000","last_change":"2024-04-26T21:16:20.420522+0000","last_active":"2024-04-26T21:16:25.816116+0000","last_peered":"2024-04-26T21:16:25.816116+0000","last_clean":"2024-04-26T21:16:25.816116+0000","last_became_active":"2024-04-26T21:16:20.420320+0000","last_became_peered":"2024-04-26T21:16:20.420320+0000","last_unstale":"2024-04-26T21:16:25.816116+0000","last_undegraded":"2024-04-26T21:16:25.816116+0000","last_fullsized":"2024-04-26T21:16:25.816116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816909+0000","last_change":"2024-04-26T21:16:20.414468+0000","last_active":"2024-04-26T21:16:25.816909+0000","last_peered":"2024-04-26T21:16:25.816909+0000","last_clean":"2024-04-26T21:16:25.816909+0000","last_became_active":"2024-04-26T21:16:20.413736+0000","last_became_peered":"2024-04-26T21:16:20.413736+0000","last_unstale":"2024-04-26T21:16:25.816909+0000","last_undegraded":"2024-04-26T21:16:25.816909+0000","last_fullsized":"2024-04-26T21:16:25.816909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815404+0000","last_change":"2024-04-26T21:16:20.409323+0000","last_active":"2024-04-26T21:16:25.815404+0000","last_peered":"2024-04-26T21:16:25.815404+0000","last_clean":"2024-04-26T21:16:25.815404+0000","last_became_active":"2024-04-26T21:16:20.408990+0000","last_became_peered":"2024-04-26T21:16:20.408990+0000","last_unstale":"2024-04-26T21:16:25.815404+0000","last_undegraded":"2024-04-26T21:16:25.815404+0000","last_fullsized":"2024-04-26T21:16:25.815404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801281+0000","last_change":"2024-04-26T21:16:20.404357+0000","last_active":"2024-04-26T21:16:25.801281+0000","last_peered":"2024-04-26T21:16:25.801281+0000","last_clean":"2024-04-26T21:16:25.801281+0000","last_became_active":"2024-04-26T21:16:20.404167+0000","last_became_peered":"2024-04-26T21:16:20.404167+0000","last_unstale":"2024-04-26T21:16:25.801281+0000","last_undegraded":"2024-04-26T21:16:25.801281+0000","last_fullsized":"2024-04-26T21:16:25.801281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434733+0000","last_change":"2024-04-26T21:16:20.425686+0000","last_active":"2024-04-26T21:16:25.434733+0000","last_peered":"2024-04-26T21:16:25.434733+0000","last_clean":"2024-04-26T21:16:25.434733+0000","last_became_active":"2024-04-26T21:16:20.425371+0000","last_became_peered":"2024-04-26T21:16:20.425371+0000","last_unstale":"2024-04-26T21:16:25.434733+0000","last_undegraded":"2024-04-26T21:16:25.434733+0000","last_fullsized":"2024-04-26T21:16:25.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815714+0000","last_change":"2024-04-26T21:16:20.409302+0000","last_active":"2024-04-26T21:16:25.815714+0000","last_peered":"2024-04-26T21:16:25.815714+0000","last_clean":"2024-04-26T21:16:25.815714+0000","last_became_active":"2024-04-26T21:16:20.409004+0000","last_became_peered":"2024-04-26T21:16:20.409004+0000","last_unstale":"2024-04-26T21:16:25.815714+0000","last_undegraded":"2024-04-26T21:16:25.815714+0000","last_fullsized":"2024-04-26T21:16:25.815714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815954+0000","last_change":"2024-04-26T21:16:20.422765+0000","last_active":"2024-04-26T21:16:25.815954+0000","last_peered":"2024-04-26T21:16:25.815954+0000","last_clean":"2024-04-26T21:16:25.815954+0000","last_became_active":"2024-04-26T21:16:20.422225+0000","last_became_peered":"2024-04-26T21:16:20.422225+0000","last_unstale":"2024-04-26T21:16:25.815954+0000","last_undegraded":"2024-04-26T21:16:25.815954+0000","last_fullsized":"2024-04-26T21:16:25.815954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814587+0000","last_change":"2024-04-26T21:16:20.410383+0000","last_active":"2024-04-26T21:16:25.814587+0000","last_peered":"2024-04-26T21:16:25.814587+0000","last_clean":"2024-04-26T21:16:25.814587+0000","last_became_active":"2024-04-26T21:16:20.409668+0000","last_became_peered":"2024-04-26T21:16:20.409668+0000","last_unstale":"2024-04-26T21:16:25.814587+0000","last_undegraded":"2024-04-26T21:16:25.814587+0000","last_fullsized":"2024-04-26T21:16:25.814587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816058+0000","last_change":"2024-04-26T21:16:20.428016+0000","last_active":"2024-04-26T21:16:25.816058+0000","last_peered":"2024-04-26T21:16:25.816058+0000","last_clean":"2024-04-26T21:16:25.816058+0000","last_became_active":"2024-04-26T21:16:20.427562+0000","last_became_peered":"2024-04-26T21:16:20.427562+0000","last_unstale":"2024-04-26T21:16:25.816058+0000","last_undegraded":"2024-04-26T21:16:25.816058+0000","last_fullsized":"2024-04-26T21:16:25.816058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816756+0000","last_change":"2024-04-26T21:16:20.425316+0000","last_active":"2024-04-26T21:16:25.816756+0000","last_peered":"2024-04-26T21:16:25.816756+0000","last_clean":"2024-04-26T21:16:25.816756+0000","last_became_active":"2024-04-26T21:16:20.425008+0000","last_became_peered":"2024-04-26T21:16:20.425008+0000","last_unstale":"2024-04-26T21:16:25.816756+0000","last_undegraded":"2024-04-26T21:16:25.816756+0000","last_fullsized":"2024-04-26T21:16:25.816756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434193+0000","last_change":"2024-04-26T21:16:20.406211+0000","last_active":"2024-04-26T21:16:25.434193+0000","last_peered":"2024-04-26T21:16:25.434193+0000","last_clean":"2024-04-26T21:16:25.434193+0000","last_became_active":"2024-04-26T21:16:20.405903+0000","last_became_peered":"2024-04-26T21:16:20.405903+0000","last_unstale":"2024-04-26T21:16:25.434193+0000","last_undegraded":"2024-04-26T21:16:25.434193+0000","last_fullsized":"2024-04-26T21:16:25.434193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436716+0000","last_change":"2024-04-26T21:16:20.407047+0000","last_active":"2024-04-26T21:16:25.436716+0000","last_peered":"2024-04-26T21:16:25.436716+0000","last_clean":"2024-04-26T21:16:25.436716+0000","last_became_active":"2024-04-26T21:16:20.404541+0000","last_became_peered":"2024-04-26T21:16:20.404541+0000","last_unstale":"2024-04-26T21:16:25.436716+0000","last_undegraded":"2024-04-26T21:16:25.436716+0000","last_fullsized":"2024-04-26T21:16:25.436716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:09.604970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815290+0000","last_change":"2024-04-26T21:16:20.398199+0000","last_active":"2024-04-26T21:16:25.815290+0000","last_peered":"2024-04-26T21:16:25.815290+0000","last_clean":"2024-04-26T21:16:25.815290+0000","last_became_active":"2024-04-26T21:16:20.397910+0000","last_became_peered":"2024-04-26T21:16:20.397910+0000","last_unstale":"2024-04-26T21:16:25.815290+0000","last_undegraded":"2024-04-26T21:16:25.815290+0000","last_fullsized":"2024-04-26T21:16:25.815290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:09.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816910+0000","last_change":"2024-04-26T21:16:20.433837+0000","last_active":"2024-04-26T21:16:25.816910+0000","last_peered":"2024-04-26T21:16:25.816910+0000","last_clean":"2024-04-26T21:16:25.816910+0000","last_became_active":"2024-04-26T21:16:20.433536+0000","last_became_peered":"2024-04-26T21:16:20.433536+0000","last_unstale":"2024-04-26T21:16:25.816910+0000","last_undegraded":"2024-04-26T21:16:25.816910+0000","last_fullsized":"2024-04-26T21:16:25.816910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:58.416107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815843+0000","last_change":"2024-04-26T21:16:20.422532+0000","last_active":"2024-04-26T21:16:25.815843+0000","last_peered":"2024-04-26T21:16:25.815843+0000","last_clean":"2024-04-26T21:16:25.815843+0000","last_became_active":"2024-04-26T21:16:20.421767+0000","last_became_peered":"2024-04-26T21:16:20.421767+0000","last_unstale":"2024-04-26T21:16:25.815843+0000","last_undegraded":"2024-04-26T21:16:25.815843+0000","last_fullsized":"2024-04-26T21:16:25.815843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800845+0000","last_change":"2024-04-26T21:16:20.413673+0000","last_active":"2024-04-26T21:16:25.800845+0000","last_peered":"2024-04-26T21:16:25.800845+0000","last_clean":"2024-04-26T21:16:25.800845+0000","last_became_active":"2024-04-26T21:16:20.413331+0000","last_became_peered":"2024-04-26T21:16:20.413331+0000","last_unstale":"2024-04-26T21:16:25.800845+0000","last_undegraded":"2024-04-26T21:16:25.800845+0000","last_fullsized":"2024-04-26T21:16:25.800845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816767+0000","last_change":"2024-04-26T21:16:20.410440+0000","last_active":"2024-04-26T21:16:25.816767+0000","last_peered":"2024-04-26T21:16:25.816767+0000","last_clean":"2024-04-26T21:16:25.816767+0000","last_became_active":"2024-04-26T21:16:20.410116+0000","last_became_peered":"2024-04-26T21:16:20.410116+0000","last_unstale":"2024-04-26T21:16:25.816767+0000","last_undegraded":"2024-04-26T21:16:25.816767+0000","last_fullsized":"2024-04-26T21:16:25.816767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:27.807333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814886+0000","last_change":"2024-04-26T21:16:20.404907+0000","last_active":"2024-04-26T21:16:25.814886+0000","last_peered":"2024-04-26T21:16:25.814886+0000","last_clean":"2024-04-26T21:16:25.814886+0000","last_became_active":"2024-04-26T21:16:20.404560+0000","last_became_peered":"2024-04-26T21:16:20.404560+0000","last_unstale":"2024-04-26T21:16:25.814886+0000","last_undegraded":"2024-04-26T21:16:25.814886+0000","last_fullsized":"2024-04-26T21:16:25.814886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434871+0000","last_change":"2024-04-26T21:16:20.423831+0000","last_active":"2024-04-26T21:16:25.434871+0000","last_peered":"2024-04-26T21:16:25.434871+0000","last_clean":"2024-04-26T21:16:25.434871+0000","last_became_active":"2024-04-26T21:16:20.423542+0000","last_became_peered":"2024-04-26T21:16:20.423542+0000","last_unstale":"2024-04-26T21:16:25.434871+0000","last_undegraded":"2024-04-26T21:16:25.434871+0000","last_fullsized":"2024-04-26T21:16:25.434871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:43.515453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434469+0000","last_change":"2024-04-26T21:16:20.426806+0000","last_active":"2024-04-26T21:16:25.434469+0000","last_peered":"2024-04-26T21:16:25.434469+0000","last_clean":"2024-04-26T21:16:25.434469+0000","last_became_active":"2024-04-26T21:16:20.426446+0000","last_became_peered":"2024-04-26T21:16:20.426446+0000","last_unstale":"2024-04-26T21:16:25.434469+0000","last_undegraded":"2024-04-26T21:16:25.434469+0000","last_fullsized":"2024-04-26T21:16:25.434469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434639+0000","last_change":"2024-04-26T21:16:20.428440+0000","last_active":"2024-04-26T21:16:25.434639+0000","last_peered":"2024-04-26T21:16:25.434639+0000","last_clean":"2024-04-26T21:16:25.434639+0000","last_became_active":"2024-04-26T21:16:20.428074+0000","last_became_peered":"2024-04-26T21:16:20.428074+0000","last_unstale":"2024-04-26T21:16:25.434639+0000","last_undegraded":"2024-04-26T21:16:25.434639+0000","last_fullsized":"2024-04-26T21:16:25.434639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436896+0000","last_change":"2024-04-26T21:16:20.427736+0000","last_active":"2024-04-26T21:16:25.436896+0000","last_peered":"2024-04-26T21:16:25.436896+0000","last_clean":"2024-04-26T21:16:25.436896+0000","last_became_active":"2024-04-26T21:16:20.424657+0000","last_became_peered":"2024-04-26T21:16:20.424657+0000","last_unstale":"2024-04-26T21:16:25.436896+0000","last_undegraded":"2024-04-26T21:16:25.436896+0000","last_fullsized":"2024-04-26T21:16:25.436896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:41.767752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814210+0000","last_change":"2024-04-26T21:16:20.425895+0000","last_active":"2024-04-26T21:16:25.814210+0000","last_peered":"2024-04-26T21:16:25.814210+0000","last_clean":"2024-04-26T21:16:25.814210+0000","last_became_active":"2024-04-26T21:16:20.425580+0000","last_became_peered":"2024-04-26T21:16:20.425580+0000","last_unstale":"2024-04-26T21:16:25.814210+0000","last_undegraded":"2024-04-26T21:16:25.814210+0000","last_fullsized":"2024-04-26T21:16:25.814210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435717+0000","last_change":"2024-04-26T21:16:20.421664+0000","last_active":"2024-04-26T21:16:25.435717+0000","last_peered":"2024-04-26T21:16:25.435717+0000","last_clean":"2024-04-26T21:16:25.435717+0000","last_became_active":"2024-04-26T21:16:20.421311+0000","last_became_peered":"2024-04-26T21:16:20.421311+0000","last_unstale":"2024-04-26T21:16:25.435717+0000","last_undegraded":"2024-04-26T21:16:25.435717+0000","last_fullsized":"2024-04-26T21:16:25.435717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815976+0000","last_change":"2024-04-26T21:16:20.427879+0000","last_active":"2024-04-26T21:16:25.815976+0000","last_peered":"2024-04-26T21:16:25.815976+0000","last_clean":"2024-04-26T21:16:25.815976+0000","last_became_active":"2024-04-26T21:16:20.426632+0000","last_became_peered":"2024-04-26T21:16:20.426632+0000","last_unstale":"2024-04-26T21:16:25.815976+0000","last_undegraded":"2024-04-26T21:16:25.815976+0000","last_fullsized":"2024-04-26T21:16:25.815976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436067+0000","last_change":"2024-04-26T21:16:20.401403+0000","last_active":"2024-04-26T21:16:25.436067+0000","last_peered":"2024-04-26T21:16:25.436067+0000","last_clean":"2024-04-26T21:16:25.436067+0000","last_became_active":"2024-04-26T21:16:20.401084+0000","last_became_peered":"2024-04-26T21:16:20.401084+0000","last_unstale":"2024-04-26T21:16:25.436067+0000","last_undegraded":"2024-04-26T21:16:25.436067+0000","last_fullsized":"2024-04-26T21:16:25.436067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816320+0000","last_change":"2024-04-26T21:16:20.434210+0000","last_active":"2024-04-26T21:16:25.816320+0000","last_peered":"2024-04-26T21:16:25.816320+0000","last_clean":"2024-04-26T21:16:25.816320+0000","last_became_active":"2024-04-26T21:16:20.433607+0000","last_became_peered":"2024-04-26T21:16:20.433607+0000","last_unstale":"2024-04-26T21:16:25.816320+0000","last_undegraded":"2024-04-26T21:16:25.816320+0000","last_fullsized":"2024-04-26T21:16:25.816320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817053+0000","last_change":"2024-04-26T21:16:20.419582+0000","last_active":"2024-04-26T21:16:25.817053+0000","last_peered":"2024-04-26T21:16:25.817053+0000","last_clean":"2024-04-26T21:16:25.817053+0000","last_became_active":"2024-04-26T21:16:20.419259+0000","last_became_peered":"2024-04-26T21:16:20.419259+0000","last_unstale":"2024-04-26T21:16:25.817053+0000","last_undegraded":"2024-04-26T21:16:25.817053+0000","last_fullsized":"2024-04-26T21:16:25.817053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801509+0000","last_change":"2024-04-26T21:16:20.405606+0000","last_active":"2024-04-26T21:16:25.801509+0000","last_peered":"2024-04-26T21:16:25.801509+0000","last_clean":"2024-04-26T21:16:25.801509+0000","last_became_active":"2024-04-26T21:16:20.405265+0000","last_became_peered":"2024-04-26T21:16:20.405265+0000","last_unstale":"2024-04-26T21:16:25.801509+0000","last_undegraded":"2024-04-26T21:16:25.801509+0000","last_fullsized":"2024-04-26T21:16:25.801509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436755+0000","last_change":"2024-04-26T21:16:20.415452+0000","last_active":"2024-04-26T21:16:25.436755+0000","last_peered":"2024-04-26T21:16:25.436755+0000","last_clean":"2024-04-26T21:16:25.436755+0000","last_became_active":"2024-04-26T21:16:20.414915+0000","last_became_peered":"2024-04-26T21:16:20.414915+0000","last_unstale":"2024-04-26T21:16:25.436755+0000","last_undegraded":"2024-04-26T21:16:25.436755+0000","last_fullsized":"2024-04-26T21:16:25.436755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:58.416107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":110683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":701563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:16:44.148 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:16:44.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f304b000640 1 Processor -- start 2024-04-26T21:16:44.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f304b000640 1 -- start start 2024-04-26T21:16:44.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f304b000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f304415d060 0x7f30440cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f304b000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 0x7f30440cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f304b000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30440b2250 con 0x7f30440cfb70 2024-04-26T21:16:44.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f304b000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f30440b25a0 con 0x7f304415d060 2024-04-26T21:16:44.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f304b000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f30440ce660 con 0x7f30440b3a40 2024-04-26T21:16:44.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f3049000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 0x7f30440cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f3043400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f30440cfb70 0x7f30440d0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:44014/0 (socket says 172.21.15.106:44014) 2024-04-26T21:16:44.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f3043400640 1 -- 172.21.15.106:0/1702868608 learned_addr learned my addr 172.21.15.106:0/1702868608 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:44.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f3043e00640 1 --2- 172.21.15.106:0/1702868608 >> v2:172.21.15.112:3300/0 conn(0x7f304415d060 0x7f30440cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f3042a00640 1 -- 172.21.15.106:0/1702868608 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329567019 0 0) 0x7f30440b2250 con 0x7f30440cfb70 2024-04-26T21:16:44.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f3042a00640 1 -- 172.21.15.106:0/1702868608 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3028003530 con 0x7f30440cfb70 2024-04-26T21:16:44.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f3049000640 1 -- 172.21.15.106:0/1702868608 >> v2:172.21.15.112:3300/0 conn(0x7f304415d060 msgr2=0x7f30440cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:44.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.323+0000 7f3049000640 1 --2- 172.21.15.106:0/1702868608 >> v2:172.21.15.112:3300/0 conn(0x7f304415d060 0x7f30440cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f3049000640 1 -- 172.21.15.106:0/1702868608 >> v1:172.21.15.112:6789/0 conn(0x7f30440cfb70 legacy=0x7f30440d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f3049000640 1 -- 172.21.15.106:0/1702868608 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30440ce940 con 0x7f30440b3a40 2024-04-26T21:16:44.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f3049000640 1 --2- 172.21.15.106:0/1702868608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 0x7f30440cfff0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f303c009d90 tx=0x7f303c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4887620cbe500e1b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:44.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f3042a00640 1 -- 172.21.15.106:0/1702868608 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c0b2070 con 0x7f30440b3a40 2024-04-26T21:16:44.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f3042a00640 1 -- 172.21.15.106:0/1702868608 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c0a5940 con 0x7f30440b3a40 2024-04-26T21:16:44.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f3042a00640 1 -- 172.21.15.106:0/1702868608 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c0a5cf0 con 0x7f30440b3a40 2024-04-26T21:16:44.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f304b000640 1 -- 172.21.15.106:0/1702868608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 msgr2=0x7f30440cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f304b000640 1 --2- 172.21.15.106:0/1702868608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 0x7f30440cfff0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f303c009d90 tx=0x7f303c01c970 comp rx=0 tx=0).stop 2024-04-26T21:16:44.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f304b000640 1 -- 172.21.15.106:0/1702868608 shutdown_connections 2024-04-26T21:16:44.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f304b000640 1 --2- 172.21.15.106:0/1702868608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 0x7f30440cfff0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.327+0000 7f304b000640 1 --2- 172.21.15.106:0/1702868608 >> v2:172.21.15.112:3300/0 conn(0x7f304415d060 0x7f30440cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 -- 172.21.15.106:0/1702868608 >> 172.21.15.106:0/1702868608 conn(0x7f30440d2c60 msgr2=0x7f30440d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:44.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 -- 172.21.15.106:0/1702868608 shutdown_connections 2024-04-26T21:16:44.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 -- 172.21.15.106:0/1702868608 wait complete. 2024-04-26T21:16:44.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 Processor -- start 2024-04-26T21:16:44.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 -- start start 2024-04-26T21:16:44.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 0x7f3044150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30440cfb70 0x7f30441506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f304415d060 0x7f30440cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3044169d80 con 0x7f304415d060 2024-04-26T21:16:44.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3044169c00 con 0x7f30440cfb70 2024-04-26T21:16:44.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f304b000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3044169f00 con 0x7f30440b3a40 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3049000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f304415d060 0x7f30440cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3043e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 0x7f3044150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3049000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f304415d060 0x7f30440cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41316/0 (socket says 172.21.15.106:41316) 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3049000640 1 -- 172.21.15.106:0/4111165209 learned_addr learned my addr 172.21.15.106:0/4111165209 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3043400640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30440cfb70 0x7f30441506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3049000640 1 -- 172.21.15.106:0/4111165209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 msgr2=0x7f3044150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3049000640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 0x7f3044150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3049000640 1 -- 172.21.15.106:0/4111165209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30440cfb70 msgr2=0x7f30441506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3049000640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30440cfb70 0x7f30441506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3049000640 1 -- 172.21.15.106:0/4111165209 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3044155a20 con 0x7f304415d060 2024-04-26T21:16:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.331+0000 7f3049000640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f304415d060 0x7f30440cc680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b0040 tx=0x7f303c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f303be00640 1 -- 172.21.15.106:0/4111165209 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c0b2050 con 0x7f304415d060 2024-04-26T21:16:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f303be00640 1 -- 172.21.15.106:0/4111165209 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c0be070 con 0x7f304415d060 2024-04-26T21:16:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f303be00640 1 -- 172.21.15.106:0/4111165209 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c003db0 con 0x7f304415d060 2024-04-26T21:16:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3044155ce0 con 0x7f304415d060 2024-04-26T21:16:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30441562a0 con 0x7f304415d060 2024-04-26T21:16:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3044069400 con 0x7f304415d060 2024-04-26T21:16:44.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f303be00640 1 -- 172.21.15.106:0/4111165209 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f303c004040 con 0x7f304415d060 2024-04-26T21:16:44.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f303be00640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3024068380 0x7f302406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f303be00640 1 -- 172.21.15.106:0/4111165209 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f303c121c10 con 0x7f304415d060 2024-04-26T21:16:44.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.335+0000 7f3043e00640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3024068380 0x7f302406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.339+0000 7f3043e00640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3024068380 0x7f302406a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3034009b60 tx=0x7f3034009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.339+0000 7f303be00640 1 -- 172.21.15.106:0/4111165209 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f303c016560 con 0x7f304415d060 2024-04-26T21:16:44.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.499+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30440cee90 con 0x7f3024068380 2024-04-26T21:16:44.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.507+0000 7f303be00640 1 -- 172.21.15.106:0/4111165209 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332538 (secure 0 0 0) 0x7f30440cee90 con 0x7f3024068380 2024-04-26T21:16:44.514 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:44.516 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:16:44.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3024068380 msgr2=0x7f302406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3024068380 0x7f302406a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3034009b60 tx=0x7f3034009190 comp rx=0 tx=0).stop 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f304415d060 msgr2=0x7f30440cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f304415d060 0x7f30440cc680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b0040 tx=0x7f303c019710 comp rx=0 tx=0).stop 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 shutdown_connections 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30440cfb70 0x7f30441506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3024068380 0x7f302406a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f304415d060 0x7f30440cc680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 --2- 172.21.15.106:0/4111165209 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30440b3a40 0x7f3044150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 >> 172.21.15.106:0/4111165209 conn(0x7f30440d2c60 msgr2=0x7f30440d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:44.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 shutdown_connections 2024-04-26T21:16:44.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.511+0000 7f304b000640 1 -- 172.21.15.106:0/4111165209 wait complete. 2024-04-26T21:16:44.535 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-26T21:16:44.295415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219604,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755116,"statfs":{"total":773094113280,"available":772869238784,"internally_reserved":0,"allocated":3514368,"data_stored":2074472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002987"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817484+0000","last_change":"2024-04-26T21:16:19.412305+0000","last_active":"2024-04-26T21:16:25.817484+0000","last_peered":"2024-04-26T21:16:25.817484+0000","last_clean":"2024-04-26T21:16:25.817484+0000","last_became_active":"2024-04-26T21:16:19.411559+0000","last_became_peered":"2024-04-26T21:16:19.411559+0000","last_unstale":"2024-04-26T21:16:25.817484+0000","last_undegraded":"2024-04-26T21:16:25.817484+0000","last_fullsized":"2024-04-26T21:16:25.817484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:31.811132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815514+0000","last_change":"2024-04-26T21:16:20.411882+0000","last_active":"2024-04-26T21:16:25.815514+0000","last_peered":"2024-04-26T21:16:25.815514+0000","last_clean":"2024-04-26T21:16:25.815514+0000","last_became_active":"2024-04-26T21:16:20.411587+0000","last_became_peered":"2024-04-26T21:16:20.411587+0000","last_unstale":"2024-04-26T21:16:25.815514+0000","last_undegraded":"2024-04-26T21:16:25.815514+0000","last_fullsized":"2024-04-26T21:16:25.815514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814423+0000","last_change":"2024-04-26T21:16:24.448323+0000","last_active":"2024-04-26T21:16:25.814423+0000","last_peered":"2024-04-26T21:16:25.814423+0000","last_clean":"2024-04-26T21:16:25.814423+0000","last_became_active":"2024-04-26T21:16:24.447718+0000","last_became_peered":"2024-04-26T21:16:24.447718+0000","last_unstale":"2024-04-26T21:16:25.814423+0000","last_undegraded":"2024-04-26T21:16:25.814423+0000","last_fullsized":"2024-04-26T21:16:25.814423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:58.709336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815628+0000","last_change":"2024-04-26T21:16:19.413460+0000","last_active":"2024-04-26T21:16:25.815628+0000","last_peered":"2024-04-26T21:16:25.815628+0000","last_clean":"2024-04-26T21:16:25.815628+0000","last_became_active":"2024-04-26T21:16:19.413146+0000","last_became_peered":"2024-04-26T21:16:19.413146+0000","last_unstale":"2024-04-26T21:16:25.815628+0000","last_undegraded":"2024-04-26T21:16:25.815628+0000","last_fullsized":"2024-04-26T21:16:25.815628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817398+0000","last_change":"2024-04-26T21:16:20.424236+0000","last_active":"2024-04-26T21:16:25.817398+0000","last_peered":"2024-04-26T21:16:25.817398+0000","last_clean":"2024-04-26T21:16:25.817398+0000","last_became_active":"2024-04-26T21:16:20.423996+0000","last_became_peered":"2024-04-26T21:16:20.423996+0000","last_unstale":"2024-04-26T21:16:25.817398+0000","last_undegraded":"2024-04-26T21:16:25.817398+0000","last_fullsized":"2024-04-26T21:16:25.817398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434335+0000","last_change":"2024-04-26T21:16:24.463491+0000","last_active":"2024-04-26T21:16:25.434335+0000","last_peered":"2024-04-26T21:16:25.434335+0000","last_clean":"2024-04-26T21:16:25.434335+0000","last_became_active":"2024-04-26T21:16:24.463053+0000","last_became_peered":"2024-04-26T21:16:24.463053+0000","last_unstale":"2024-04-26T21:16:25.434335+0000","last_undegraded":"2024-04-26T21:16:25.434335+0000","last_fullsized":"2024-04-26T21:16:25.434335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:29.049312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436569+0000","last_change":"2024-04-26T21:16:19.411595+0000","last_active":"2024-04-26T21:16:25.436569+0000","last_peered":"2024-04-26T21:16:25.436569+0000","last_clean":"2024-04-26T21:16:25.436569+0000","last_became_active":"2024-04-26T21:16:19.411220+0000","last_became_peered":"2024-04-26T21:16:19.411220+0000","last_unstale":"2024-04-26T21:16:25.436569+0000","last_undegraded":"2024-04-26T21:16:25.436569+0000","last_fullsized":"2024-04-26T21:16:25.436569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816434+0000","last_change":"2024-04-26T21:16:20.426594+0000","last_active":"2024-04-26T21:16:25.816434+0000","last_peered":"2024-04-26T21:16:25.816434+0000","last_clean":"2024-04-26T21:16:25.816434+0000","last_became_active":"2024-04-26T21:16:20.426300+0000","last_became_peered":"2024-04-26T21:16:20.426300+0000","last_unstale":"2024-04-26T21:16:25.816434+0000","last_undegraded":"2024-04-26T21:16:25.816434+0000","last_fullsized":"2024-04-26T21:16:25.816434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435135+0000","last_change":"2024-04-26T21:16:24.461980+0000","last_active":"2024-04-26T21:16:25.435135+0000","last_peered":"2024-04-26T21:16:25.435135+0000","last_clean":"2024-04-26T21:16:25.435135+0000","last_became_active":"2024-04-26T21:16:24.461244+0000","last_became_peered":"2024-04-26T21:16:24.461244+0000","last_unstale":"2024-04-26T21:16:25.435135+0000","last_undegraded":"2024-04-26T21:16:25.435135+0000","last_fullsized":"2024-04-26T21:16:25.435135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:49.007056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436320+0000","last_change":"2024-04-26T21:16:19.413076+0000","last_active":"2024-04-26T21:16:25.436320+0000","last_peered":"2024-04-26T21:16:25.436320+0000","last_clean":"2024-04-26T21:16:25.436320+0000","last_became_active":"2024-04-26T21:16:19.412710+0000","last_became_peered":"2024-04-26T21:16:19.412710+0000","last_unstale":"2024-04-26T21:16:25.436320+0000","last_undegraded":"2024-04-26T21:16:25.436320+0000","last_fullsized":"2024-04-26T21:16:25.436320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:56.575835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816409+0000","last_change":"2024-04-26T21:16:20.421335+0000","last_active":"2024-04-26T21:16:25.816409+0000","last_peered":"2024-04-26T21:16:25.816409+0000","last_clean":"2024-04-26T21:16:25.816409+0000","last_became_active":"2024-04-26T21:16:20.420893+0000","last_became_peered":"2024-04-26T21:16:20.420893+0000","last_unstale":"2024-04-26T21:16:25.816409+0000","last_undegraded":"2024-04-26T21:16:25.816409+0000","last_fullsized":"2024-04-26T21:16:25.816409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:09.604970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434983+0000","last_change":"2024-04-26T21:16:24.457306+0000","last_active":"2024-04-26T21:16:25.434983+0000","last_peered":"2024-04-26T21:16:25.434983+0000","last_clean":"2024-04-26T21:16:25.434983+0000","last_became_active":"2024-04-26T21:16:24.456786+0000","last_became_peered":"2024-04-26T21:16:24.456786+0000","last_unstale":"2024-04-26T21:16:25.434983+0000","last_undegraded":"2024-04-26T21:16:25.434983+0000","last_fullsized":"2024-04-26T21:16:25.434983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:07.354698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433876+0000","last_change":"2024-04-26T21:16:20.407919+0000","last_active":"2024-04-26T21:16:25.433876+0000","last_peered":"2024-04-26T21:16:25.433876+0000","last_clean":"2024-04-26T21:16:25.433876+0000","last_became_active":"2024-04-26T21:16:20.405803+0000","last_became_peered":"2024-04-26T21:16:20.405803+0000","last_unstale":"2024-04-26T21:16:25.433876+0000","last_undegraded":"2024-04-26T21:16:25.433876+0000","last_fullsized":"2024-04-26T21:16:25.433876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436225+0000","last_change":"2024-04-26T21:16:19.408886+0000","last_active":"2024-04-26T21:16:25.436225+0000","last_peered":"2024-04-26T21:16:25.436225+0000","last_clean":"2024-04-26T21:16:25.436225+0000","last_became_active":"2024-04-26T21:16:19.408563+0000","last_became_peered":"2024-04-26T21:16:19.408563+0000","last_unstale":"2024-04-26T21:16:25.436225+0000","last_undegraded":"2024-04-26T21:16:25.436225+0000","last_fullsized":"2024-04-26T21:16:25.436225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436044+0000","last_change":"2024-04-26T21:16:24.463322+0000","last_active":"2024-04-26T21:16:25.436044+0000","last_peered":"2024-04-26T21:16:25.436044+0000","last_clean":"2024-04-26T21:16:25.436044+0000","last_became_active":"2024-04-26T21:16:24.462885+0000","last_became_peered":"2024-04-26T21:16:24.462885+0000","last_unstale":"2024-04-26T21:16:25.436044+0000","last_undegraded":"2024-04-26T21:16:25.436044+0000","last_fullsized":"2024-04-26T21:16:25.436044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814971+0000","last_change":"2024-04-26T21:16:20.417586+0000","last_active":"2024-04-26T21:16:25.814971+0000","last_peered":"2024-04-26T21:16:25.814971+0000","last_clean":"2024-04-26T21:16:25.814971+0000","last_became_active":"2024-04-26T21:16:20.417195+0000","last_became_peered":"2024-04-26T21:16:20.417195+0000","last_unstale":"2024-04-26T21:16:25.814971+0000","last_undegraded":"2024-04-26T21:16:25.814971+0000","last_fullsized":"2024-04-26T21:16:25.814971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801200+0000","last_change":"2024-04-26T21:16:19.402526+0000","last_active":"2024-04-26T21:16:25.801200+0000","last_peered":"2024-04-26T21:16:25.801200+0000","last_clean":"2024-04-26T21:16:25.801200+0000","last_became_active":"2024-04-26T21:16:19.399544+0000","last_became_peered":"2024-04-26T21:16:19.399544+0000","last_unstale":"2024-04-26T21:16:25.801200+0000","last_undegraded":"2024-04-26T21:16:25.801200+0000","last_fullsized":"2024-04-26T21:16:25.801200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434800+0000","last_change":"2024-04-26T21:16:24.462467+0000","last_active":"2024-04-26T21:16:25.434800+0000","last_peered":"2024-04-26T21:16:25.434800+0000","last_clean":"2024-04-26T21:16:25.434800+0000","last_became_active":"2024-04-26T21:16:24.461966+0000","last_became_peered":"2024-04-26T21:16:24.461966+0000","last_unstale":"2024-04-26T21:16:25.434800+0000","last_undegraded":"2024-04-26T21:16:25.434800+0000","last_fullsized":"2024-04-26T21:16:25.434800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:44.228248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814368+0000","last_change":"2024-04-26T21:16:20.404811+0000","last_active":"2024-04-26T21:16:25.814368+0000","last_peered":"2024-04-26T21:16:25.814368+0000","last_clean":"2024-04-26T21:16:25.814368+0000","last_became_active":"2024-04-26T21:16:20.403360+0000","last_became_peered":"2024-04-26T21:16:20.403360+0000","last_unstale":"2024-04-26T21:16:25.814368+0000","last_undegraded":"2024-04-26T21:16:25.814368+0000","last_fullsized":"2024-04-26T21:16:25.814368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800884+0000","last_change":"2024-04-26T21:16:19.400626+0000","last_active":"2024-04-26T21:16:25.800884+0000","last_peered":"2024-04-26T21:16:25.800884+0000","last_clean":"2024-04-26T21:16:25.800884+0000","last_became_active":"2024-04-26T21:16:19.400194+0000","last_became_peered":"2024-04-26T21:16:19.400194+0000","last_unstale":"2024-04-26T21:16:25.800884+0000","last_undegraded":"2024-04-26T21:16:25.800884+0000","last_fullsized":"2024-04-26T21:16:25.800884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801658+0000","last_change":"2024-04-26T21:16:24.461234+0000","last_active":"2024-04-26T21:16:25.801658+0000","last_peered":"2024-04-26T21:16:25.801658+0000","last_clean":"2024-04-26T21:16:25.801658+0000","last_became_active":"2024-04-26T21:16:24.460911+0000","last_became_peered":"2024-04-26T21:16:24.460911+0000","last_unstale":"2024-04-26T21:16:25.801658+0000","last_undegraded":"2024-04-26T21:16:25.801658+0000","last_fullsized":"2024-04-26T21:16:25.801658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:45.803476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434606+0000","last_change":"2024-04-26T21:16:20.418241+0000","last_active":"2024-04-26T21:16:25.434606+0000","last_peered":"2024-04-26T21:16:25.434606+0000","last_clean":"2024-04-26T21:16:25.434606+0000","last_became_active":"2024-04-26T21:16:20.417710+0000","last_became_peered":"2024-04-26T21:16:20.417710+0000","last_unstale":"2024-04-26T21:16:25.434606+0000","last_undegraded":"2024-04-26T21:16:25.434606+0000","last_fullsized":"2024-04-26T21:16:25.434606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:46.750974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435669+0000","last_change":"2024-04-26T21:16:19.417003+0000","last_active":"2024-04-26T21:16:25.435669+0000","last_peered":"2024-04-26T21:16:25.435669+0000","last_clean":"2024-04-26T21:16:25.435669+0000","last_became_active":"2024-04-26T21:16:19.416648+0000","last_became_peered":"2024-04-26T21:16:19.416648+0000","last_unstale":"2024-04-26T21:16:25.435669+0000","last_undegraded":"2024-04-26T21:16:25.435669+0000","last_fullsized":"2024-04-26T21:16:25.435669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434863+0000","last_change":"2024-04-26T21:16:24.462876+0000","last_active":"2024-04-26T21:16:25.434863+0000","last_peered":"2024-04-26T21:16:25.434863+0000","last_clean":"2024-04-26T21:16:25.434863+0000","last_became_active":"2024-04-26T21:16:24.462460+0000","last_became_peered":"2024-04-26T21:16:24.462460+0000","last_unstale":"2024-04-26T21:16:25.434863+0000","last_undegraded":"2024-04-26T21:16:25.434863+0000","last_fullsized":"2024-04-26T21:16:25.434863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:21.311855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817334+0000","last_change":"2024-04-26T21:16:20.408076+0000","last_active":"2024-04-26T21:16:25.817334+0000","last_peered":"2024-04-26T21:16:25.817334+0000","last_clean":"2024-04-26T21:16:25.817334+0000","last_became_active":"2024-04-26T21:16:20.407656+0000","last_became_peered":"2024-04-26T21:16:20.407656+0000","last_unstale":"2024-04-26T21:16:25.817334+0000","last_undegraded":"2024-04-26T21:16:25.817334+0000","last_fullsized":"2024-04-26T21:16:25.817334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435249+0000","last_change":"2024-04-26T21:16:19.411480+0000","last_active":"2024-04-26T21:16:25.435249+0000","last_peered":"2024-04-26T21:16:25.435249+0000","last_clean":"2024-04-26T21:16:25.435249+0000","last_became_active":"2024-04-26T21:16:19.410829+0000","last_became_peered":"2024-04-26T21:16:19.410829+0000","last_unstale":"2024-04-26T21:16:25.435249+0000","last_undegraded":"2024-04-26T21:16:25.435249+0000","last_fullsized":"2024-04-26T21:16:25.435249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434466+0000","last_change":"2024-04-26T21:16:24.456850+0000","last_active":"2024-04-26T21:16:25.434466+0000","last_peered":"2024-04-26T21:16:25.434466+0000","last_clean":"2024-04-26T21:16:25.434466+0000","last_became_active":"2024-04-26T21:16:24.456404+0000","last_became_peered":"2024-04-26T21:16:24.456404+0000","last_unstale":"2024-04-26T21:16:25.434466+0000","last_undegraded":"2024-04-26T21:16:25.434466+0000","last_fullsized":"2024-04-26T21:16:25.434466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:35.587426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815768+0000","last_change":"2024-04-26T21:16:20.427731+0000","last_active":"2024-04-26T21:16:25.815768+0000","last_peered":"2024-04-26T21:16:25.815768+0000","last_clean":"2024-04-26T21:16:25.815768+0000","last_became_active":"2024-04-26T21:16:20.427425+0000","last_became_peered":"2024-04-26T21:16:20.427425+0000","last_unstale":"2024-04-26T21:16:25.815768+0000","last_undegraded":"2024-04-26T21:16:25.815768+0000","last_fullsized":"2024-04-26T21:16:25.815768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801527+0000","last_change":"2024-04-26T21:16:19.406450+0000","last_active":"2024-04-26T21:16:25.801527+0000","last_peered":"2024-04-26T21:16:25.801527+0000","last_clean":"2024-04-26T21:16:25.801527+0000","last_became_active":"2024-04-26T21:16:19.405911+0000","last_became_peered":"2024-04-26T21:16:19.405911+0000","last_unstale":"2024-04-26T21:16:25.801527+0000","last_undegraded":"2024-04-26T21:16:25.801527+0000","last_fullsized":"2024-04-26T21:16:25.801527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814203+0000","last_change":"2024-04-26T21:16:24.458420+0000","last_active":"2024-04-26T21:16:25.814203+0000","last_peered":"2024-04-26T21:16:25.814203+0000","last_clean":"2024-04-26T21:16:25.814203+0000","last_became_active":"2024-04-26T21:16:24.458033+0000","last_became_peered":"2024-04-26T21:16:24.458033+0000","last_unstale":"2024-04-26T21:16:25.814203+0000","last_undegraded":"2024-04-26T21:16:25.814203+0000","last_fullsized":"2024-04-26T21:16:25.814203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:45.881928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801205+0000","last_change":"2024-04-26T21:16:20.410112+0000","last_active":"2024-04-26T21:16:25.801205+0000","last_peered":"2024-04-26T21:16:25.801205+0000","last_clean":"2024-04-26T21:16:25.801205+0000","last_became_active":"2024-04-26T21:16:20.406760+0000","last_became_peered":"2024-04-26T21:16:20.406760+0000","last_unstale":"2024-04-26T21:16:25.801205+0000","last_undegraded":"2024-04-26T21:16:25.801205+0000","last_fullsized":"2024-04-26T21:16:25.801205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436719+0000","last_change":"2024-04-26T21:16:19.415298+0000","last_active":"2024-04-26T21:16:25.436719+0000","last_peered":"2024-04-26T21:16:25.436719+0000","last_clean":"2024-04-26T21:16:25.436719+0000","last_became_active":"2024-04-26T21:16:19.414712+0000","last_became_peered":"2024-04-26T21:16:19.414712+0000","last_unstale":"2024-04-26T21:16:25.436719+0000","last_undegraded":"2024-04-26T21:16:25.436719+0000","last_fullsized":"2024-04-26T21:16:25.436719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:38.445207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816864+0000","last_change":"2024-04-26T21:16:24.454307+0000","last_active":"2024-04-26T21:16:25.816864+0000","last_peered":"2024-04-26T21:16:25.816864+0000","last_clean":"2024-04-26T21:16:25.816864+0000","last_became_active":"2024-04-26T21:16:24.453880+0000","last_became_peered":"2024-04-26T21:16:24.453880+0000","last_unstale":"2024-04-26T21:16:25.816864+0000","last_undegraded":"2024-04-26T21:16:25.816864+0000","last_fullsized":"2024-04-26T21:16:25.816864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:02.451831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816509+0000","last_change":"2024-04-26T21:16:20.421987+0000","last_active":"2024-04-26T21:16:25.816509+0000","last_peered":"2024-04-26T21:16:25.816509+0000","last_clean":"2024-04-26T21:16:25.816509+0000","last_became_active":"2024-04-26T21:16:20.421708+0000","last_became_peered":"2024-04-26T21:16:20.421708+0000","last_unstale":"2024-04-26T21:16:25.816509+0000","last_undegraded":"2024-04-26T21:16:25.816509+0000","last_fullsized":"2024-04-26T21:16:25.816509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:03.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801261+0000","last_change":"2024-04-26T21:16:19.411246+0000","last_active":"2024-04-26T21:16:25.801261+0000","last_peered":"2024-04-26T21:16:25.801261+0000","last_clean":"2024-04-26T21:16:25.801261+0000","last_became_active":"2024-04-26T21:16:19.410899+0000","last_became_peered":"2024-04-26T21:16:19.410899+0000","last_unstale":"2024-04-26T21:16:25.801261+0000","last_undegraded":"2024-04-26T21:16:25.801261+0000","last_fullsized":"2024-04-26T21:16:25.801261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:38.445207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800985+0000","last_change":"2024-04-26T21:16:24.460849+0000","last_active":"2024-04-26T21:16:25.800985+0000","last_peered":"2024-04-26T21:16:25.800985+0000","last_clean":"2024-04-26T21:16:25.800985+0000","last_became_active":"2024-04-26T21:16:24.460317+0000","last_became_peered":"2024-04-26T21:16:24.460317+0000","last_unstale":"2024-04-26T21:16:25.800985+0000","last_undegraded":"2024-04-26T21:16:25.800985+0000","last_fullsized":"2024-04-26T21:16:25.800985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435239+0000","last_change":"2024-04-26T21:16:20.418564+0000","last_active":"2024-04-26T21:16:25.435239+0000","last_peered":"2024-04-26T21:16:25.435239+0000","last_clean":"2024-04-26T21:16:25.435239+0000","last_became_active":"2024-04-26T21:16:20.417882+0000","last_became_peered":"2024-04-26T21:16:20.417882+0000","last_unstale":"2024-04-26T21:16:25.435239+0000","last_undegraded":"2024-04-26T21:16:25.435239+0000","last_fullsized":"2024-04-26T21:16:25.435239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:40.649173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816239+0000","last_change":"2024-04-26T21:16:19.399034+0000","last_active":"2024-04-26T21:16:25.816239+0000","last_peered":"2024-04-26T21:16:25.816239+0000","last_clean":"2024-04-26T21:16:25.816239+0000","last_became_active":"2024-04-26T21:16:19.398765+0000","last_became_peered":"2024-04-26T21:16:19.398765+0000","last_unstale":"2024-04-26T21:16:25.816239+0000","last_undegraded":"2024-04-26T21:16:25.816239+0000","last_fullsized":"2024-04-26T21:16:25.816239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801228+0000","last_change":"2024-04-26T21:16:24.458228+0000","last_active":"2024-04-26T21:16:25.801228+0000","last_peered":"2024-04-26T21:16:25.801228+0000","last_clean":"2024-04-26T21:16:25.801228+0000","last_became_active":"2024-04-26T21:16:24.457891+0000","last_became_peered":"2024-04-26T21:16:24.457891+0000","last_unstale":"2024-04-26T21:16:25.801228+0000","last_undegraded":"2024-04-26T21:16:25.801228+0000","last_fullsized":"2024-04-26T21:16:25.801228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:41:02.451831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800959+0000","last_change":"2024-04-26T21:16:20.403928+0000","last_active":"2024-04-26T21:16:25.800959+0000","last_peered":"2024-04-26T21:16:25.800959+0000","last_clean":"2024-04-26T21:16:25.800959+0000","last_became_active":"2024-04-26T21:16:20.403679+0000","last_became_peered":"2024-04-26T21:16:20.403679+0000","last_unstale":"2024-04-26T21:16:25.800959+0000","last_undegraded":"2024-04-26T21:16:25.800959+0000","last_fullsized":"2024-04-26T21:16:25.800959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814353+0000","last_change":"2024-04-26T21:16:19.401004+0000","last_active":"2024-04-26T21:16:25.814353+0000","last_peered":"2024-04-26T21:16:25.814353+0000","last_clean":"2024-04-26T21:16:25.814353+0000","last_became_active":"2024-04-26T21:16:19.400735+0000","last_became_peered":"2024-04-26T21:16:19.400735+0000","last_unstale":"2024-04-26T21:16:25.814353+0000","last_undegraded":"2024-04-26T21:16:25.814353+0000","last_fullsized":"2024-04-26T21:16:25.814353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:10.576991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801692+0000","last_change":"2024-04-26T21:16:24.455241+0000","last_active":"2024-04-26T21:16:25.801692+0000","last_peered":"2024-04-26T21:16:25.801692+0000","last_clean":"2024-04-26T21:16:25.801692+0000","last_became_active":"2024-04-26T21:16:24.454846+0000","last_became_peered":"2024-04-26T21:16:24.454846+0000","last_unstale":"2024-04-26T21:16:25.801692+0000","last_undegraded":"2024-04-26T21:16:25.801692+0000","last_fullsized":"2024-04-26T21:16:25.801692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:31.330251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816525+0000","last_change":"2024-04-26T21:16:20.410135+0000","last_active":"2024-04-26T21:16:25.816525+0000","last_peered":"2024-04-26T21:16:25.816525+0000","last_clean":"2024-04-26T21:16:25.816525+0000","last_became_active":"2024-04-26T21:16:20.409798+0000","last_became_peered":"2024-04-26T21:16:20.409798+0000","last_unstale":"2024-04-26T21:16:25.816525+0000","last_undegraded":"2024-04-26T21:16:25.816525+0000","last_fullsized":"2024-04-26T21:16:25.816525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:11.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435791+0000","last_change":"2024-04-26T21:16:19.412309+0000","last_active":"2024-04-26T21:16:25.435791+0000","last_peered":"2024-04-26T21:16:25.435791+0000","last_clean":"2024-04-26T21:16:25.435791+0000","last_became_active":"2024-04-26T21:16:19.412073+0000","last_became_peered":"2024-04-26T21:16:19.412073+0000","last_unstale":"2024-04-26T21:16:25.435791+0000","last_undegraded":"2024-04-26T21:16:25.435791+0000","last_fullsized":"2024-04-26T21:16:25.435791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817236+0000","last_change":"2024-04-26T21:16:24.458176+0000","last_active":"2024-04-26T21:16:25.817236+0000","last_peered":"2024-04-26T21:16:25.817236+0000","last_clean":"2024-04-26T21:16:25.817236+0000","last_became_active":"2024-04-26T21:16:24.457774+0000","last_became_peered":"2024-04-26T21:16:24.457774+0000","last_unstale":"2024-04-26T21:16:25.817236+0000","last_undegraded":"2024-04-26T21:16:25.817236+0000","last_fullsized":"2024-04-26T21:16:25.817236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:45.881928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814481+0000","last_change":"2024-04-26T21:16:20.425327+0000","last_active":"2024-04-26T21:16:25.814481+0000","last_peered":"2024-04-26T21:16:25.814481+0000","last_clean":"2024-04-26T21:16:25.814481+0000","last_became_active":"2024-04-26T21:16:20.425071+0000","last_became_peered":"2024-04-26T21:16:20.425071+0000","last_unstale":"2024-04-26T21:16:25.814481+0000","last_undegraded":"2024-04-26T21:16:25.814481+0000","last_fullsized":"2024-04-26T21:16:25.814481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816253+0000","last_change":"2024-04-26T21:16:19.408668+0000","last_active":"2024-04-26T21:16:25.816253+0000","last_peered":"2024-04-26T21:16:25.816253+0000","last_clean":"2024-04-26T21:16:25.816253+0000","last_became_active":"2024-04-26T21:16:19.408363+0000","last_became_peered":"2024-04-26T21:16:19.408363+0000","last_unstale":"2024-04-26T21:16:25.816253+0000","last_undegraded":"2024-04-26T21:16:25.816253+0000","last_fullsized":"2024-04-26T21:16:25.816253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435906+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:16:25.435906+0000","last_peered":"2024-04-26T21:16:25.435906+0000","last_clean":"2024-04-26T21:16:25.435906+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:16:25.435906+0000","last_undegraded":"2024-04-26T21:16:25.435906+0000","last_fullsized":"2024-04-26T21:16:25.435906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434338+0000","last_change":"2024-04-26T21:16:24.452049+0000","last_active":"2024-04-26T21:16:25.434338+0000","last_peered":"2024-04-26T21:16:25.434338+0000","last_clean":"2024-04-26T21:16:25.434338+0000","last_became_active":"2024-04-26T21:16:24.451479+0000","last_became_peered":"2024-04-26T21:16:24.451479+0000","last_unstale":"2024-04-26T21:16:25.434338+0000","last_undegraded":"2024-04-26T21:16:25.434338+0000","last_fullsized":"2024-04-26T21:16:25.434338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:49.007056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436447+0000","last_change":"2024-04-26T21:16:20.425471+0000","last_active":"2024-04-26T21:16:25.436447+0000","last_peered":"2024-04-26T21:16:25.436447+0000","last_clean":"2024-04-26T21:16:25.436447+0000","last_became_active":"2024-04-26T21:16:20.425139+0000","last_became_peered":"2024-04-26T21:16:20.425139+0000","last_unstale":"2024-04-26T21:16:25.436447+0000","last_undegraded":"2024-04-26T21:16:25.436447+0000","last_fullsized":"2024-04-26T21:16:25.436447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:44.971333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815036+0000","last_change":"2024-04-26T21:16:19.405872+0000","last_active":"2024-04-26T21:16:25.815036+0000","last_peered":"2024-04-26T21:16:25.815036+0000","last_clean":"2024-04-26T21:16:25.815036+0000","last_became_active":"2024-04-26T21:16:19.405574+0000","last_became_peered":"2024-04-26T21:16:19.405574+0000","last_unstale":"2024-04-26T21:16:25.815036+0000","last_undegraded":"2024-04-26T21:16:25.815036+0000","last_fullsized":"2024-04-26T21:16:25.815036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:11.405759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433802+0000","last_change":"2024-04-26T21:16:24.452916+0000","last_active":"2024-04-26T21:16:25.433802+0000","last_peered":"2024-04-26T21:16:25.433802+0000","last_clean":"2024-04-26T21:16:25.433802+0000","last_became_active":"2024-04-26T21:16:24.452500+0000","last_became_peered":"2024-04-26T21:16:24.452500+0000","last_unstale":"2024-04-26T21:16:25.433802+0000","last_undegraded":"2024-04-26T21:16:25.433802+0000","last_fullsized":"2024-04-26T21:16:25.433802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:07.354698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816437+0000","last_change":"2024-04-26T21:16:20.434192+0000","last_active":"2024-04-26T21:16:25.816437+0000","last_peered":"2024-04-26T21:16:25.816437+0000","last_clean":"2024-04-26T21:16:25.816437+0000","last_became_active":"2024-04-26T21:16:20.433657+0000","last_became_peered":"2024-04-26T21:16:20.433657+0000","last_unstale":"2024-04-26T21:16:25.816437+0000","last_undegraded":"2024-04-26T21:16:25.816437+0000","last_fullsized":"2024-04-26T21:16:25.816437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:54.005276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801434+0000","last_change":"2024-04-26T21:16:19.403457+0000","last_active":"2024-04-26T21:16:25.801434+0000","last_peered":"2024-04-26T21:16:25.801434+0000","last_clean":"2024-04-26T21:16:25.801434+0000","last_became_active":"2024-04-26T21:16:19.402886+0000","last_became_peered":"2024-04-26T21:16:19.402886+0000","last_unstale":"2024-04-26T21:16:25.801434+0000","last_undegraded":"2024-04-26T21:16:25.801434+0000","last_fullsized":"2024-04-26T21:16:25.801434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816954+0000","last_change":"2024-04-26T21:16:24.454078+0000","last_active":"2024-04-26T21:16:25.816954+0000","last_peered":"2024-04-26T21:16:25.816954+0000","last_clean":"2024-04-26T21:16:25.816954+0000","last_became_active":"2024-04-26T21:16:24.453726+0000","last_became_peered":"2024-04-26T21:16:24.453726+0000","last_unstale":"2024-04-26T21:16:25.816954+0000","last_undegraded":"2024-04-26T21:16:25.816954+0000","last_fullsized":"2024-04-26T21:16:25.816954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:45.803476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436898+0000","last_change":"2024-04-26T21:16:20.415657+0000","last_active":"2024-04-26T21:16:25.436898+0000","last_peered":"2024-04-26T21:16:25.436898+0000","last_clean":"2024-04-26T21:16:25.436898+0000","last_became_active":"2024-04-26T21:16:20.415241+0000","last_became_peered":"2024-04-26T21:16:20.415241+0000","last_unstale":"2024-04-26T21:16:25.436898+0000","last_undegraded":"2024-04-26T21:16:25.436898+0000","last_fullsized":"2024-04-26T21:16:25.436898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:27.294527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815326+0000","last_change":"2024-04-26T21:16:19.398067+0000","last_active":"2024-04-26T21:16:25.815326+0000","last_peered":"2024-04-26T21:16:25.815326+0000","last_clean":"2024-04-26T21:16:25.815326+0000","last_became_active":"2024-04-26T21:16:19.397685+0000","last_became_peered":"2024-04-26T21:16:19.397685+0000","last_unstale":"2024-04-26T21:16:25.815326+0000","last_undegraded":"2024-04-26T21:16:25.815326+0000","last_fullsized":"2024-04-26T21:16:25.815326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:38.089679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815875+0000","last_change":"2024-04-26T21:16:24.450492+0000","last_active":"2024-04-26T21:16:25.815875+0000","last_peered":"2024-04-26T21:16:25.815875+0000","last_clean":"2024-04-26T21:16:25.815875+0000","last_became_active":"2024-04-26T21:16:24.450086+0000","last_became_peered":"2024-04-26T21:16:24.450086+0000","last_unstale":"2024-04-26T21:16:25.815875+0000","last_undegraded":"2024-04-26T21:16:25.815875+0000","last_fullsized":"2024-04-26T21:16:25.815875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436736+0000","last_change":"2024-04-26T21:16:20.422919+0000","last_active":"2024-04-26T21:16:25.436736+0000","last_peered":"2024-04-26T21:16:25.436736+0000","last_clean":"2024-04-26T21:16:25.436736+0000","last_became_active":"2024-04-26T21:16:20.422606+0000","last_became_peered":"2024-04-26T21:16:20.422606+0000","last_unstale":"2024-04-26T21:16:25.436736+0000","last_undegraded":"2024-04-26T21:16:25.436736+0000","last_fullsized":"2024-04-26T21:16:25.436736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:54.005276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434221+0000","last_change":"2024-04-26T21:16:19.409935+0000","last_active":"2024-04-26T21:16:25.434221+0000","last_peered":"2024-04-26T21:16:25.434221+0000","last_clean":"2024-04-26T21:16:25.434221+0000","last_became_active":"2024-04-26T21:16:19.409636+0000","last_became_peered":"2024-04-26T21:16:19.409636+0000","last_unstale":"2024-04-26T21:16:25.434221+0000","last_undegraded":"2024-04-26T21:16:25.434221+0000","last_fullsized":"2024-04-26T21:16:25.434221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:24.652333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434240+0000","last_change":"2024-04-26T21:16:24.462022+0000","last_active":"2024-04-26T21:16:25.434240+0000","last_peered":"2024-04-26T21:16:25.434240+0000","last_clean":"2024-04-26T21:16:25.434240+0000","last_became_active":"2024-04-26T21:16:24.461691+0000","last_became_peered":"2024-04-26T21:16:24.461691+0000","last_unstale":"2024-04-26T21:16:25.434240+0000","last_undegraded":"2024-04-26T21:16:25.434240+0000","last_fullsized":"2024-04-26T21:16:25.434240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:35.967648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435773+0000","last_change":"2024-04-26T21:16:20.406585+0000","last_active":"2024-04-26T21:16:25.435773+0000","last_peered":"2024-04-26T21:16:25.435773+0000","last_clean":"2024-04-26T21:16:25.435773+0000","last_became_active":"2024-04-26T21:16:20.406265+0000","last_became_peered":"2024-04-26T21:16:20.406265+0000","last_unstale":"2024-04-26T21:16:25.435773+0000","last_undegraded":"2024-04-26T21:16:25.435773+0000","last_fullsized":"2024-04-26T21:16:25.435773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814382+0000","last_change":"2024-04-26T21:16:19.395551+0000","last_active":"2024-04-26T21:16:25.814382+0000","last_peered":"2024-04-26T21:16:25.814382+0000","last_clean":"2024-04-26T21:16:25.814382+0000","last_became_active":"2024-04-26T21:16:19.393831+0000","last_became_peered":"2024-04-26T21:16:19.393831+0000","last_unstale":"2024-04-26T21:16:25.814382+0000","last_undegraded":"2024-04-26T21:16:25.814382+0000","last_fullsized":"2024-04-26T21:16:25.814382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:53.258420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817267+0000","last_change":"2024-04-26T21:16:24.452943+0000","last_active":"2024-04-26T21:16:25.817267+0000","last_peered":"2024-04-26T21:16:25.817267+0000","last_clean":"2024-04-26T21:16:25.817267+0000","last_became_active":"2024-04-26T21:16:24.452603+0000","last_became_peered":"2024-04-26T21:16:24.452603+0000","last_unstale":"2024-04-26T21:16:25.817267+0000","last_undegraded":"2024-04-26T21:16:25.817267+0000","last_fullsized":"2024-04-26T21:16:25.817267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433930+0000","last_change":"2024-04-26T21:16:20.410601+0000","last_active":"2024-04-26T21:16:25.433930+0000","last_peered":"2024-04-26T21:16:25.433930+0000","last_clean":"2024-04-26T21:16:25.433930+0000","last_became_active":"2024-04-26T21:16:20.410197+0000","last_became_peered":"2024-04-26T21:16:20.410197+0000","last_unstale":"2024-04-26T21:16:25.433930+0000","last_undegraded":"2024-04-26T21:16:25.433930+0000","last_fullsized":"2024-04-26T21:16:25.433930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433955+0000","last_change":"2024-04-26T21:16:19.413099+0000","last_active":"2024-04-26T21:16:25.433955+0000","last_peered":"2024-04-26T21:16:25.433955+0000","last_clean":"2024-04-26T21:16:25.433955+0000","last_became_active":"2024-04-26T21:16:19.412695+0000","last_became_peered":"2024-04-26T21:16:19.412695+0000","last_unstale":"2024-04-26T21:16:25.433955+0000","last_undegraded":"2024-04-26T21:16:25.433955+0000","last_fullsized":"2024-04-26T21:16:25.433955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:01.796435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815773+0000","last_change":"2024-04-26T21:16:24.446231+0000","last_active":"2024-04-26T21:16:25.815773+0000","last_peered":"2024-04-26T21:16:25.815773+0000","last_clean":"2024-04-26T21:16:25.815773+0000","last_became_active":"2024-04-26T21:16:24.445743+0000","last_became_peered":"2024-04-26T21:16:24.445743+0000","last_unstale":"2024-04-26T21:16:25.815773+0000","last_undegraded":"2024-04-26T21:16:25.815773+0000","last_fullsized":"2024-04-26T21:16:25.815773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:27.238080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436166+0000","last_change":"2024-04-26T21:16:20.423076+0000","last_active":"2024-04-26T21:16:25.436166+0000","last_peered":"2024-04-26T21:16:25.436166+0000","last_clean":"2024-04-26T21:16:25.436166+0000","last_became_active":"2024-04-26T21:16:20.422476+0000","last_became_peered":"2024-04-26T21:16:20.422476+0000","last_unstale":"2024-04-26T21:16:25.436166+0000","last_undegraded":"2024-04-26T21:16:25.436166+0000","last_fullsized":"2024-04-26T21:16:25.436166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816169+0000","last_change":"2024-04-26T21:16:19.406614+0000","last_active":"2024-04-26T21:16:25.816169+0000","last_peered":"2024-04-26T21:16:25.816169+0000","last_clean":"2024-04-26T21:16:25.816169+0000","last_became_active":"2024-04-26T21:16:19.403274+0000","last_became_peered":"2024-04-26T21:16:19.403274+0000","last_unstale":"2024-04-26T21:16:25.816169+0000","last_undegraded":"2024-04-26T21:16:25.816169+0000","last_fullsized":"2024-04-26T21:16:25.816169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.745443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815305+0000","last_change":"2024-04-26T21:16:24.451820+0000","last_active":"2024-04-26T21:16:25.815305+0000","last_peered":"2024-04-26T21:16:25.815305+0000","last_clean":"2024-04-26T21:16:25.815305+0000","last_became_active":"2024-04-26T21:16:24.451472+0000","last_became_peered":"2024-04-26T21:16:24.451472+0000","last_unstale":"2024-04-26T21:16:25.815305+0000","last_undegraded":"2024-04-26T21:16:25.815305+0000","last_fullsized":"2024-04-26T21:16:25.815305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:09.977865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816825+0000","last_change":"2024-04-26T21:16:20.425068+0000","last_active":"2024-04-26T21:16:25.816825+0000","last_peered":"2024-04-26T21:16:25.816825+0000","last_clean":"2024-04-26T21:16:25.816825+0000","last_became_active":"2024-04-26T21:16:20.424773+0000","last_became_peered":"2024-04-26T21:16:20.424773+0000","last_unstale":"2024-04-26T21:16:25.816825+0000","last_undegraded":"2024-04-26T21:16:25.816825+0000","last_fullsized":"2024-04-26T21:16:25.816825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817008+0000","last_change":"2024-04-26T21:16:19.413580+0000","last_active":"2024-04-26T21:16:25.817008+0000","last_peered":"2024-04-26T21:16:25.817008+0000","last_clean":"2024-04-26T21:16:25.817008+0000","last_became_active":"2024-04-26T21:16:19.412636+0000","last_became_peered":"2024-04-26T21:16:19.412636+0000","last_unstale":"2024-04-26T21:16:25.817008+0000","last_undegraded":"2024-04-26T21:16:25.817008+0000","last_fullsized":"2024-04-26T21:16:25.817008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:06.128835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816582+0000","last_change":"2024-04-26T21:16:24.456301+0000","last_active":"2024-04-26T21:16:25.816582+0000","last_peered":"2024-04-26T21:16:25.816582+0000","last_clean":"2024-04-26T21:16:25.816582+0000","last_became_active":"2024-04-26T21:16:24.455115+0000","last_became_peered":"2024-04-26T21:16:24.455115+0000","last_unstale":"2024-04-26T21:16:25.816582+0000","last_undegraded":"2024-04-26T21:16:25.816582+0000","last_fullsized":"2024-04-26T21:16:25.816582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:58.709336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436405+0000","last_change":"2024-04-26T21:16:20.404787+0000","last_active":"2024-04-26T21:16:25.436405+0000","last_peered":"2024-04-26T21:16:25.436405+0000","last_clean":"2024-04-26T21:16:25.436405+0000","last_became_active":"2024-04-26T21:16:20.404355+0000","last_became_peered":"2024-04-26T21:16:20.404355+0000","last_unstale":"2024-04-26T21:16:25.436405+0000","last_undegraded":"2024-04-26T21:16:25.436405+0000","last_fullsized":"2024-04-26T21:16:25.436405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:03.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:35.742110+0000","last_change":"2024-04-26T21:16:19.407394+0000","last_active":"2024-04-26T21:16:35.742110+0000","last_peered":"2024-04-26T21:16:35.742110+0000","last_clean":"2024-04-26T21:16:35.742110+0000","last_became_active":"2024-04-26T21:16:19.407056+0000","last_became_peered":"2024-04-26T21:16:19.407056+0000","last_unstale":"2024-04-26T21:16:35.742110+0000","last_undegraded":"2024-04-26T21:16:35.742110+0000","last_fullsized":"2024-04-26T21:16:35.742110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801146+0000","last_change":"2024-04-26T21:16:24.460241+0000","last_active":"2024-04-26T21:16:25.801146+0000","last_peered":"2024-04-26T21:16:25.801146+0000","last_clean":"2024-04-26T21:16:25.801146+0000","last_became_active":"2024-04-26T21:16:24.459738+0000","last_became_peered":"2024-04-26T21:16:24.459738+0000","last_unstale":"2024-04-26T21:16:25.801146+0000","last_undegraded":"2024-04-26T21:16:25.801146+0000","last_fullsized":"2024-04-26T21:16:25.801146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:13.640693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434981+0000","last_change":"2024-04-26T21:16:20.430119+0000","last_active":"2024-04-26T21:16:25.434981+0000","last_peered":"2024-04-26T21:16:25.434981+0000","last_clean":"2024-04-26T21:16:25.434981+0000","last_became_active":"2024-04-26T21:16:20.429573+0000","last_became_peered":"2024-04-26T21:16:20.429573+0000","last_unstale":"2024-04-26T21:16:25.434981+0000","last_undegraded":"2024-04-26T21:16:25.434981+0000","last_fullsized":"2024-04-26T21:16:25.434981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:39.450737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801403+0000","last_change":"2024-04-26T21:16:19.405677+0000","last_active":"2024-04-26T21:16:25.801403+0000","last_peered":"2024-04-26T21:16:25.801403+0000","last_clean":"2024-04-26T21:16:25.801403+0000","last_became_active":"2024-04-26T21:16:19.405168+0000","last_became_peered":"2024-04-26T21:16:19.405168+0000","last_unstale":"2024-04-26T21:16:25.801403+0000","last_undegraded":"2024-04-26T21:16:25.801403+0000","last_fullsized":"2024-04-26T21:16:25.801403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:39.643642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434637+0000","last_change":"2024-04-26T21:16:24.462415+0000","last_active":"2024-04-26T21:16:25.434637+0000","last_peered":"2024-04-26T21:16:25.434637+0000","last_clean":"2024-04-26T21:16:25.434637+0000","last_became_active":"2024-04-26T21:16:24.462047+0000","last_became_peered":"2024-04-26T21:16:24.462047+0000","last_unstale":"2024-04-26T21:16:25.434637+0000","last_undegraded":"2024-04-26T21:16:25.434637+0000","last_fullsized":"2024-04-26T21:16:25.434637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:50.269287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817452+0000","last_change":"2024-04-26T21:16:20.423947+0000","last_active":"2024-04-26T21:16:25.817452+0000","last_peered":"2024-04-26T21:16:25.817452+0000","last_clean":"2024-04-26T21:16:25.817452+0000","last_became_active":"2024-04-26T21:16:20.423647+0000","last_became_peered":"2024-04-26T21:16:20.423647+0000","last_unstale":"2024-04-26T21:16:25.817452+0000","last_undegraded":"2024-04-26T21:16:25.817452+0000","last_fullsized":"2024-04-26T21:16:25.817452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816645+0000","last_change":"2024-04-26T21:16:19.403292+0000","last_active":"2024-04-26T21:16:25.816645+0000","last_peered":"2024-04-26T21:16:25.816645+0000","last_clean":"2024-04-26T21:16:25.816645+0000","last_became_active":"2024-04-26T21:16:19.402784+0000","last_became_peered":"2024-04-26T21:16:19.402784+0000","last_unstale":"2024-04-26T21:16:25.816645+0000","last_undegraded":"2024-04-26T21:16:25.816645+0000","last_fullsized":"2024-04-26T21:16:25.816645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814330+0000","last_change":"2024-04-26T21:16:24.456302+0000","last_active":"2024-04-26T21:16:25.814330+0000","last_peered":"2024-04-26T21:16:25.814330+0000","last_clean":"2024-04-26T21:16:25.814330+0000","last_became_active":"2024-04-26T21:16:24.456017+0000","last_became_peered":"2024-04-26T21:16:24.456017+0000","last_unstale":"2024-04-26T21:16:25.814330+0000","last_undegraded":"2024-04-26T21:16:25.814330+0000","last_fullsized":"2024-04-26T21:16:25.814330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:17.487265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816540+0000","last_change":"2024-04-26T21:16:20.425747+0000","last_active":"2024-04-26T21:16:25.816540+0000","last_peered":"2024-04-26T21:16:25.816540+0000","last_clean":"2024-04-26T21:16:25.816540+0000","last_became_active":"2024-04-26T21:16:20.425488+0000","last_became_peered":"2024-04-26T21:16:20.425488+0000","last_unstale":"2024-04-26T21:16:25.816540+0000","last_undegraded":"2024-04-26T21:16:25.816540+0000","last_fullsized":"2024-04-26T21:16:25.816540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:44.971333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435140+0000","last_change":"2024-04-26T21:16:19.406087+0000","last_active":"2024-04-26T21:16:25.435140+0000","last_peered":"2024-04-26T21:16:25.435140+0000","last_clean":"2024-04-26T21:16:25.435140+0000","last_became_active":"2024-04-26T21:16:19.405864+0000","last_became_peered":"2024-04-26T21:16:19.405864+0000","last_unstale":"2024-04-26T21:16:25.435140+0000","last_undegraded":"2024-04-26T21:16:25.435140+0000","last_fullsized":"2024-04-26T21:16:25.435140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:10.856958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814623+0000","last_change":"2024-04-26T21:16:24.448037+0000","last_active":"2024-04-26T21:16:25.814623+0000","last_peered":"2024-04-26T21:16:25.814623+0000","last_clean":"2024-04-26T21:16:25.814623+0000","last_became_active":"2024-04-26T21:16:24.447296+0000","last_became_peered":"2024-04-26T21:16:24.447296+0000","last_unstale":"2024-04-26T21:16:25.814623+0000","last_undegraded":"2024-04-26T21:16:25.814623+0000","last_fullsized":"2024-04-26T21:16:25.814623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:07.159212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817154+0000","last_change":"2024-04-26T21:16:24.459333+0000","last_active":"2024-04-26T21:16:25.817154+0000","last_peered":"2024-04-26T21:16:25.817154+0000","last_clean":"2024-04-26T21:16:25.817154+0000","last_became_active":"2024-04-26T21:16:24.458880+0000","last_became_peered":"2024-04-26T21:16:24.458880+0000","last_unstale":"2024-04-26T21:16:25.817154+0000","last_undegraded":"2024-04-26T21:16:25.817154+0000","last_fullsized":"2024-04-26T21:16:25.817154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:31.330251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800771+0000","last_change":"2024-04-26T21:16:20.403324+0000","last_active":"2024-04-26T21:16:25.800771+0000","last_peered":"2024-04-26T21:16:25.800771+0000","last_clean":"2024-04-26T21:16:25.800771+0000","last_became_active":"2024-04-26T21:16:20.403028+0000","last_became_peered":"2024-04-26T21:16:20.403028+0000","last_unstale":"2024-04-26T21:16:25.800771+0000","last_undegraded":"2024-04-26T21:16:25.800771+0000","last_fullsized":"2024-04-26T21:16:25.800771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816007+0000","last_change":"2024-04-26T21:16:19.399594+0000","last_active":"2024-04-26T21:16:25.816007+0000","last_peered":"2024-04-26T21:16:25.816007+0000","last_clean":"2024-04-26T21:16:25.816007+0000","last_became_active":"2024-04-26T21:16:19.399283+0000","last_became_peered":"2024-04-26T21:16:19.399283+0000","last_unstale":"2024-04-26T21:16:25.816007+0000","last_undegraded":"2024-04-26T21:16:25.816007+0000","last_fullsized":"2024-04-26T21:16:25.816007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:42.509922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435033+0000","last_change":"2024-04-26T21:16:24.452081+0000","last_active":"2024-04-26T21:16:25.435033+0000","last_peered":"2024-04-26T21:16:25.435033+0000","last_clean":"2024-04-26T21:16:25.435033+0000","last_became_active":"2024-04-26T21:16:24.451654+0000","last_became_peered":"2024-04-26T21:16:24.451654+0000","last_unstale":"2024-04-26T21:16:25.435033+0000","last_undegraded":"2024-04-26T21:16:25.435033+0000","last_fullsized":"2024-04-26T21:16:25.435033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:58.040999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814302+0000","last_change":"2024-04-26T21:16:20.412643+0000","last_active":"2024-04-26T21:16:25.814302+0000","last_peered":"2024-04-26T21:16:25.814302+0000","last_clean":"2024-04-26T21:16:25.814302+0000","last_became_active":"2024-04-26T21:16:20.412229+0000","last_became_peered":"2024-04-26T21:16:20.412229+0000","last_unstale":"2024-04-26T21:16:25.814302+0000","last_undegraded":"2024-04-26T21:16:25.814302+0000","last_fullsized":"2024-04-26T21:16:25.814302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814684+0000","last_change":"2024-04-26T21:16:19.404756+0000","last_active":"2024-04-26T21:16:25.814684+0000","last_peered":"2024-04-26T21:16:25.814684+0000","last_clean":"2024-04-26T21:16:25.814684+0000","last_became_active":"2024-04-26T21:16:19.404480+0000","last_became_peered":"2024-04-26T21:16:19.404480+0000","last_unstale":"2024-04-26T21:16:25.814684+0000","last_undegraded":"2024-04-26T21:16:25.814684+0000","last_fullsized":"2024-04-26T21:16:25.814684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:06.128835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434093+0000","last_change":"2024-04-26T21:16:19.409681+0000","last_active":"2024-04-26T21:16:25.434093+0000","last_peered":"2024-04-26T21:16:25.434093+0000","last_clean":"2024-04-26T21:16:25.434093+0000","last_became_active":"2024-04-26T21:16:19.409425+0000","last_became_peered":"2024-04-26T21:16:19.409425+0000","last_unstale":"2024-04-26T21:16:25.434093+0000","last_undegraded":"2024-04-26T21:16:25.434093+0000","last_fullsized":"2024-04-26T21:16:25.434093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:50.050147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816993+0000","last_change":"2024-04-26T21:16:20.414103+0000","last_active":"2024-04-26T21:16:25.816993+0000","last_peered":"2024-04-26T21:16:25.816993+0000","last_clean":"2024-04-26T21:16:25.816993+0000","last_became_active":"2024-04-26T21:16:20.413448+0000","last_became_peered":"2024-04-26T21:16:20.413448+0000","last_unstale":"2024-04-26T21:16:25.816993+0000","last_undegraded":"2024-04-26T21:16:25.816993+0000","last_fullsized":"2024-04-26T21:16:25.816993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814945+0000","last_change":"2024-04-26T21:16:24.460713+0000","last_active":"2024-04-26T21:16:25.814945+0000","last_peered":"2024-04-26T21:16:25.814945+0000","last_clean":"2024-04-26T21:16:25.814945+0000","last_became_active":"2024-04-26T21:16:24.460386+0000","last_became_peered":"2024-04-26T21:16:24.460386+0000","last_unstale":"2024-04-26T21:16:25.814945+0000","last_undegraded":"2024-04-26T21:16:25.814945+0000","last_fullsized":"2024-04-26T21:16:25.814945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:04.230303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815685+0000","last_change":"2024-04-26T21:16:19.406024+0000","last_active":"2024-04-26T21:16:25.815685+0000","last_peered":"2024-04-26T21:16:25.815685+0000","last_clean":"2024-04-26T21:16:25.815685+0000","last_became_active":"2024-04-26T21:16:19.405711+0000","last_became_peered":"2024-04-26T21:16:19.405711+0000","last_unstale":"2024-04-26T21:16:25.815685+0000","last_undegraded":"2024-04-26T21:16:25.815685+0000","last_fullsized":"2024-04-26T21:16:25.815685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:18.366338+0000","last_clean_scrub_stamp":"2024-04-26T21:16:18.366338+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:36.055875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435119+0000","last_change":"2024-04-26T21:16:20.418241+0000","last_active":"2024-04-26T21:16:25.435119+0000","last_peered":"2024-04-26T21:16:25.435119+0000","last_clean":"2024-04-26T21:16:25.435119+0000","last_became_active":"2024-04-26T21:16:20.417321+0000","last_became_peered":"2024-04-26T21:16:20.417321+0000","last_unstale":"2024-04-26T21:16:25.435119+0000","last_undegraded":"2024-04-26T21:16:25.435119+0000","last_fullsized":"2024-04-26T21:16:25.435119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:11.862489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815612+0000","last_change":"2024-04-26T21:16:24.459831+0000","last_active":"2024-04-26T21:16:25.815612+0000","last_peered":"2024-04-26T21:16:25.815612+0000","last_clean":"2024-04-26T21:16:25.815612+0000","last_became_active":"2024-04-26T21:16:24.459065+0000","last_became_peered":"2024-04-26T21:16:24.459065+0000","last_unstale":"2024-04-26T21:16:25.815612+0000","last_undegraded":"2024-04-26T21:16:25.815612+0000","last_fullsized":"2024-04-26T21:16:25.815612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:23.407592+0000","last_clean_scrub_stamp":"2024-04-26T21:16:23.407592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:22.852921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.433775+0000","last_change":"2024-04-26T21:16:20.409734+0000","last_active":"2024-04-26T21:16:25.433775+0000","last_peered":"2024-04-26T21:16:25.433775+0000","last_clean":"2024-04-26T21:16:25.433775+0000","last_became_active":"2024-04-26T21:16:20.409468+0000","last_became_peered":"2024-04-26T21:16:20.409468+0000","last_unstale":"2024-04-26T21:16:25.433775+0000","last_undegraded":"2024-04-26T21:16:25.433775+0000","last_fullsized":"2024-04-26T21:16:25.433775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814266+0000","last_change":"2024-04-26T21:16:20.415585+0000","last_active":"2024-04-26T21:16:25.814266+0000","last_peered":"2024-04-26T21:16:25.814266+0000","last_clean":"2024-04-26T21:16:25.814266+0000","last_became_active":"2024-04-26T21:16:20.415303+0000","last_became_peered":"2024-04-26T21:16:20.415303+0000","last_unstale":"2024-04-26T21:16:25.814266+0000","last_undegraded":"2024-04-26T21:16:25.814266+0000","last_fullsized":"2024-04-26T21:16:25.814266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:19:56.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816116+0000","last_change":"2024-04-26T21:16:20.420522+0000","last_active":"2024-04-26T21:16:25.816116+0000","last_peered":"2024-04-26T21:16:25.816116+0000","last_clean":"2024-04-26T21:16:25.816116+0000","last_became_active":"2024-04-26T21:16:20.420320+0000","last_became_peered":"2024-04-26T21:16:20.420320+0000","last_unstale":"2024-04-26T21:16:25.816116+0000","last_undegraded":"2024-04-26T21:16:25.816116+0000","last_fullsized":"2024-04-26T21:16:25.816116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816909+0000","last_change":"2024-04-26T21:16:20.414468+0000","last_active":"2024-04-26T21:16:25.816909+0000","last_peered":"2024-04-26T21:16:25.816909+0000","last_clean":"2024-04-26T21:16:25.816909+0000","last_became_active":"2024-04-26T21:16:20.413736+0000","last_became_peered":"2024-04-26T21:16:20.413736+0000","last_unstale":"2024-04-26T21:16:25.816909+0000","last_undegraded":"2024-04-26T21:16:25.816909+0000","last_fullsized":"2024-04-26T21:16:25.816909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815404+0000","last_change":"2024-04-26T21:16:20.409323+0000","last_active":"2024-04-26T21:16:25.815404+0000","last_peered":"2024-04-26T21:16:25.815404+0000","last_clean":"2024-04-26T21:16:25.815404+0000","last_became_active":"2024-04-26T21:16:20.408990+0000","last_became_peered":"2024-04-26T21:16:20.408990+0000","last_unstale":"2024-04-26T21:16:25.815404+0000","last_undegraded":"2024-04-26T21:16:25.815404+0000","last_fullsized":"2024-04-26T21:16:25.815404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801281+0000","last_change":"2024-04-26T21:16:20.404357+0000","last_active":"2024-04-26T21:16:25.801281+0000","last_peered":"2024-04-26T21:16:25.801281+0000","last_clean":"2024-04-26T21:16:25.801281+0000","last_became_active":"2024-04-26T21:16:20.404167+0000","last_became_peered":"2024-04-26T21:16:20.404167+0000","last_unstale":"2024-04-26T21:16:25.801281+0000","last_undegraded":"2024-04-26T21:16:25.801281+0000","last_fullsized":"2024-04-26T21:16:25.801281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434733+0000","last_change":"2024-04-26T21:16:20.425686+0000","last_active":"2024-04-26T21:16:25.434733+0000","last_peered":"2024-04-26T21:16:25.434733+0000","last_clean":"2024-04-26T21:16:25.434733+0000","last_became_active":"2024-04-26T21:16:20.425371+0000","last_became_peered":"2024-04-26T21:16:20.425371+0000","last_unstale":"2024-04-26T21:16:25.434733+0000","last_undegraded":"2024-04-26T21:16:25.434733+0000","last_fullsized":"2024-04-26T21:16:25.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815714+0000","last_change":"2024-04-26T21:16:20.409302+0000","last_active":"2024-04-26T21:16:25.815714+0000","last_peered":"2024-04-26T21:16:25.815714+0000","last_clean":"2024-04-26T21:16:25.815714+0000","last_became_active":"2024-04-26T21:16:20.409004+0000","last_became_peered":"2024-04-26T21:16:20.409004+0000","last_unstale":"2024-04-26T21:16:25.815714+0000","last_undegraded":"2024-04-26T21:16:25.815714+0000","last_fullsized":"2024-04-26T21:16:25.815714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815954+0000","last_change":"2024-04-26T21:16:20.422765+0000","last_active":"2024-04-26T21:16:25.815954+0000","last_peered":"2024-04-26T21:16:25.815954+0000","last_clean":"2024-04-26T21:16:25.815954+0000","last_became_active":"2024-04-26T21:16:20.422225+0000","last_became_peered":"2024-04-26T21:16:20.422225+0000","last_unstale":"2024-04-26T21:16:25.815954+0000","last_undegraded":"2024-04-26T21:16:25.815954+0000","last_fullsized":"2024-04-26T21:16:25.815954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:46.233564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814587+0000","last_change":"2024-04-26T21:16:20.410383+0000","last_active":"2024-04-26T21:16:25.814587+0000","last_peered":"2024-04-26T21:16:25.814587+0000","last_clean":"2024-04-26T21:16:25.814587+0000","last_became_active":"2024-04-26T21:16:20.409668+0000","last_became_peered":"2024-04-26T21:16:20.409668+0000","last_unstale":"2024-04-26T21:16:25.814587+0000","last_undegraded":"2024-04-26T21:16:25.814587+0000","last_fullsized":"2024-04-26T21:16:25.814587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816058+0000","last_change":"2024-04-26T21:16:20.428016+0000","last_active":"2024-04-26T21:16:25.816058+0000","last_peered":"2024-04-26T21:16:25.816058+0000","last_clean":"2024-04-26T21:16:25.816058+0000","last_became_active":"2024-04-26T21:16:20.427562+0000","last_became_peered":"2024-04-26T21:16:20.427562+0000","last_unstale":"2024-04-26T21:16:25.816058+0000","last_undegraded":"2024-04-26T21:16:25.816058+0000","last_fullsized":"2024-04-26T21:16:25.816058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:25.013588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816756+0000","last_change":"2024-04-26T21:16:20.425316+0000","last_active":"2024-04-26T21:16:25.816756+0000","last_peered":"2024-04-26T21:16:25.816756+0000","last_clean":"2024-04-26T21:16:25.816756+0000","last_became_active":"2024-04-26T21:16:20.425008+0000","last_became_peered":"2024-04-26T21:16:20.425008+0000","last_unstale":"2024-04-26T21:16:25.816756+0000","last_undegraded":"2024-04-26T21:16:25.816756+0000","last_fullsized":"2024-04-26T21:16:25.816756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:49.076716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434193+0000","last_change":"2024-04-26T21:16:20.406211+0000","last_active":"2024-04-26T21:16:25.434193+0000","last_peered":"2024-04-26T21:16:25.434193+0000","last_clean":"2024-04-26T21:16:25.434193+0000","last_became_active":"2024-04-26T21:16:20.405903+0000","last_became_peered":"2024-04-26T21:16:20.405903+0000","last_unstale":"2024-04-26T21:16:25.434193+0000","last_undegraded":"2024-04-26T21:16:25.434193+0000","last_fullsized":"2024-04-26T21:16:25.434193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436716+0000","last_change":"2024-04-26T21:16:20.407047+0000","last_active":"2024-04-26T21:16:25.436716+0000","last_peered":"2024-04-26T21:16:25.436716+0000","last_clean":"2024-04-26T21:16:25.436716+0000","last_became_active":"2024-04-26T21:16:20.404541+0000","last_became_peered":"2024-04-26T21:16:20.404541+0000","last_unstale":"2024-04-26T21:16:25.436716+0000","last_undegraded":"2024-04-26T21:16:25.436716+0000","last_fullsized":"2024-04-26T21:16:25.436716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:09.604970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815290+0000","last_change":"2024-04-26T21:16:20.398199+0000","last_active":"2024-04-26T21:16:25.815290+0000","last_peered":"2024-04-26T21:16:25.815290+0000","last_clean":"2024-04-26T21:16:25.815290+0000","last_became_active":"2024-04-26T21:16:20.397910+0000","last_became_peered":"2024-04-26T21:16:20.397910+0000","last_unstale":"2024-04-26T21:16:25.815290+0000","last_undegraded":"2024-04-26T21:16:25.815290+0000","last_fullsized":"2024-04-26T21:16:25.815290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:09.155471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816910+0000","last_change":"2024-04-26T21:16:20.433837+0000","last_active":"2024-04-26T21:16:25.816910+0000","last_peered":"2024-04-26T21:16:25.816910+0000","last_clean":"2024-04-26T21:16:25.816910+0000","last_became_active":"2024-04-26T21:16:20.433536+0000","last_became_peered":"2024-04-26T21:16:20.433536+0000","last_unstale":"2024-04-26T21:16:25.816910+0000","last_undegraded":"2024-04-26T21:16:25.816910+0000","last_fullsized":"2024-04-26T21:16:25.816910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:58.416107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815843+0000","last_change":"2024-04-26T21:16:20.422532+0000","last_active":"2024-04-26T21:16:25.815843+0000","last_peered":"2024-04-26T21:16:25.815843+0000","last_clean":"2024-04-26T21:16:25.815843+0000","last_became_active":"2024-04-26T21:16:20.421767+0000","last_became_peered":"2024-04-26T21:16:20.421767+0000","last_unstale":"2024-04-26T21:16:25.815843+0000","last_undegraded":"2024-04-26T21:16:25.815843+0000","last_fullsized":"2024-04-26T21:16:25.815843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.800845+0000","last_change":"2024-04-26T21:16:20.413673+0000","last_active":"2024-04-26T21:16:25.800845+0000","last_peered":"2024-04-26T21:16:25.800845+0000","last_clean":"2024-04-26T21:16:25.800845+0000","last_became_active":"2024-04-26T21:16:20.413331+0000","last_became_peered":"2024-04-26T21:16:20.413331+0000","last_unstale":"2024-04-26T21:16:25.800845+0000","last_undegraded":"2024-04-26T21:16:25.800845+0000","last_fullsized":"2024-04-26T21:16:25.800845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.191814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816767+0000","last_change":"2024-04-26T21:16:20.410440+0000","last_active":"2024-04-26T21:16:25.816767+0000","last_peered":"2024-04-26T21:16:25.816767+0000","last_clean":"2024-04-26T21:16:25.816767+0000","last_became_active":"2024-04-26T21:16:20.410116+0000","last_became_peered":"2024-04-26T21:16:20.410116+0000","last_unstale":"2024-04-26T21:16:25.816767+0000","last_undegraded":"2024-04-26T21:16:25.816767+0000","last_fullsized":"2024-04-26T21:16:25.816767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:27.807333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814886+0000","last_change":"2024-04-26T21:16:20.404907+0000","last_active":"2024-04-26T21:16:25.814886+0000","last_peered":"2024-04-26T21:16:25.814886+0000","last_clean":"2024-04-26T21:16:25.814886+0000","last_became_active":"2024-04-26T21:16:20.404560+0000","last_became_peered":"2024-04-26T21:16:20.404560+0000","last_unstale":"2024-04-26T21:16:25.814886+0000","last_undegraded":"2024-04-26T21:16:25.814886+0000","last_fullsized":"2024-04-26T21:16:25.814886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434871+0000","last_change":"2024-04-26T21:16:20.423831+0000","last_active":"2024-04-26T21:16:25.434871+0000","last_peered":"2024-04-26T21:16:25.434871+0000","last_clean":"2024-04-26T21:16:25.434871+0000","last_became_active":"2024-04-26T21:16:20.423542+0000","last_became_peered":"2024-04-26T21:16:20.423542+0000","last_unstale":"2024-04-26T21:16:25.434871+0000","last_undegraded":"2024-04-26T21:16:25.434871+0000","last_fullsized":"2024-04-26T21:16:25.434871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:43.515453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434469+0000","last_change":"2024-04-26T21:16:20.426806+0000","last_active":"2024-04-26T21:16:25.434469+0000","last_peered":"2024-04-26T21:16:25.434469+0000","last_clean":"2024-04-26T21:16:25.434469+0000","last_became_active":"2024-04-26T21:16:20.426446+0000","last_became_peered":"2024-04-26T21:16:20.426446+0000","last_unstale":"2024-04-26T21:16:25.434469+0000","last_undegraded":"2024-04-26T21:16:25.434469+0000","last_fullsized":"2024-04-26T21:16:25.434469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:52.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.434639+0000","last_change":"2024-04-26T21:16:20.428440+0000","last_active":"2024-04-26T21:16:25.434639+0000","last_peered":"2024-04-26T21:16:25.434639+0000","last_clean":"2024-04-26T21:16:25.434639+0000","last_became_active":"2024-04-26T21:16:20.428074+0000","last_became_peered":"2024-04-26T21:16:20.428074+0000","last_unstale":"2024-04-26T21:16:25.434639+0000","last_undegraded":"2024-04-26T21:16:25.434639+0000","last_fullsized":"2024-04-26T21:16:25.434639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:24.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436896+0000","last_change":"2024-04-26T21:16:20.427736+0000","last_active":"2024-04-26T21:16:25.436896+0000","last_peered":"2024-04-26T21:16:25.436896+0000","last_clean":"2024-04-26T21:16:25.436896+0000","last_became_active":"2024-04-26T21:16:20.424657+0000","last_became_peered":"2024-04-26T21:16:20.424657+0000","last_unstale":"2024-04-26T21:16:25.436896+0000","last_undegraded":"2024-04-26T21:16:25.436896+0000","last_fullsized":"2024-04-26T21:16:25.436896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:41.767752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.814210+0000","last_change":"2024-04-26T21:16:20.425895+0000","last_active":"2024-04-26T21:16:25.814210+0000","last_peered":"2024-04-26T21:16:25.814210+0000","last_clean":"2024-04-26T21:16:25.814210+0000","last_became_active":"2024-04-26T21:16:20.425580+0000","last_became_peered":"2024-04-26T21:16:20.425580+0000","last_unstale":"2024-04-26T21:16:25.814210+0000","last_undegraded":"2024-04-26T21:16:25.814210+0000","last_fullsized":"2024-04-26T21:16:25.814210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:24.080517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.435717+0000","last_change":"2024-04-26T21:16:20.421664+0000","last_active":"2024-04-26T21:16:25.435717+0000","last_peered":"2024-04-26T21:16:25.435717+0000","last_clean":"2024-04-26T21:16:25.435717+0000","last_became_active":"2024-04-26T21:16:20.421311+0000","last_became_peered":"2024-04-26T21:16:20.421311+0000","last_unstale":"2024-04-26T21:16:25.435717+0000","last_undegraded":"2024-04-26T21:16:25.435717+0000","last_fullsized":"2024-04-26T21:16:25.435717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.815976+0000","last_change":"2024-04-26T21:16:20.427879+0000","last_active":"2024-04-26T21:16:25.815976+0000","last_peered":"2024-04-26T21:16:25.815976+0000","last_clean":"2024-04-26T21:16:25.815976+0000","last_became_active":"2024-04-26T21:16:20.426632+0000","last_became_peered":"2024-04-26T21:16:20.426632+0000","last_unstale":"2024-04-26T21:16:25.815976+0000","last_undegraded":"2024-04-26T21:16:25.815976+0000","last_fullsized":"2024-04-26T21:16:25.815976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:31.931924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436067+0000","last_change":"2024-04-26T21:16:20.401403+0000","last_active":"2024-04-26T21:16:25.436067+0000","last_peered":"2024-04-26T21:16:25.436067+0000","last_clean":"2024-04-26T21:16:25.436067+0000","last_became_active":"2024-04-26T21:16:20.401084+0000","last_became_peered":"2024-04-26T21:16:20.401084+0000","last_unstale":"2024-04-26T21:16:25.436067+0000","last_undegraded":"2024-04-26T21:16:25.436067+0000","last_fullsized":"2024-04-26T21:16:25.436067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:40.192524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.816320+0000","last_change":"2024-04-26T21:16:20.434210+0000","last_active":"2024-04-26T21:16:25.816320+0000","last_peered":"2024-04-26T21:16:25.816320+0000","last_clean":"2024-04-26T21:16:25.816320+0000","last_became_active":"2024-04-26T21:16:20.433607+0000","last_became_peered":"2024-04-26T21:16:20.433607+0000","last_unstale":"2024-04-26T21:16:25.816320+0000","last_undegraded":"2024-04-26T21:16:25.816320+0000","last_fullsized":"2024-04-26T21:16:25.816320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:31.551702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.817053+0000","last_change":"2024-04-26T21:16:20.419582+0000","last_active":"2024-04-26T21:16:25.817053+0000","last_peered":"2024-04-26T21:16:25.817053+0000","last_clean":"2024-04-26T21:16:25.817053+0000","last_became_active":"2024-04-26T21:16:20.419259+0000","last_became_peered":"2024-04-26T21:16:20.419259+0000","last_unstale":"2024-04-26T21:16:25.817053+0000","last_undegraded":"2024-04-26T21:16:25.817053+0000","last_fullsized":"2024-04-26T21:16:25.817053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.801509+0000","last_change":"2024-04-26T21:16:20.405606+0000","last_active":"2024-04-26T21:16:25.801509+0000","last_peered":"2024-04-26T21:16:25.801509+0000","last_clean":"2024-04-26T21:16:25.801509+0000","last_became_active":"2024-04-26T21:16:20.405265+0000","last_became_peered":"2024-04-26T21:16:20.405265+0000","last_unstale":"2024-04-26T21:16:25.801509+0000","last_undegraded":"2024-04-26T21:16:25.801509+0000","last_fullsized":"2024-04-26T21:16:25.801509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:21.859305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T21:16:25.436755+0000","last_change":"2024-04-26T21:16:20.415452+0000","last_active":"2024-04-26T21:16:25.436755+0000","last_peered":"2024-04-26T21:16:25.436755+0000","last_clean":"2024-04-26T21:16:25.436755+0000","last_became_active":"2024-04-26T21:16:20.414915+0000","last_became_peered":"2024-04-26T21:16:20.414915+0000","last_unstale":"2024-04-26T21:16:25.436755+0000","last_undegraded":"2024-04-26T21:16:25.436755+0000","last_fullsized":"2024-04-26T21:16:25.436755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:19.371869+0000","last_clean_scrub_stamp":"2024-04-26T21:16:19.371869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:58.416107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":110683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":701563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:16:44.539 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T21:16:44.539 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T21:16:44.540 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T21:16:44.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T21:16:44.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.711+0000 7f9eac600640 1 Processor -- start 2024-04-26T21:16:44.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.711+0000 7f9eac600640 1 -- start start 2024-04-26T21:16:44.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.711+0000 7f9eac600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ea413f140 0x7f9ea415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.711+0000 7f9eac600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea40b3d10 con 0x7f9ea406eb70 2024-04-26T21:16:44.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.711+0000 7f9eac600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea40b3ff0 con 0x7f9ea413ed60 2024-04-26T21:16:44.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.711+0000 7f9eac600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea40b3ac0 con 0x7f9ea413f140 2024-04-26T21:16:44.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.711+0000 7f9eaa600640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9ea406eb70 0x7f9ea40d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34924/0 (socket says 172.21.15.106:34924) 2024-04-26T21:16:44.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.711+0000 7f9eaa600640 1 -- 172.21.15.106:0/1981763597 learned_addr learned my addr 172.21.15.106:0/1981763597 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:44.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689677637 0 0) 0x7f9ea40b3d10 con 0x7f9ea406eb70 2024-04-26T21:16:44.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e8c005740 con 0x7f9ea406eb70 2024-04-26T21:16:44.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea9200640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ea413f140 0x7f9ea415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 681361809 0 0) 0x7f9e8c005740 con 0x7f9ea406eb70 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ea413f140 msgr2=0x7f9ea415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ea413f140 0x7f9ea415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 >> v1:172.21.15.112:6789/0 conn(0x7f9ea413ed60 legacy=0x7f9ea40b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea40b42d0 con 0x7f9ea406eb70 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f9e9c001a20 con 0x7f9ea406eb70 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 >> v1:172.21.15.106:6789/0 conn(0x7f9ea406eb70 legacy=0x7f9ea40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e8c005c00 0x7f9e8c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0065d0 0x7f9e8c006aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e8c0072f0 0x7f9e8c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea40b3ac0 con 0x7f9e8c0072f0 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c00e200 con 0x7f9e8c0065d0 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c00e400 con 0x7f9e8c005c00 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9eaa600640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e8c0072f0 0x7f9e8c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea9200640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0065d0 0x7f9e8c006aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9ea9c00640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e8c005c00 0x7f9e8c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9eaa600640 1 -- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e8c005c00 msgr2=0x7f9e8c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:44.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9eaa600640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9e8c005c00 0x7f9e8c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9eaa600640 1 -- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0065d0 msgr2=0x7f9e8c006aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:44.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9eaa600640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0065d0 0x7f9e8c006aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.715+0000 7f9eaa600640 1 -- 172.21.15.106:0/1981763597 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c005740 con 0x7f9e8c0072f0 2024-04-26T21:16:44.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eaa600640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e8c0072f0 0x7f9e8c00dbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ea415f930 tx=0x7f9e9c01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfab8c14d048a294 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:44.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c00a4a0 con 0x7f9e8c0072f0 2024-04-26T21:16:44.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c0ad630 con 0x7f9e8c0072f0 2024-04-26T21:16:44.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9ea3e00640 1 -- 172.21.15.106:0/1981763597 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0ada20 con 0x7f9e8c0072f0 2024-04-26T21:16:44.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 -- 172.21.15.106:0/1981763597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e8c0072f0 msgr2=0x7f9e8c00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 --2- 172.21.15.106:0/1981763597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e8c0072f0 0x7f9e8c00dbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ea415f930 tx=0x7f9e9c01d2e0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eaa600640 1 -- 172.21.15.106:0/1981763597 reap_dead start 2024-04-26T21:16:44.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 -- 172.21.15.106:0/1981763597 shutdown_connections 2024-04-26T21:16:44.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 -- 172.21.15.106:0/1981763597 >> 172.21.15.106:0/1981763597 conn(0x7f9ea4068340 msgr2=0x7f9ea4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:44.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 -- 172.21.15.106:0/1981763597 shutdown_connections 2024-04-26T21:16:44.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 -- 172.21.15.106:0/1981763597 wait complete. 2024-04-26T21:16:44.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 Processor -- start 2024-04-26T21:16:44.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 -- start start 2024-04-26T21:16:44.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0072f0 0x7f9ea415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ea40b0140 0x7f9ea414e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ea40ab150 0x7f9ea40ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea40d1500 con 0x7f9ea40ab150 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea40b4920 con 0x7f9e8c0072f0 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eac600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea40d1680 con 0x7f9ea40b0140 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eaa600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ea40ab150 0x7f9ea40ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eaa600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ea40ab150 0x7f9ea40ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41348/0 (socket says 172.21.15.106:41348) 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.719+0000 7f9eaa600640 1 -- 172.21.15.106:0/4258005473 learned_addr learned my addr 172.21.15.106:0/4258005473 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea9200640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ea40b0140 0x7f9ea414e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea9c00640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0072f0 0x7f9ea415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9eaa600640 1 -- 172.21.15.106:0/4258005473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ea40b0140 msgr2=0x7f9ea414e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9eaa600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ea40b0140 0x7f9ea414e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9eaa600640 1 -- 172.21.15.106:0/4258005473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0072f0 msgr2=0x7f9ea415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9eaa600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0072f0 0x7f9ea415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9eaa600640 1 -- 172.21.15.106:0/4258005473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea40abac0 con 0x7f9ea40ab150 2024-04-26T21:16:44.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea9c00640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0072f0 0x7f9ea415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:44.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9eaa600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ea40ab150 0x7f9ea40ad920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c01db80 tx=0x7f9e8c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:44.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea1600640 1 -- 172.21.15.106:0/4258005473 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0bc070 con 0x7f9ea40ab150 2024-04-26T21:16:44.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea1600640 1 -- 172.21.15.106:0/4258005473 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c0ad430 con 0x7f9ea40ab150 2024-04-26T21:16:44.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea40abda0 con 0x7f9ea40ab150 2024-04-26T21:16:44.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea1600640 1 -- 172.21.15.106:0/4258005473 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c00a4a0 con 0x7f9ea40ab150 2024-04-26T21:16:44.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea40ac360 con 0x7f9ea40ab150 2024-04-26T21:16:44.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea4069400 con 0x7f9ea40ab150 2024-04-26T21:16:44.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea1600640 1 -- 172.21.15.106:0/4258005473 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e9c0bf070 con 0x7f9ea40ab150 2024-04-26T21:16:44.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea1600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9e84068380 0x7f9e8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:44.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea1600640 1 -- 172.21.15.106:0/4258005473 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9e9c120e60 con 0x7f9ea40ab150 2024-04-26T21:16:44.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.723+0000 7f9ea9c00640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9e84068380 0x7f9e8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:44.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.727+0000 7f9ea9c00640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9e84068380 0x7f9e8406a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9e98007990 tx=0x7f9e98007900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:44.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.731+0000 7f9ea1600640 1 -- 172.21.15.106:0/4258005473 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9e9c016ff0 con 0x7f9ea40ab150 2024-04-26T21:16:44.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9ea40cfcc0 con 0x7f9ea40ab150 2024-04-26T21:16:44.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9ea1600640 1 -- 172.21.15.106:0/4258005473 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9e9c0f0960 con 0x7f9ea40ab150 2024-04-26T21:16:44.922 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T21:16:44.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9e84068380 msgr2=0x7f9e8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9e84068380 0x7f9e8406a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9e98007990 tx=0x7f9e98007900 comp rx=0 tx=0).stop 2024-04-26T21:16:44.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ea40ab150 msgr2=0x7f9ea40ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:44.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ea40ab150 0x7f9ea40ad920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c01db80 tx=0x7f9e8c007a50 comp rx=0 tx=0).stop 2024-04-26T21:16:44.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 shutdown_connections 2024-04-26T21:16:44.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9e84068380 0x7f9e8406a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ea40ab150 0x7f9ea40ad920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ea40b0140 0x7f9ea414e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 --2- 172.21.15.106:0/4258005473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e8c0072f0 0x7f9ea415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:44.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 >> 172.21.15.106:0/4258005473 conn(0x7f9ea4068340 msgr2=0x7f9ea415ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:44.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 shutdown_connections 2024-04-26T21:16:44.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:44.919+0000 7f9eac600640 1 -- 172.21.15.106:0/4258005473 wait complete. 2024-04-26T21:16:44.943 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T21:16:44.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:45.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.075+0000 7f805f800640 1 Processor -- start 2024-04-26T21:16:45.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.075+0000 7f805f800640 1 -- start start 2024-04-26T21:16:45.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.075+0000 7f805f800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f80580d14b0 0x7f805815df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.075+0000 7f805f800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80580b3da0 con 0x7f8058146490 2024-04-26T21:16:45.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.075+0000 7f805f800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8058160fa0 con 0x7f8058160ac0 2024-04-26T21:16:45.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.075+0000 7f805f800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f8058161280 con 0x7f80580d14b0 2024-04-26T21:16:45.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.075+0000 7f805d800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f80580d14b0 0x7f805815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.075+0000 7f805d800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f80580d14b0 0x7f805815df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41350/0 (socket says 172.21.15.106:41350) 2024-04-26T21:16:45.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.075+0000 7f805ce00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8058146490 0x7f80580cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34926/0 (socket says 172.21.15.106:34926) 2024-04-26T21:16:45.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f805d800640 1 -- 172.21.15.106:0/1327250722 learned_addr learned my addr 172.21.15.106:0/1327250722 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:45.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f805d800640 1 -- 172.21.15.106:0/1327250722 >> v1:172.21.15.112:6789/0 conn(0x7f8058160ac0 legacy=0x7f80580d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f805d800640 1 -- 172.21.15.106:0/1327250722 >> v1:172.21.15.106:6789/0 conn(0x7f8058146490 legacy=0x7f80580cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f805d800640 1 -- 172.21.15.106:0/1327250722 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8058161560 con 0x7f80580d14b0 2024-04-26T21:16:45.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f805d800640 1 --2- 172.21.15.106:0/1327250722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80580d14b0 0x7f805815df50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8050009e50 tx=0x7f805001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec638df546a441b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:45.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f8057e00640 1 -- 172.21.15.106:0/1327250722 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500a57f0 con 0x7f80580d14b0 2024-04-26T21:16:45.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f8057e00640 1 -- 172.21.15.106:0/1327250722 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80500a5990 con 0x7f80580d14b0 2024-04-26T21:16:45.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f8057e00640 1 -- 172.21.15.106:0/1327250722 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500a5d60 con 0x7f80580d14b0 2024-04-26T21:16:45.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f805f800640 1 -- 172.21.15.106:0/1327250722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80580d14b0 msgr2=0x7f805815df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.079+0000 7f805f800640 1 --2- 172.21.15.106:0/1327250722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80580d14b0 0x7f805815df50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8050009e50 tx=0x7f805001ca30 comp rx=0 tx=0).stop 2024-04-26T21:16:45.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- 172.21.15.106:0/1327250722 shutdown_connections 2024-04-26T21:16:45.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 --2- 172.21.15.106:0/1327250722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80580d14b0 0x7f805815df50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- 172.21.15.106:0/1327250722 >> 172.21.15.106:0/1327250722 conn(0x7f8058068340 msgr2=0x7f8058068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:45.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- 172.21.15.106:0/1327250722 shutdown_connections 2024-04-26T21:16:45.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- 172.21.15.106:0/1327250722 wait complete. 2024-04-26T21:16:45.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 Processor -- start 2024-04-26T21:16:45.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- start start 2024-04-26T21:16:45.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80580d14b0 0x7f805806df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8058146490 0x7f8058140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8058160ac0 0x7f805813e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f80580b5150 con 0x7f8058146490 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f80580b4fd0 con 0x7f8058160ac0 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f805816ae70 con 0x7f80580d14b0 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f804fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8058146490 0x7f8058140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f804fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8058146490 0x7f8058140ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41352/0 (socket says 172.21.15.106:41352) 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f804fe00640 1 -- 172.21.15.106:0/1304663510 learned_addr learned my addr 172.21.15.106:0/1304663510 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805d800640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8058160ac0 0x7f805813e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805ce00640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80580d14b0 0x7f805806df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f804fe00640 1 -- 172.21.15.106:0/1304663510 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80580d14b0 msgr2=0x7f805806df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f804fe00640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80580d14b0 0x7f805806df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f804fe00640 1 -- 172.21.15.106:0/1304663510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8058160ac0 msgr2=0x7f805813e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f804fe00640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8058160ac0 0x7f805813e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f804fe00640 1 -- 172.21.15.106:0/1304663510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805806e560 con 0x7f8058146490 2024-04-26T21:16:45.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805d800640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8058160ac0 0x7f805813e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:45.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f804fe00640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8058146490 0x7f8058140ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f804000c340 tx=0x7f804000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:45.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f8055600640 1 -- 172.21.15.106:0/1304663510 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400052d0 con 0x7f8058146490 2024-04-26T21:16:45.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f8055600640 1 -- 172.21.15.106:0/1304663510 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8040005470 con 0x7f8058146490 2024-04-26T21:16:45.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f8055600640 1 -- 172.21.15.106:0/1304663510 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040007260 con 0x7f8058146490 2024-04-26T21:16:45.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f805806e840 con 0x7f8058146490 2024-04-26T21:16:45.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.083+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f805806ee00 con 0x7f8058146490 2024-04-26T21:16:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.087+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8058069400 con 0x7f8058146490 2024-04-26T21:16:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.087+0000 7f8055600640 1 -- 172.21.15.106:0/1304663510 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8040007400 con 0x7f8058146490 2024-04-26T21:16:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.087+0000 7f8055600640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8034068380 0x7f803406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.087+0000 7f8055600640 1 -- 172.21.15.106:0/1304663510 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8040086230 con 0x7f8058146490 2024-04-26T21:16:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.087+0000 7f805ce00640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8034068380 0x7f803406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.087+0000 7f805ce00640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8034068380 0x7f803406a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8048000f70 tx=0x7f8048007c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:45.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.091+0000 7f8055600640 1 -- 172.21.15.106:0/1304663510 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8040056410 con 0x7f8058146490 2024-04-26T21:16:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.247+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8058073d70 con 0x7f8058146490 2024-04-26T21:16:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f8055600640 1 -- 172.21.15.106:0/1304663510 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7f8040055d10 con 0x7f8058146490 2024-04-26T21:16:45.253 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:45.253 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8034068380 msgr2=0x7f803406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8034068380 0x7f803406a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8048000f70 tx=0x7f8048007c90 comp rx=0 tx=0).stop 2024-04-26T21:16:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8058146490 msgr2=0x7f8058140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8058146490 0x7f8058140ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f804000c340 tx=0x7f804000c800 comp rx=0 tx=0).stop 2024-04-26T21:16:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 shutdown_connections 2024-04-26T21:16:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8058160ac0 0x7f805813e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8034068380 0x7f803406a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8058146490 0x7f8058140ae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 --2- 172.21.15.106:0/1304663510 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80580d14b0 0x7f805806df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 >> 172.21.15.106:0/1304663510 conn(0x7f8058068340 msgr2=0x7f80580b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 shutdown_connections 2024-04-26T21:16:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.251+0000 7f805f800640 1 -- 172.21.15.106:0/1304663510 wait complete. 2024-04-26T21:16:45.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:16:45.275 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:16:45.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59f7000640 1 Processor -- start 2024-04-26T21:16:45.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59f7000640 1 -- start start 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59f7000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59f00b5260 0x7f59f015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59f7000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59f015de50 0x7f59f0166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59f7000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f00b44a0 con 0x7f59f015d530 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59f7000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f59f00b4780 con 0x7f59f00b5260 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59f7000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f59f00b4a60 con 0x7f59f015de50 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59e7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59f00b5260 0x7f59f015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59efe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f59f015d530 0x7f59f00cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:44052/0 (socket says 172.21.15.106:44052) 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59e7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59f00b5260 0x7f59f015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41362/0 (socket says 172.21.15.106:41362) 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59efe00640 1 -- 172.21.15.106:0/2587654949 learned_addr learned my addr 172.21.15.106:0/2587654949 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:45.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59f5000640 1 --2- 172.21.15.106:0/2587654949 >> v2:172.21.15.112:3300/0 conn(0x7f59f015de50 0x7f59f0166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59e7400640 1 -- 172.21.15.106:0/2587654949 >> v2:172.21.15.112:3300/0 conn(0x7f59f015de50 msgr2=0x7f59f0166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:45.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59e7400640 1 --2- 172.21.15.106:0/2587654949 >> v2:172.21.15.112:3300/0 conn(0x7f59f015de50 0x7f59f0166ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59e7400640 1 -- 172.21.15.106:0/2587654949 >> v1:172.21.15.112:6789/0 conn(0x7f59f015d530 legacy=0x7f59f00cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59e7400640 1 -- 172.21.15.106:0/2587654949 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f00b4d40 con 0x7f59f00b5260 2024-04-26T21:16:45.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.411+0000 7f59ef400640 1 -- 172.21.15.106:0/2587654949 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116086 0 0) 0x7f59f00b44a0 con 0x7f59f015d530 2024-04-26T21:16:45.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59e7400640 1 --2- 172.21.15.106:0/2587654949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f00b5260 0x7f59f015d910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59f0146db0 tx=0x7f59d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f9a4fbef995b42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:45.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59ef400640 1 -- 172.21.15.106:0/2587654949 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d80ab640 con 0x7f59f00b5260 2024-04-26T21:16:45.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59ef400640 1 -- 172.21.15.106:0/2587654949 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d80b0070 con 0x7f59f00b5260 2024-04-26T21:16:45.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59ef400640 1 -- 172.21.15.106:0/2587654949 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d80aba00 con 0x7f59f00b5260 2024-04-26T21:16:45.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59f7000640 1 -- 172.21.15.106:0/2587654949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f00b5260 msgr2=0x7f59f015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59f7000640 1 --2- 172.21.15.106:0/2587654949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f00b5260 0x7f59f015d910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59f0146db0 tx=0x7f59d801c480 comp rx=0 tx=0).stop 2024-04-26T21:16:45.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59f7000640 1 -- 172.21.15.106:0/2587654949 shutdown_connections 2024-04-26T21:16:45.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59f7000640 1 --2- 172.21.15.106:0/2587654949 >> v2:172.21.15.112:3300/0 conn(0x7f59f015de50 0x7f59f0166ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59f7000640 1 --2- 172.21.15.106:0/2587654949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f00b5260 0x7f59f015d910 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59f7000640 1 -- 172.21.15.106:0/2587654949 >> 172.21.15.106:0/2587654949 conn(0x7f59f00b2910 msgr2=0x7f59f00b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:45.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59f7000640 1 -- 172.21.15.106:0/2587654949 shutdown_connections 2024-04-26T21:16:45.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.415+0000 7f59f7000640 1 -- 172.21.15.106:0/2587654949 wait complete. 2024-04-26T21:16:45.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 Processor -- start 2024-04-26T21:16:45.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 -- start start 2024-04-26T21:16:45.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59f00b5260 0x7f59f0156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f015d530 0x7f59f013a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59f015de50 0x7f59f013ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f59f00d06b0 con 0x7f59f015d530 2024-04-26T21:16:45.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f59f00d0530 con 0x7f59f00b5260 2024-04-26T21:16:45.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f59f0169840 con 0x7f59f015de50 2024-04-26T21:16:45.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59efe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59f00b5260 0x7f59f0156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59e7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f015d530 0x7f59f013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59efe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59f00b5260 0x7f59f0156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:44680/0 (socket says 172.21.15.106:44680) 2024-04-26T21:16:45.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59efe00640 1 -- 172.21.15.106:0/2916399222 learned_addr learned my addr 172.21.15.106:0/2916399222 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:45.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f5000640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59f015de50 0x7f59f013ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59efe00640 1 -- 172.21.15.106:0/2916399222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59f015de50 msgr2=0x7f59f013ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59efe00640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59f015de50 0x7f59f013ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59efe00640 1 -- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f015d530 msgr2=0x7f59f013a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59efe00640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f015d530 0x7f59f013a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59efe00640 1 -- 172.21.15.106:0/2916399222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f01443b0 con 0x7f59f00b5260 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59e7400640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f015d530 0x7f59f013a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59efe00640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59f00b5260 0x7f59f0156a40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f59e000c520 tx=0x7f59e000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59ecc00640 1 -- 172.21.15.106:0/2916399222 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e0018070 con 0x7f59f00b5260 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59ecc00640 1 -- 172.21.15.106:0/2916399222 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e00074e0 con 0x7f59f00b5260 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f0073f70 con 0x7f59f00b5260 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59ecc00640 1 -- 172.21.15.106:0/2916399222 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e00049f0 con 0x7f59f00b5260 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f00739b0 con 0x7f59f00b5260 2024-04-26T21:16:45.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.419+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f0069400 con 0x7f59f00b5260 2024-04-26T21:16:45.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.423+0000 7f59ecc00640 1 -- 172.21.15.106:0/2916399222 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59e001b070 con 0x7f59f00b5260 2024-04-26T21:16:45.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.423+0000 7f59ecc00640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f59cc068380 0x7f59cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.423+0000 7f59ecc00640 1 -- 172.21.15.106:0/2916399222 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f59e0086250 con 0x7f59f00b5260 2024-04-26T21:16:45.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.423+0000 7f59e7400640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f59cc068380 0x7f59cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.423+0000 7f59e7400640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f59cc068380 0x7f59cc06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f59d80af000 tx=0x7f59d80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:45.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.427+0000 7f59ecc00640 1 -- 172.21.15.106:0/2916399222 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f59e0055e60 con 0x7f59f00b5260 2024-04-26T21:16:45.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f59f0069b10 con 0x7f59f00b5260 2024-04-26T21:16:45.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59ecc00640 1 -- 172.21.15.106:0/2916399222 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f59e005a160 con 0x7f59f00b5260 2024-04-26T21:16:45.590 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f59cc068380 msgr2=0x7f59cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f59cc068380 0x7f59cc06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f59d80af000 tx=0x7f59d80a7000 comp rx=0 tx=0).stop 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59f00b5260 msgr2=0x7f59f0156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59f00b5260 0x7f59f0156a40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f59e000c520 tx=0x7f59e000c9e0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 shutdown_connections 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f59cc068380 0x7f59cc06a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f59f015de50 0x7f59f013ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59f015d530 0x7f59f013a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 --2- 172.21.15.106:0/2916399222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59f00b5260 0x7f59f0156a40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 >> 172.21.15.106:0/2916399222 conn(0x7f59f00b2910 msgr2=0x7f59f015ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 shutdown_connections 2024-04-26T21:16:45.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.587+0000 7f59f7000640 1 -- 172.21.15.106:0/2916399222 wait complete. 2024-04-26T21:16:45.611 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:16:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f455aa00640 1 Processor -- start 2024-04-26T21:16:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f455aa00640 1 -- start start 2024-04-26T21:16:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f455aa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f455415d530 0x7f45540cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f455aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f45540b5260 0x7f45540d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f455aa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45540b44a0 con 0x7f455415d910 2024-04-26T21:16:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f455aa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f45540b4780 con 0x7f45540b5260 2024-04-26T21:16:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f455aa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f45540b4a60 con 0x7f455415d530 2024-04-26T21:16:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f4553400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f45540b5260 0x7f45540d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f4558a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f455415d910 0x7f455415dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34932/0 (socket says 172.21.15.106:34932) 2024-04-26T21:16:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f4558a00640 1 -- 172.21.15.106:0/285747442 learned_addr learned my addr 172.21.15.106:0/285747442 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:45.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f4553e00640 1 --2- 172.21.15.106:0/285747442 >> v2:172.21.15.112:3300/0 conn(0x7f455415d530 0x7f45540cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f4553400640 1 -- 172.21.15.106:0/285747442 >> v2:172.21.15.112:3300/0 conn(0x7f455415d530 msgr2=0x7f45540cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:45.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f4553400640 1 --2- 172.21.15.106:0/285747442 >> v2:172.21.15.112:3300/0 conn(0x7f455415d530 0x7f45540cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f4553400640 1 -- 172.21.15.106:0/285747442 >> v1:172.21.15.106:6789/0 conn(0x7f455415d910 legacy=0x7f455415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f4553400640 1 -- 172.21.15.106:0/285747442 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45540b4d40 con 0x7f45540b5260 2024-04-26T21:16:45.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.747+0000 7f4552a00640 1 -- 172.21.15.106:0/285747442 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708064607 0 0) 0x7f45540b44a0 con 0x7f455415d910 2024-04-26T21:16:45.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f4553400640 1 --2- 172.21.15.106:0/285747442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45540b5260 0x7f45540d0360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f455406d900 tx=0x7f454001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12f7bec2426ecde server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:45.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f4552a00640 1 -- 172.21.15.106:0/285747442 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45400ab640 con 0x7f45540b5260 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f4552a00640 1 -- 172.21.15.106:0/285747442 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45400b0070 con 0x7f45540b5260 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f4552a00640 1 -- 172.21.15.106:0/285747442 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45400aba00 con 0x7f45540b5260 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f455aa00640 1 -- 172.21.15.106:0/285747442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45540b5260 msgr2=0x7f45540d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f455aa00640 1 --2- 172.21.15.106:0/285747442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45540b5260 0x7f45540d0360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f455406d900 tx=0x7f454001c480 comp rx=0 tx=0).stop 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f455aa00640 1 -- 172.21.15.106:0/285747442 shutdown_connections 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f455aa00640 1 --2- 172.21.15.106:0/285747442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45540b5260 0x7f45540d0360 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f455aa00640 1 --2- 172.21.15.106:0/285747442 >> v2:172.21.15.112:3300/0 conn(0x7f455415d530 0x7f45540cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f455aa00640 1 -- 172.21.15.106:0/285747442 >> 172.21.15.106:0/285747442 conn(0x7f45540b2910 msgr2=0x7f45540b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f455aa00640 1 -- 172.21.15.106:0/285747442 shutdown_connections 2024-04-26T21:16:45.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.751+0000 7f455aa00640 1 -- 172.21.15.106:0/285747442 wait complete. 2024-04-26T21:16:45.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 Processor -- start 2024-04-26T21:16:45.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 -- start start 2024-04-26T21:16:45.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540b5260 0x7f455415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f455415d530 0x7f455415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f455415d910 0x7f455415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4554169690 con 0x7f455415d910 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4554169510 con 0x7f45540b5260 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4554169810 con 0x7f455415d530 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4558a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f455415d910 0x7f455415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4558a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f455415d910 0x7f455415e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41384/0 (socket says 172.21.15.106:41384) 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4558a00640 1 -- 172.21.15.106:0/2626826158 learned_addr learned my addr 172.21.15.106:0/2626826158 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4553e00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540b5260 0x7f455415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4553400640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f455415d530 0x7f455415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4558a00640 1 -- 172.21.15.106:0/2626826158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f455415d530 msgr2=0x7f455415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4558a00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f455415d530 0x7f455415b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4558a00640 1 -- 172.21.15.106:0/2626826158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540b5260 msgr2=0x7f455415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4558a00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540b5260 0x7f455415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4558a00640 1 -- 172.21.15.106:0/2626826158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455415bb20 con 0x7f455415d910 2024-04-26T21:16:45.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4553400640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f455415d530 0x7f455415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:45.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f4558a00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f455415d910 0x7f455415e4f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f454c00c700 tx=0x7f454c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:45.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f454be00640 1 -- 172.21.15.106:0/2626826158 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c018070 con 0x7f455415d910 2024-04-26T21:16:45.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f454be00640 1 -- 172.21.15.106:0/2626826158 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c00ce10 con 0x7f455415d910 2024-04-26T21:16:45.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455415be00 con 0x7f455415d910 2024-04-26T21:16:45.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f454be00640 1 -- 172.21.15.106:0/2626826158 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c00a860 con 0x7f455415d910 2024-04-26T21:16:45.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.755+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455413e0a0 con 0x7f455415d910 2024-04-26T21:16:45.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.759+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4554069400 con 0x7f455415d910 2024-04-26T21:16:45.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.759+0000 7f454be00640 1 -- 172.21.15.106:0/2626826158 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f454c01b070 con 0x7f455415d910 2024-04-26T21:16:45.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.759+0000 7f454be00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4534068380 0x7f453406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:45.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.759+0000 7f454be00640 1 -- 172.21.15.106:0/2626826158 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f454c086290 con 0x7f455415d910 2024-04-26T21:16:45.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.759+0000 7f4553e00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4534068380 0x7f453406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:45.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.759+0000 7f4553e00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4534068380 0x7f453406a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4544007a60 tx=0x7f4544008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:45.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.763+0000 7f454be00640 1 -- 172.21.15.106:0/2626826158 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f454c055e20 con 0x7f455415d910 2024-04-26T21:16:45.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.919+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f455406fe50 con 0x7f455415d910 2024-04-26T21:16:45.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.919+0000 7f454be00640 1 -- 172.21.15.106:0/2626826158 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f454c05a120 con 0x7f455415d910 2024-04-26T21:16:45.923 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:16:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.919+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4534068380 msgr2=0x7f453406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.919+0000 7f455aa00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4534068380 0x7f453406a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4544007a60 tx=0x7f4544008040 comp rx=0 tx=0).stop 2024-04-26T21:16:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.919+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f455415d910 msgr2=0x7f455415e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.919+0000 7f455aa00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f455415d910 0x7f455415e4f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f454c00c700 tx=0x7f454c00cbc0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.923+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 shutdown_connections 2024-04-26T21:16:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.923+0000 7f455aa00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4534068380 0x7f453406a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.923+0000 7f455aa00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f455415d910 0x7f455415e4f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.923+0000 7f455aa00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f455415d530 0x7f455415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.923+0000 7f455aa00640 1 --2- 172.21.15.106:0/2626826158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540b5260 0x7f455415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.923+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 >> 172.21.15.106:0/2626826158 conn(0x7f45540b2910 msgr2=0x7f455415dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.923+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 shutdown_connections 2024-04-26T21:16:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:45.923+0000 7f455aa00640 1 -- 172.21.15.106:0/2626826158 wait complete. 2024-04-26T21:16:45.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:16:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c95e00640 1 Processor -- start 2024-04-26T21:16:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c95e00640 1 -- start start 2024-04-26T21:16:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c95e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7c9015f100 0x7f7c900d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c95e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7c9015f4e0 0x7f7c90162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c95e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c90163340 0x7f7c9006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c95e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f7c900cff70 con 0x7f7c9015f4e0 2024-04-26T21:16:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c95e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7c90163970 con 0x7f7c9015f100 2024-04-26T21:16:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c95e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7c90163c50 con 0x7f7c90163340 2024-04-26T21:16:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c86000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7c9015f4e0 0x7f7c90162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c86000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7c9015f4e0 0x7f7c90162e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41396/0 (socket says 172.21.15.106:41396) 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c86000640 1 -- 172.21.15.106:0/739514565 learned_addr learned my addr 172.21.15.106:0/739514565 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c8ea00640 1 --2- 172.21.15.106:0/739514565 >> v2:172.21.15.112:3300/0 conn(0x7f7c9015f100 0x7f7c900d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c8f400640 1 --2- 172.21.15.106:0/739514565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c90163340 0x7f7c9006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c86000640 1 -- 172.21.15.106:0/739514565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c90163340 msgr2=0x7f7c9006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c86000640 1 --2- 172.21.15.106:0/739514565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c90163340 0x7f7c9006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c86000640 1 -- 172.21.15.106:0/739514565 >> v2:172.21.15.112:3300/0 conn(0x7f7c9015f100 msgr2=0x7f7c900d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c86000640 1 --2- 172.21.15.106:0/739514565 >> v2:172.21.15.112:3300/0 conn(0x7f7c9015f100 0x7f7c900d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c86000640 1 -- 172.21.15.106:0/739514565 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c900cf920 con 0x7f7c9015f4e0 2024-04-26T21:16:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.079+0000 7f7c8f400640 1 --2- 172.21.15.106:0/739514565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c90163340 0x7f7c9006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c86000640 1 --2- 172.21.15.106:0/739514565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f4e0 0x7f7c90162e00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c90163e60 tx=0x7f7c7801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66ca80755683793 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c8e000640 1 -- 172.21.15.106:0/739514565 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c780b1070 con 0x7f7c9015f4e0 2024-04-26T21:16:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c8e000640 1 -- 172.21.15.106:0/739514565 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c780ac620 con 0x7f7c9015f4e0 2024-04-26T21:16:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c8e000640 1 -- 172.21.15.106:0/739514565 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c780ac9f0 con 0x7f7c9015f4e0 2024-04-26T21:16:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c95e00640 1 -- 172.21.15.106:0/739514565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f4e0 msgr2=0x7f7c90162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c95e00640 1 --2- 172.21.15.106:0/739514565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f4e0 0x7f7c90162e00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c90163e60 tx=0x7f7c7801c4f0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c95e00640 1 -- 172.21.15.106:0/739514565 shutdown_connections 2024-04-26T21:16:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c95e00640 1 --2- 172.21.15.106:0/739514565 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c90163340 0x7f7c9006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c95e00640 1 --2- 172.21.15.106:0/739514565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f4e0 0x7f7c90162e00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c95e00640 1 --2- 172.21.15.106:0/739514565 >> v2:172.21.15.112:3300/0 conn(0x7f7c9015f100 0x7f7c900d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c95e00640 1 -- 172.21.15.106:0/739514565 >> 172.21.15.106:0/739514565 conn(0x7f7c9009ba60 msgr2=0x7f7c9009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c95e00640 1 -- 172.21.15.106:0/739514565 shutdown_connections 2024-04-26T21:16:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.083+0000 7f7c95e00640 1 -- 172.21.15.106:0/739514565 wait complete. 2024-04-26T21:16:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 Processor -- start 2024-04-26T21:16:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 -- start start 2024-04-26T21:16:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f100 0x7f7c90152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c9015f4e0 0x7f7c900cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c90163340 0x7f7c900cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7c900d1de0 con 0x7f7c9015f100 2024-04-26T21:16:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7c900d1c60 con 0x7f7c90163340 2024-04-26T21:16:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7c900d1f60 con 0x7f7c9015f4e0 2024-04-26T21:16:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f100 0x7f7c90152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f100 0x7f7c90152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41406/0 (socket says 172.21.15.106:41406) 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8ea00640 1 -- 172.21.15.106:0/3529462816 learned_addr learned my addr 172.21.15.106:0/3529462816 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c86000640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c9015f4e0 0x7f7c900cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8f400640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c90163340 0x7f7c900cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8ea00640 1 -- 172.21.15.106:0/3529462816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c9015f4e0 msgr2=0x7f7c900cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8ea00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c9015f4e0 0x7f7c900cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8ea00640 1 -- 172.21.15.106:0/3529462816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c90163340 msgr2=0x7f7c900cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8ea00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c90163340 0x7f7c900cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8ea00640 1 -- 172.21.15.106:0/3529462816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c90075d40 con 0x7f7c9015f100 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c8ea00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f100 0x7f7c90152150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000d800 tx=0x7f7c8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c87e00640 1 -- 172.21.15.106:0/3529462816 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80018020 con 0x7f7c9015f100 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c87e00640 1 -- 172.21.15.106:0/3529462816 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c800096a0 con 0x7f7c9015f100 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c90152690 con 0x7f7c9015f100 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c87e00640 1 -- 172.21.15.106:0/3529462816 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80009a50 con 0x7f7c9015f100 2024-04-26T21:16:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c900b0dd0 con 0x7f7c9015f100 2024-04-26T21:16:46.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.087+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c900b17d0 con 0x7f7c9015f100 2024-04-26T21:16:46.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.091+0000 7f7c87e00640 1 -- 172.21.15.106:0/3529462816 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c8001b020 con 0x7f7c9015f100 2024-04-26T21:16:46.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.091+0000 7f7c87e00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7c6c068380 0x7f7c6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.091+0000 7f7c87e00640 1 -- 172.21.15.106:0/3529462816 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7c80087160 con 0x7f7c9015f100 2024-04-26T21:16:46.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.091+0000 7f7c86000640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7c6c068380 0x7f7c6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.091+0000 7f7c86000640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7c6c068380 0x7f7c6c06a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c780ae000 tx=0x7f7c78008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.095+0000 7f7c87e00640 1 -- 172.21.15.106:0/3529462816 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7c80022020 con 0x7f7c9015f100 2024-04-26T21:16:46.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7c90069400 con 0x7f7c9015f100 2024-04-26T21:16:46.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c87e00640 1 -- 172.21.15.106:0/3529462816 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f7c80056cf0 con 0x7f7c9015f100 2024-04-26T21:16:46.257 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:16:46.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7c6c068380 msgr2=0x7f7c6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7c6c068380 0x7f7c6c06a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c780ae000 tx=0x7f7c78008040 comp rx=0 tx=0).stop 2024-04-26T21:16:46.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f100 msgr2=0x7f7c90152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f100 0x7f7c90152150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000d800 tx=0x7f7c8000dcc0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 shutdown_connections 2024-04-26T21:16:46.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c90163340 0x7f7c900cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7c6c068380 0x7f7c6c06a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7c9015f4e0 0x7f7c900cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 --2- 172.21.15.106:0/3529462816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c9015f100 0x7f7c90152150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 >> 172.21.15.106:0/3529462816 conn(0x7f7c9009ba60 msgr2=0x7f7c900b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:46.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 shutdown_connections 2024-04-26T21:16:46.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.255+0000 7f7c95e00640 1 -- 172.21.15.106:0/3529462816 wait complete. 2024-04-26T21:16:46.278 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:16:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d95400640 1 Processor -- start 2024-04-26T21:16:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d95400640 1 -- start start 2024-04-26T21:16:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d95400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6d9015c4e0 0x7f6d9015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d95400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015d080 0x7f6d900b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d95400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6d9015fa20 0x7f6d9015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d95400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f6d9015d5f0 con 0x7f6d9015fa20 2024-04-26T21:16:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d95400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6d9015ce00 con 0x7f6d9015c4e0 2024-04-26T21:16:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d95400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6d900b4f00 con 0x7f6d9015d080 2024-04-26T21:16:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8f200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6d9015fa20 0x7f6d9015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8f200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6d9015fa20 0x7f6d9015feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41414/0 (socket says 172.21.15.106:41414) 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8f200640 1 -- 172.21.15.106:0/508344772 learned_addr learned my addr 172.21.15.106:0/508344772 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8e800640 1 --2- 172.21.15.106:0/508344772 >> v2:172.21.15.112:3300/0 conn(0x7f6d9015c4e0 0x7f6d9015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8de00640 1 --2- 172.21.15.106:0/508344772 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015d080 0x7f6d900b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8f200640 1 -- 172.21.15.106:0/508344772 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015d080 msgr2=0x7f6d900b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8f200640 1 --2- 172.21.15.106:0/508344772 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015d080 0x7f6d900b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8f200640 1 -- 172.21.15.106:0/508344772 >> v2:172.21.15.112:3300/0 conn(0x7f6d9015c4e0 msgr2=0x7f6d9015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8f200640 1 --2- 172.21.15.106:0/508344772 >> v2:172.21.15.112:3300/0 conn(0x7f6d9015c4e0 0x7f6d9015c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8f200640 1 -- 172.21.15.106:0/508344772 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d900b51e0 con 0x7f6d9015fa20 2024-04-26T21:16:46.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.415+0000 7f6d8de00640 1 --2- 172.21.15.106:0/508344772 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015d080 0x7f6d900b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:46.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d8f200640 1 --2- 172.21.15.106:0/508344772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 0x7f6d9015feb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6d90070310 tx=0x7f6d8801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614157b68cc76a42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d8d400640 1 -- 172.21.15.106:0/508344772 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d880a5840 con 0x7f6d9015fa20 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d8d400640 1 -- 172.21.15.106:0/508344772 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d880a59e0 con 0x7f6d9015fa20 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d8d400640 1 -- 172.21.15.106:0/508344772 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d880a5db0 con 0x7f6d9015fa20 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d95400640 1 -- 172.21.15.106:0/508344772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 msgr2=0x7f6d9015feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d95400640 1 --2- 172.21.15.106:0/508344772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 0x7f6d9015feb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6d90070310 tx=0x7f6d8801c9c0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d95400640 1 -- 172.21.15.106:0/508344772 shutdown_connections 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d95400640 1 --2- 172.21.15.106:0/508344772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 0x7f6d9015feb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d95400640 1 --2- 172.21.15.106:0/508344772 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015d080 0x7f6d900b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d95400640 1 --2- 172.21.15.106:0/508344772 >> v2:172.21.15.112:3300/0 conn(0x7f6d9015c4e0 0x7f6d9015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d95400640 1 -- 172.21.15.106:0/508344772 >> 172.21.15.106:0/508344772 conn(0x7f6d900b2910 msgr2=0x7f6d900b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d95400640 1 -- 172.21.15.106:0/508344772 shutdown_connections 2024-04-26T21:16:46.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.419+0000 7f6d95400640 1 -- 172.21.15.106:0/508344772 wait complete. 2024-04-26T21:16:46.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 Processor -- start 2024-04-26T21:16:46.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 -- start start 2024-04-26T21:16:46.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015c4e0 0x7f6d900c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d9015d080 0x7f6d901f8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 0x7f6d9013d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6d900b4b60 con 0x7f6d9015fa20 2024-04-26T21:16:46.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6d90145ba0 con 0x7f6d9015d080 2024-04-26T21:16:46.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6d900b4ce0 con 0x7f6d9015c4e0 2024-04-26T21:16:46.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 0x7f6d9013d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 0x7f6d9013d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41422/0 (socket says 172.21.15.106:41422) 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8f200640 1 -- 172.21.15.106:0/3076856174 learned_addr learned my addr 172.21.15.106:0/3076856174 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8de00640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d9015d080 0x7f6d901f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8e800640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015c4e0 0x7f6d900c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8f200640 1 -- 172.21.15.106:0/3076856174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015c4e0 msgr2=0x7f6d900c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8f200640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015c4e0 0x7f6d900c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8f200640 1 -- 172.21.15.106:0/3076856174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d9015d080 msgr2=0x7f6d901f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8f200640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d9015d080 0x7f6d901f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8f200640 1 -- 172.21.15.106:0/3076856174 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9013feb0 con 0x7f6d9015fa20 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8e800640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015c4e0 0x7f6d900c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d8f200640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 0x7f6d9013d520 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d880af040 tx=0x7f6d88019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d86a00640 1 -- 172.21.15.106:0/3076856174 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d880bc070 con 0x7f6d9015fa20 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d86a00640 1 -- 172.21.15.106:0/3076856174 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d880b8850 con 0x7f6d9015fa20 2024-04-26T21:16:46.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d90140190 con 0x7f6d9015fa20 2024-04-26T21:16:46.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d86a00640 1 -- 172.21.15.106:0/3076856174 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d880b8c40 con 0x7f6d9015fa20 2024-04-26T21:16:46.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d90140750 con 0x7f6d9015fa20 2024-04-26T21:16:46.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.423+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d90140c40 con 0x7f6d9015fa20 2024-04-26T21:16:46.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.427+0000 7f6d86a00640 1 -- 172.21.15.106:0/3076856174 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6d880b6410 con 0x7f6d9015fa20 2024-04-26T21:16:46.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.427+0000 7f6d86a00640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6d70068380 0x7f6d7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.427+0000 7f6d86a00640 1 -- 172.21.15.106:0/3076856174 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6d88121b90 con 0x7f6d9015fa20 2024-04-26T21:16:46.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.427+0000 7f6d8e800640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6d70068380 0x7f6d7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.427+0000 7f6d8e800640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6d70068380 0x7f6d7006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000ba50 tx=0x7f6d80008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.431+0000 7f6d86a00640 1 -- 172.21.15.106:0/3076856174 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6d880165e0 con 0x7f6d9015fa20 2024-04-26T21:16:46.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.587+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6d9006e2a0 con 0x7f6d9015fa20 2024-04-26T21:16:46.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.587+0000 7f6d86a00640 1 -- 172.21.15.106:0/3076856174 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f6d880f17b0 con 0x7f6d9015fa20 2024-04-26T21:16:46.592 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:16:46.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6d70068380 msgr2=0x7f6d7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6d70068380 0x7f6d7006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000ba50 tx=0x7f6d80008040 comp rx=0 tx=0).stop 2024-04-26T21:16:46.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 msgr2=0x7f6d9013d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 0x7f6d9013d520 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d880af040 tx=0x7f6d88019760 comp rx=0 tx=0).stop 2024-04-26T21:16:46.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 shutdown_connections 2024-04-26T21:16:46.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d9015d080 0x7f6d901f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6d70068380 0x7f6d7006a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d9015fa20 0x7f6d9013d520 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 --2- 172.21.15.106:0/3076856174 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6d9015c4e0 0x7f6d900c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 >> 172.21.15.106:0/3076856174 conn(0x7f6d900b2910 msgr2=0x7f6d90071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:46.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 shutdown_connections 2024-04-26T21:16:46.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.591+0000 7f6d95400640 1 -- 172.21.15.106:0/3076856174 wait complete. 2024-04-26T21:16:46.613 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:16:46.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b42600640 1 Processor -- start 2024-04-26T21:16:46.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b42600640 1 -- start start 2024-04-26T21:16:46.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b42600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5b3c0d37f0 0x7f5b3c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b42600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 0x7f5b3c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b42600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b3c0d1d70 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b42600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5b3c0d2050 con 0x7f5b3c0d37f0 2024-04-26T21:16:46.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b42600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3c0cd450 con 0x7f5b3c0cdc50 2024-04-26T21:16:46.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3b400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5b3c15f3d0 0x7f5b3c0cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:44064/0 (socket says 172.21.15.106:44064) 2024-04-26T21:16:46.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3b400640 1 -- 172.21.15.106:0/3754996195 learned_addr learned my addr 172.21.15.106:0/3754996195 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:46.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3aa00640 1 --2- 172.21.15.106:0/3754996195 >> v2:172.21.15.112:3300/0 conn(0x7f5b3c0d37f0 0x7f5b3c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3be00640 1 --2- 172.21.15.106:0/3754996195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 0x7f5b3c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3a000640 1 -- 172.21.15.106:0/3754996195 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683482912 0 0) 0x7f5b3c0d1d70 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3a000640 1 -- 172.21.15.106:0/3754996195 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b20003530 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3be00640 1 -- 172.21.15.106:0/3754996195 >> v2:172.21.15.112:3300/0 conn(0x7f5b3c0d37f0 msgr2=0x7f5b3c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:46.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3be00640 1 --2- 172.21.15.106:0/3754996195 >> v2:172.21.15.112:3300/0 conn(0x7f5b3c0d37f0 0x7f5b3c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3be00640 1 -- 172.21.15.106:0/3754996195 >> v1:172.21.15.112:6789/0 conn(0x7f5b3c15f3d0 legacy=0x7f5b3c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.747+0000 7f5b3be00640 1 -- 172.21.15.106:0/3754996195 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c0cd730 con 0x7f5b3c0cdc50 2024-04-26T21:16:46.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b3be00640 1 --2- 172.21.15.106:0/3754996195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 0x7f5b3c0ce0e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009d90 tx=0x7f5b3401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f5d3053c0c8d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b3a000640 1 -- 172.21.15.106:0/3754996195 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b340b2070 con 0x7f5b3c0cdc50 2024-04-26T21:16:46.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b3a000640 1 -- 172.21.15.106:0/3754996195 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b340a5830 con 0x7f5b3c0cdc50 2024-04-26T21:16:46.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b3a000640 1 -- 172.21.15.106:0/3754996195 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b340a5c00 con 0x7f5b3c0cdc50 2024-04-26T21:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b42600640 1 -- 172.21.15.106:0/3754996195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 msgr2=0x7f5b3c0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b42600640 1 --2- 172.21.15.106:0/3754996195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 0x7f5b3c0ce0e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009d90 tx=0x7f5b3401c970 comp rx=0 tx=0).stop 2024-04-26T21:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b42600640 1 -- 172.21.15.106:0/3754996195 shutdown_connections 2024-04-26T21:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b42600640 1 --2- 172.21.15.106:0/3754996195 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 0x7f5b3c0ce0e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b42600640 1 --2- 172.21.15.106:0/3754996195 >> v2:172.21.15.112:3300/0 conn(0x7f5b3c0d37f0 0x7f5b3c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b42600640 1 -- 172.21.15.106:0/3754996195 >> 172.21.15.106:0/3754996195 conn(0x7f5b3c0d2c60 msgr2=0x7f5b3c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b42600640 1 -- 172.21.15.106:0/3754996195 shutdown_connections 2024-04-26T21:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.751+0000 7f5b42600640 1 -- 172.21.15.106:0/3754996195 wait complete. 2024-04-26T21:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 Processor -- start 2024-04-26T21:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 -- start start 2024-04-26T21:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 0x7f5b3c159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b3c0d37f0 0x7f5b3c158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b3c15f3d0 0x7f5b3c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c16c010 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c0d0340 con 0x7f5b3c0d37f0 2024-04-26T21:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3c16c190 con 0x7f5b3c0cdc50 2024-04-26T21:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b3c15f3d0 0x7f5b3c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b3c15f3d0 0x7f5b3c0c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41428/0 (socket says 172.21.15.106:41428) 2024-04-26T21:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3be00640 1 -- 172.21.15.106:0/3215390437 learned_addr learned my addr 172.21.15.106:0/3215390437 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:46.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3aa00640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b3c0d37f0 0x7f5b3c158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3b400640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 0x7f5b3c159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3be00640 1 -- 172.21.15.106:0/3215390437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 msgr2=0x7f5b3c159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3be00640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 0x7f5b3c159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3be00640 1 -- 172.21.15.106:0/3215390437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b3c0d37f0 msgr2=0x7f5b3c158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3be00640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b3c0d37f0 0x7f5b3c158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3be00640 1 -- 172.21.15.106:0/3215390437 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c15a000 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b3be00640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b3c15f3d0 0x7f5b3c0c7bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5b3401b020 tx=0x7f5b34019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b33400640 1 -- 172.21.15.106:0/3215390437 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b340b2050 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b33400640 1 -- 172.21.15.106:0/3215390437 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b340be070 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b33400640 1 -- 172.21.15.106:0/3215390437 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b340ad850 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3c15a2e0 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.755+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b3c158680 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.759+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b3c069400 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.759+0000 7f5b33400640 1 -- 172.21.15.106:0/3215390437 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b3c0cee30 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.759+0000 7f5b33400640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5b1c068380 0x7f5b1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.759+0000 7f5b33400640 1 -- 172.21.15.106:0/3215390437 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5b34121a50 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.759+0000 7f5b3b400640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5b1c068380 0x7f5b1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.759+0000 7f5b3b400640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5b1c068380 0x7f5b1c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c007fd0 tx=0x7f5b2c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.763+0000 7f5b33400640 1 -- 172.21.15.106:0/3215390437 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5b34016560 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.951+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b3c15a930 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.951+0000 7f5b33400640 1 -- 172.21.15.106:0/3215390437 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f5b340f17a0 con 0x7f5b3c15f3d0 2024-04-26T21:16:46.956 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:46.956 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:37.854892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:16:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 9 2024-04-26T21:16:46.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5b1c068380 msgr2=0x7f5b1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5b1c068380 0x7f5b1c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c007fd0 tx=0x7f5b2c009040 comp rx=0 tx=0).stop 2024-04-26T21:16:46.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b3c15f3d0 msgr2=0x7f5b3c0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b3c15f3d0 0x7f5b3c0c7bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5b3401b020 tx=0x7f5b34019710 comp rx=0 tx=0).stop 2024-04-26T21:16:46.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 shutdown_connections 2024-04-26T21:16:46.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b3c0d37f0 0x7f5b3c158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5b1c068380 0x7f5b1c06a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b3c15f3d0 0x7f5b3c0c7bb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 --2- 172.21.15.106:0/3215390437 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b3c0cdc50 0x7f5b3c159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 >> 172.21.15.106:0/3215390437 conn(0x7f5b3c0d2c60 msgr2=0x7f5b3c15d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 shutdown_connections 2024-04-26T21:16:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:46.955+0000 7f5b42600640 1 -- 172.21.15.106:0/3215390437 wait complete. 2024-04-26T21:16:46.977 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:47.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.107+0000 7faeffe00640 1 Processor -- start 2024-04-26T21:16:47.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.107+0000 7faeffe00640 1 -- start start 2024-04-26T21:16:47.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faeffe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faef8070470 0x7faef80b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faeffe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faef815dad0 0x7faef80b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faeffe00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef815d030 con 0x7faef80b33c0 2024-04-26T21:16:47.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faeffe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7faef80b43b0 con 0x7faef8070470 2024-04-26T21:16:47.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faeffe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faef80b4600 con 0x7faef815dad0 2024-04-26T21:16:47.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefd400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faef8070470 0x7faef80b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefd400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faef8070470 0x7faef80b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40784/0 (socket says 172.21.15.106:40784) 2024-04-26T21:16:47.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefd400640 1 -- 172.21.15.106:0/168317240 learned_addr learned my addr 172.21.15.106:0/168317240 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:47.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefca00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faef80b33c0 0x7faef815d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49416/0 (socket says 172.21.15.106:49416) 2024-04-26T21:16:47.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefde00640 1 --2- 172.21.15.106:0/168317240 >> v2:172.21.15.112:3300/0 conn(0x7faef815dad0 0x7faef80b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefd400640 1 -- 172.21.15.106:0/168317240 >> v2:172.21.15.112:3300/0 conn(0x7faef815dad0 msgr2=0x7faef80b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:47.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefd400640 1 --2- 172.21.15.106:0/168317240 >> v2:172.21.15.112:3300/0 conn(0x7faef815dad0 0x7faef80b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefd400640 1 -- 172.21.15.106:0/168317240 >> v1:172.21.15.106:6789/0 conn(0x7faef80b33c0 legacy=0x7faef815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefd400640 1 -- 172.21.15.106:0/168317240 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef80b48e0 con 0x7faef8070470 2024-04-26T21:16:47.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.111+0000 7faefd400640 1 --2- 172.21.15.106:0/168317240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef8070470 0x7faef80b50e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faef8073b40 tx=0x7faeec01eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70539b4540a12e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faef7e00640 1 -- 172.21.15.106:0/168317240 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec00b2d0 con 0x7faef8070470 2024-04-26T21:16:47.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faef7e00640 1 -- 172.21.15.106:0/168317240 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec00b470 con 0x7faef8070470 2024-04-26T21:16:47.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faef7e00640 1 -- 172.21.15.106:0/168317240 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec0a7a50 con 0x7faef8070470 2024-04-26T21:16:47.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 -- 172.21.15.106:0/168317240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef8070470 msgr2=0x7faef80b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 --2- 172.21.15.106:0/168317240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef8070470 0x7faef80b50e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faef8073b40 tx=0x7faeec01eb60 comp rx=0 tx=0).stop 2024-04-26T21:16:47.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 -- 172.21.15.106:0/168317240 shutdown_connections 2024-04-26T21:16:47.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 --2- 172.21.15.106:0/168317240 >> v2:172.21.15.112:3300/0 conn(0x7faef815dad0 0x7faef80b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 --2- 172.21.15.106:0/168317240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef8070470 0x7faef80b50e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 -- 172.21.15.106:0/168317240 >> 172.21.15.106:0/168317240 conn(0x7faef806c5d0 msgr2=0x7faef806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 -- 172.21.15.106:0/168317240 shutdown_connections 2024-04-26T21:16:47.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 -- 172.21.15.106:0/168317240 wait complete. 2024-04-26T21:16:47.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 Processor -- start 2024-04-26T21:16:47.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 -- start start 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faef8070470 0x7faef8157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faef80b33c0 0x7faef8159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef815dad0 0x7faef815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faef8072750 con 0x7faef815dad0 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faef815cd00 con 0x7faef80b33c0 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faeffe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faef80728d0 con 0x7faef8070470 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faefde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef815dad0 0x7faef815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.115+0000 7faefde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef815dad0 0x7faef815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40792/0 (socket says 172.21.15.106:40792) 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefde00640 1 -- 172.21.15.106:0/3972776224 learned_addr learned my addr 172.21.15.106:0/3972776224 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:47.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefca00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faef80b33c0 0x7faef8159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefd400640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faef8070470 0x7faef8157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefde00640 1 -- 172.21.15.106:0/3972776224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faef8070470 msgr2=0x7faef8157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefde00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faef8070470 0x7faef8157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefde00640 1 -- 172.21.15.106:0/3972776224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faef80b33c0 msgr2=0x7faef8159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefde00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faef80b33c0 0x7faef8159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefde00640 1 -- 172.21.15.106:0/3972776224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef8157920 con 0x7faef815dad0 2024-04-26T21:16:47.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefde00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef815dad0 0x7faef815b200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faef000e7f0 tx=0x7faef000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faef5600640 1 -- 172.21.15.106:0/3972776224 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0017070 con 0x7faef815dad0 2024-04-26T21:16:47.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faef5600640 1 -- 172.21.15.106:0/3972776224 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef000c940 con 0x7faef815dad0 2024-04-26T21:16:47.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faef5600640 1 -- 172.21.15.106:0/3972776224 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef000eea0 con 0x7faef815dad0 2024-04-26T21:16:47.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef8157c00 con 0x7faef815dad0 2024-04-26T21:16:47.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef81581c0 con 0x7faef815dad0 2024-04-26T21:16:47.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef8069400 con 0x7faef815dad0 2024-04-26T21:16:47.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faef5600640 1 -- 172.21.15.106:0/3972776224 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faef001a070 con 0x7faef815dad0 2024-04-26T21:16:47.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faef5600640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faed8068380 0x7faed806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faef5600640 1 -- 172.21.15.106:0/3972776224 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7faef0086fe0 con 0x7faef815dad0 2024-04-26T21:16:47.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.119+0000 7faefd400640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faed8068380 0x7faed806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.123+0000 7faefd400640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faed8068380 0x7faed806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faeec0b0000 tx=0x7faeec0a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.123+0000 7faef5600640 1 -- 172.21.15.106:0/3972776224 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faef00571e0 con 0x7faef815dad0 2024-04-26T21:16:47.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faef80008e0 con 0x7faef815dad0 2024-04-26T21:16:47.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faef5600640 1 -- 172.21.15.106:0/3972776224 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7faef0056ae0 con 0x7faef815dad0 2024-04-26T21:16:47.286 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:47.287 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:47.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faed8068380 msgr2=0x7faed806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faed8068380 0x7faed806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faeec0b0000 tx=0x7faeec0a9070 comp rx=0 tx=0).stop 2024-04-26T21:16:47.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef815dad0 msgr2=0x7faef815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef815dad0 0x7faef815b200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faef000e7f0 tx=0x7faef000ecb0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 shutdown_connections 2024-04-26T21:16:47.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faef80b33c0 0x7faef8159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faed8068380 0x7faed806a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faef815dad0 0x7faef815b200 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 --2- 172.21.15.106:0/3972776224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faef8070470 0x7faef8157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.283+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 >> 172.21.15.106:0/3972776224 conn(0x7faef806c5d0 msgr2=0x7faef815ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.287+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 shutdown_connections 2024-04-26T21:16:47.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.287+0000 7faeffe00640 1 -- 172.21.15.106:0/3972776224 wait complete. 2024-04-26T21:16:47.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:16:47.309 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:16:47.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.443+0000 7f05c2a00640 1 Processor -- start 2024-04-26T21:16:47.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05c2a00640 1 -- start start 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05c2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05bc15d530 0x7f05bc0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05c2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05bc0b5260 0x7f05bc0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05c2a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc0b44a0 con 0x7f05bc15d910 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05c2a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f05bc0b4780 con 0x7f05bc0b5260 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05c2a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f05bc0b4a60 con 0x7f05bc15d530 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05bb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05bc0b5260 0x7f05bc0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05c0a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f05bc15d910 0x7f05bc15dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49432/0 (socket says 172.21.15.106:49432) 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05c0a00640 1 -- 172.21.15.106:0/373503195 learned_addr learned my addr 172.21.15.106:0/373503195 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05bbe00640 1 --2- 172.21.15.106:0/373503195 >> v2:172.21.15.112:3300/0 conn(0x7f05bc15d530 0x7f05bc0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05bb400640 1 -- 172.21.15.106:0/373503195 >> v2:172.21.15.112:3300/0 conn(0x7f05bc15d530 msgr2=0x7f05bc0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05bb400640 1 --2- 172.21.15.106:0/373503195 >> v2:172.21.15.112:3300/0 conn(0x7f05bc15d530 0x7f05bc0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05bb400640 1 -- 172.21.15.106:0/373503195 >> v1:172.21.15.106:6789/0 conn(0x7f05bc15d910 legacy=0x7f05bc15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05bb400640 1 -- 172.21.15.106:0/373503195 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc0b4d40 con 0x7f05bc0b5260 2024-04-26T21:16:47.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05baa00640 1 -- 172.21.15.106:0/373503195 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4153815253 0 0) 0x7f05bc0b44a0 con 0x7f05bc15d910 2024-04-26T21:16:47.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.447+0000 7f05bbe00640 1 --2- 172.21.15.106:0/373503195 >> v2:172.21.15.112:3300/0 conn(0x7f05bc15d530 0x7f05bc0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:47.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05bb400640 1 --2- 172.21.15.106:0/373503195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc0b5260 0x7f05bc0d0360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f05bc06d900 tx=0x7f05a801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c894fc6f38412352 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05baa00640 1 -- 172.21.15.106:0/373503195 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a80ab640 con 0x7f05bc0b5260 2024-04-26T21:16:47.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05baa00640 1 -- 172.21.15.106:0/373503195 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a80b0070 con 0x7f05bc0b5260 2024-04-26T21:16:47.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05baa00640 1 -- 172.21.15.106:0/373503195 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a80aba00 con 0x7f05bc0b5260 2024-04-26T21:16:47.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 -- 172.21.15.106:0/373503195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc0b5260 msgr2=0x7f05bc0d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 --2- 172.21.15.106:0/373503195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc0b5260 0x7f05bc0d0360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f05bc06d900 tx=0x7f05a801c480 comp rx=0 tx=0).stop 2024-04-26T21:16:47.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 -- 172.21.15.106:0/373503195 shutdown_connections 2024-04-26T21:16:47.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 --2- 172.21.15.106:0/373503195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc0b5260 0x7f05bc0d0360 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 --2- 172.21.15.106:0/373503195 >> v2:172.21.15.112:3300/0 conn(0x7f05bc15d530 0x7f05bc0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 -- 172.21.15.106:0/373503195 >> 172.21.15.106:0/373503195 conn(0x7f05bc0b2910 msgr2=0x7f05bc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 -- 172.21.15.106:0/373503195 shutdown_connections 2024-04-26T21:16:47.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 -- 172.21.15.106:0/373503195 wait complete. 2024-04-26T21:16:47.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 Processor -- start 2024-04-26T21:16:47.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.451+0000 7f05c2a00640 1 -- start start 2024-04-26T21:16:47.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c2a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc0b5260 0x7f05bc15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05bc15d530 0x7f05bc15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc15d910 0x7f05bc15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c2a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc169690 con 0x7f05bc15d910 2024-04-26T21:16:47.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c2a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc169510 con 0x7f05bc0b5260 2024-04-26T21:16:47.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c2a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f05bc169810 con 0x7f05bc15d530 2024-04-26T21:16:47.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c0a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc15d910 0x7f05bc15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c0a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc15d910 0x7f05bc15e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40810/0 (socket says 172.21.15.106:40810) 2024-04-26T21:16:47.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c0a00640 1 -- 172.21.15.106:0/999046747 learned_addr learned my addr 172.21.15.106:0/999046747 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:47.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05bbe00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc0b5260 0x7f05bc15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05bb400640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05bc15d530 0x7f05bc15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c0a00640 1 -- 172.21.15.106:0/999046747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05bc15d530 msgr2=0x7f05bc15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c0a00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05bc15d530 0x7f05bc15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c0a00640 1 -- 172.21.15.106:0/999046747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc0b5260 msgr2=0x7f05bc15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c0a00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc0b5260 0x7f05bc15a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c0a00640 1 -- 172.21.15.106:0/999046747 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc15bb20 con 0x7f05bc15d910 2024-04-26T21:16:47.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05bbe00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc0b5260 0x7f05bc15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:47.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c0a00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc15d910 0x7f05bc15e4f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f05b400c3e0 tx=0x7f05b400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05b3e00640 1 -- 172.21.15.106:0/999046747 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40074e0 con 0x7f05bc15d910 2024-04-26T21:16:47.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05b3e00640 1 -- 172.21.15.106:0/999046747 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b40047f0 con 0x7f05bc15d910 2024-04-26T21:16:47.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc15be00 con 0x7f05bc15d910 2024-04-26T21:16:47.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05b3e00640 1 -- 172.21.15.106:0/999046747 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4004be0 con 0x7f05bc15d910 2024-04-26T21:16:47.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05bc13e0a0 con 0x7f05bc15d910 2024-04-26T21:16:47.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05bc069400 con 0x7f05bc15d910 2024-04-26T21:16:47.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.455+0000 7f05b3e00640 1 -- 172.21.15.106:0/999046747 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05b4011070 con 0x7f05bc15d910 2024-04-26T21:16:47.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.459+0000 7f05b3e00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f059c068380 0x7f059c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.459+0000 7f05b3e00640 1 -- 172.21.15.106:0/999046747 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f05b4086810 con 0x7f05bc15d910 2024-04-26T21:16:47.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.459+0000 7f05bbe00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f059c068380 0x7f059c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.459+0000 7f05bbe00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f059c068380 0x7f059c06a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f05ac003f10 tx=0x7f05ac009890 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.463+0000 7f05b3e00640 1 -- 172.21.15.106:0/999046747 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f05b40563a0 con 0x7f05bc15d910 2024-04-26T21:16:47.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.619+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f05bc06fe50 con 0x7f05bc15d910 2024-04-26T21:16:47.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.619+0000 7f05b3e00640 1 -- 172.21.15.106:0/999046747 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f05b405a6a0 con 0x7f05bc15d910 2024-04-26T21:16:47.627 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:16:47.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f059c068380 msgr2=0x7f059c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f059c068380 0x7f059c06a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f05ac003f10 tx=0x7f05ac009890 comp rx=0 tx=0).stop 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc15d910 msgr2=0x7f05bc15e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc15d910 0x7f05bc15e4f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f05b400c3e0 tx=0x7f05b400c8a0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 shutdown_connections 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f059c068380 0x7f059c06a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05bc15d910 0x7f05bc15e4f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f05bc15d530 0x7f05bc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 --2- 172.21.15.106:0/999046747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05bc0b5260 0x7f05bc15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 >> 172.21.15.106:0/999046747 conn(0x7f05bc0b2910 msgr2=0x7f05bc15dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 shutdown_connections 2024-04-26T21:16:47.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.623+0000 7f05c2a00640 1 -- 172.21.15.106:0/999046747 wait complete. 2024-04-26T21:16:47.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:16:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f0091600640 1 Processor -- start 2024-04-26T21:16:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f0091600640 1 -- start start 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f0091600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f008c0ce590 0x7f008c15e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f0091600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c06dee0 con 0x7f008c162bf0 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f0091600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c06e1c0 con 0x7f008c0d1e50 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f0091600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f008c06eaf0 con 0x7f008c0ce590 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f008b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f008c0ce590 0x7f008c15e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f008b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f008c0ce590 0x7f008c15e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40824/0 (socket says 172.21.15.106:40824) 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f008aa00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f008c162bf0 0x7f008c06d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49440/0 (socket says 172.21.15.106:49440) 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f008b400640 1 -- 172.21.15.106:0/2144189877 learned_addr learned my addr 172.21.15.106:0/2144189877 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f008b400640 1 -- 172.21.15.106:0/2144189877 >> v1:172.21.15.112:6789/0 conn(0x7f008c0d1e50 legacy=0x7f008c162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f008b400640 1 -- 172.21.15.106:0/2144189877 >> v1:172.21.15.106:6789/0 conn(0x7f008c162bf0 legacy=0x7f008c06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.779+0000 7f008b400640 1 -- 172.21.15.106:0/2144189877 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c06e4a0 con 0x7f008c0ce590 2024-04-26T21:16:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f008b400640 1 --2- 172.21.15.106:0/2144189877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c0ce590 0x7f008c15e8c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0084009e50 tx=0x7f008401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184d9dfc3e483b12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0089600640 1 -- 172.21.15.106:0/2144189877 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840a57d0 con 0x7f008c0ce590 2024-04-26T21:16:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0089600640 1 -- 172.21.15.106:0/2144189877 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00840a5970 con 0x7f008c0ce590 2024-04-26T21:16:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0089600640 1 -- 172.21.15.106:0/2144189877 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840a5d40 con 0x7f008c0ce590 2024-04-26T21:16:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0091600640 1 -- 172.21.15.106:0/2144189877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c0ce590 msgr2=0x7f008c15e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0091600640 1 --2- 172.21.15.106:0/2144189877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c0ce590 0x7f008c15e8c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0084009e50 tx=0x7f008401c970 comp rx=0 tx=0).stop 2024-04-26T21:16:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0091600640 1 -- 172.21.15.106:0/2144189877 shutdown_connections 2024-04-26T21:16:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0091600640 1 --2- 172.21.15.106:0/2144189877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c0ce590 0x7f008c15e8c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0091600640 1 -- 172.21.15.106:0/2144189877 >> 172.21.15.106:0/2144189877 conn(0x7f008c0d2c50 msgr2=0x7f008c0d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0091600640 1 -- 172.21.15.106:0/2144189877 shutdown_connections 2024-04-26T21:16:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.783+0000 7f0091600640 1 -- 172.21.15.106:0/2144189877 wait complete. 2024-04-26T21:16:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 Processor -- start 2024-04-26T21:16:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 -- start start 2024-04-26T21:16:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c0ce590 0x7f008c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f008c0d1e50 0x7f008c0cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c162bf0 0x7f008c0cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f008c16cb00 con 0x7f008c162bf0 2024-04-26T21:16:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f008c16c980 con 0x7f008c0ce590 2024-04-26T21:16:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f008c16cc80 con 0x7f008c0d1e50 2024-04-26T21:16:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c162bf0 0x7f008c0cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008aa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c0ce590 0x7f008c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c162bf0 0x7f008c0cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40838/0 (socket says 172.21.15.106:40838) 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008b400640 1 -- 172.21.15.106:0/696389719 learned_addr learned my addr 172.21.15.106:0/696389719 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008a000640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f008c0d1e50 0x7f008c0cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008b400640 1 -- 172.21.15.106:0/696389719 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f008c0d1e50 msgr2=0x7f008c0cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008b400640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f008c0d1e50 0x7f008c0cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008b400640 1 -- 172.21.15.106:0/696389719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c0ce590 msgr2=0x7f008c15bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008b400640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c0ce590 0x7f008c15bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008b400640 1 -- 172.21.15.106:0/696389719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c0cba40 con 0x7f008c162bf0 2024-04-26T21:16:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f008b400640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c162bf0 0x7f008c0cf800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f00840af040 tx=0x7f0084019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0082a00640 1 -- 172.21.15.106:0/696389719 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840bc020 con 0x7f008c162bf0 2024-04-26T21:16:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0082a00640 1 -- 172.21.15.106:0/696389719 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00840b8690 con 0x7f008c162bf0 2024-04-26T21:16:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0082a00640 1 -- 172.21.15.106:0/696389719 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840b8a80 con 0x7f008c162bf0 2024-04-26T21:16:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c0cbd20 con 0x7f008c162bf0 2024-04-26T21:16:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.787+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c15c010 con 0x7f008c162bf0 2024-04-26T21:16:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.791+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f008c069400 con 0x7f008c162bf0 2024-04-26T21:16:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.791+0000 7f0082a00640 1 -- 172.21.15.106:0/696389719 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00840bf020 con 0x7f008c162bf0 2024-04-26T21:16:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.791+0000 7f0082a00640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f006c068380 0x7f006c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.791+0000 7f0082a00640 1 -- 172.21.15.106:0/696389719 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0084121c10 con 0x7f008c162bf0 2024-04-26T21:16:47.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.791+0000 7f008aa00640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f006c068380 0x7f006c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.791+0000 7f008aa00640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f006c068380 0x7f006c06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f70 tx=0x7f007c007e50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.795+0000 7f0082a00640 1 -- 172.21.15.106:0/696389719 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f00840c6030 con 0x7f008c162bf0 2024-04-26T21:16:47.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f008c0b5220 con 0x7f008c162bf0 2024-04-26T21:16:47.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0082a00640 1 -- 172.21.15.106:0/696389719 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f0084016620 con 0x7f008c162bf0 2024-04-26T21:16:47.958 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:16:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f006c068380 msgr2=0x7f006c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f006c068380 0x7f006c06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f70 tx=0x7f007c007e50 comp rx=0 tx=0).stop 2024-04-26T21:16:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c162bf0 msgr2=0x7f008c0cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c162bf0 0x7f008c0cf800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f00840af040 tx=0x7f0084019710 comp rx=0 tx=0).stop 2024-04-26T21:16:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 shutdown_connections 2024-04-26T21:16:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f006c068380 0x7f006c06a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f008c162bf0 0x7f008c0cf800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f008c0d1e50 0x7f008c0cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 --2- 172.21.15.106:0/696389719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f008c0ce590 0x7f008c15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 >> 172.21.15.106:0/696389719 conn(0x7f008c0d2c50 msgr2=0x7f008c0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 shutdown_connections 2024-04-26T21:16:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:47.955+0000 7f0091600640 1 -- 172.21.15.106:0/696389719 wait complete. 2024-04-26T21:16:47.979 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:16:48.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.119+0000 7fc3bb000640 1 Processor -- start 2024-04-26T21:16:48.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.119+0000 7fc3bb000640 1 -- start start 2024-04-26T21:16:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.119+0000 7fc3bb000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b415be20 0x7fc3b40d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.119+0000 7fc3bb000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3b40732d0 0x7fc3b4070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.119+0000 7fc3bb000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b40d0050 con 0x7fc3b40b0b00 2024-04-26T21:16:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.119+0000 7fc3bb000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b406fd70 con 0x7fc3b40732d0 2024-04-26T21:16:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.119+0000 7fc3bb000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b40d0310 con 0x7fc3b415be20 2024-04-26T21:16:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3ba600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3b40732d0 0x7fc3b4070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3ba600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3b40732d0 0x7fc3b4070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40844/0 (socket says 172.21.15.106:40844) 2024-04-26T21:16:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3ba600640 1 -- 172.21.15.106:0/702518642 learned_addr learned my addr 172.21.15.106:0/702518642 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3b9c00640 1 --2- 172.21.15.106:0/702518642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b415be20 0x7fc3b40d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3ba600640 1 -- 172.21.15.106:0/702518642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b415be20 msgr2=0x7fc3b40d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3ba600640 1 --2- 172.21.15.106:0/702518642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b415be20 0x7fc3b40d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3ba600640 1 -- 172.21.15.106:0/702518642 >> v1:172.21.15.112:6789/0 conn(0x7fc3b40b0b00 legacy=0x7fc3b4072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3ba600640 1 -- 172.21.15.106:0/702518642 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b40d10d0 con 0x7fc3b40732d0 2024-04-26T21:16:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3ba600640 1 --2- 172.21.15.106:0/702518642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40732d0 0x7fc3b4070200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009e50 tx=0x7fc3ac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caaac13c7641315d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3b3e00640 1 -- 172.21.15.106:0/702518642 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0a5770 con 0x7fc3b40732d0 2024-04-26T21:16:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3b3e00640 1 -- 172.21.15.106:0/702518642 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ac0a5910 con 0x7fc3b40732d0 2024-04-26T21:16:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.123+0000 7fc3b3e00640 1 -- 172.21.15.106:0/702518642 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0a5ce0 con 0x7fc3b40732d0 2024-04-26T21:16:48.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 -- 172.21.15.106:0/702518642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40732d0 msgr2=0x7fc3b4070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 --2- 172.21.15.106:0/702518642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40732d0 0x7fc3b4070200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009e50 tx=0x7fc3ac01c9a0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 -- 172.21.15.106:0/702518642 shutdown_connections 2024-04-26T21:16:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 --2- 172.21.15.106:0/702518642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40732d0 0x7fc3b4070200 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 --2- 172.21.15.106:0/702518642 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b415be20 0x7fc3b40d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 -- 172.21.15.106:0/702518642 >> 172.21.15.106:0/702518642 conn(0x7fc3b40d18f0 msgr2=0x7fc3b40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 -- 172.21.15.106:0/702518642 shutdown_connections 2024-04-26T21:16:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 -- 172.21.15.106:0/702518642 wait complete. 2024-04-26T21:16:48.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 Processor -- start 2024-04-26T21:16:48.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 -- start start 2024-04-26T21:16:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b40732d0 0x7fc3b40c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40b0b00 0x7fc3b40cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b415be20 0x7fc3b414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4168d90 con 0x7fc3b40b0b00 2024-04-26T21:16:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4168f10 con 0x7fc3b415be20 2024-04-26T21:16:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3bb000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b4169090 con 0x7fc3b40732d0 2024-04-26T21:16:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40b0b00 0x7fc3b40cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3b9c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b40732d0 0x7fc3b40c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40b0b00 0x7fc3b40cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40856/0 (socket says 172.21.15.106:40856) 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3b9200640 1 -- 172.21.15.106:0/553949188 learned_addr learned my addr 172.21.15.106:0/553949188 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.127+0000 7fc3ba600640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b415be20 0x7fc3b414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b9200640 1 -- 172.21.15.106:0/553949188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b40732d0 msgr2=0x7fc3b40c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b9200640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b40732d0 0x7fc3b40c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b9200640 1 -- 172.21.15.106:0/553949188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b415be20 msgr2=0x7fc3b414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b9200640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b415be20 0x7fc3b414ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b9200640 1 -- 172.21.15.106:0/553949188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b40c8130 con 0x7fc3b40b0b00 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b9200640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40b0b00 0x7fc3b40cb1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000c430 tx=0x7fc3a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b1600640 1 -- 172.21.15.106:0/553949188 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00052d0 con 0x7fc3b40b0b00 2024-04-26T21:16:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b1600640 1 -- 172.21.15.106:0/553949188 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a0005470 con 0x7fc3b40b0b00 2024-04-26T21:16:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b40b4fa0 con 0x7fc3b40b0b00 2024-04-26T21:16:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b1600640 1 -- 172.21.15.106:0/553949188 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0007260 con 0x7fc3b40b0b00 2024-04-26T21:16:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b40b5560 con 0x7fc3b40b0b00 2024-04-26T21:16:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b40506d0 con 0x7fc3b40b0b00 2024-04-26T21:16:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b1600640 1 -- 172.21.15.106:0/553949188 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc3a0007400 con 0x7fc3b40b0b00 2024-04-26T21:16:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b1600640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc394068380 0x7fc39406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b1600640 1 -- 172.21.15.106:0/553949188 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc3a00861b0 con 0x7fc3b40b0b00 2024-04-26T21:16:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.131+0000 7fc3b9c00640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc394068380 0x7fc39406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.135+0000 7fc3b9c00640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc394068380 0x7fc39406a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009ac0 tx=0x7fc3a8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.135+0000 7fc3b1600640 1 -- 172.21.15.106:0/553949188 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc3a0055dd0 con 0x7fc3b40b0b00 2024-04-26T21:16:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc3b4073cb0 con 0x7fc3b40b0b00 2024-04-26T21:16:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3b1600640 1 -- 172.21.15.106:0/553949188 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fc3a005a0d0 con 0x7fc3b40b0b00 2024-04-26T21:16:48.305 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:16:48.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc394068380 msgr2=0x7fc39406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc394068380 0x7fc39406a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009ac0 tx=0x7fc3a8009190 comp rx=0 tx=0).stop 2024-04-26T21:16:48.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40b0b00 msgr2=0x7fc3b40cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40b0b00 0x7fc3b40cb1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000c430 tx=0x7fc3a000c8f0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 shutdown_connections 2024-04-26T21:16:48.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3b415be20 0x7fc3b414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc394068380 0x7fc39406a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3b40b0b00 0x7fc3b40cb1f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 --2- 172.21.15.106:0/553949188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc3b40732d0 0x7fc3b40c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 >> 172.21.15.106:0/553949188 conn(0x7fc3b40d18f0 msgr2=0x7fc3b40b7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 shutdown_connections 2024-04-26T21:16:48.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.303+0000 7fc3bb000640 1 -- 172.21.15.106:0/553949188 wait complete. 2024-04-26T21:16:48.327 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:16:48.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.463+0000 7f33c3200640 1 Processor -- start 2024-04-26T21:16:48.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.463+0000 7f33c3200640 1 -- start start 2024-04-26T21:16:48.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c3200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33c40d35d0 0x7f33c40b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c3200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c40d1910 con 0x7f33c40d11c0 2024-04-26T21:16:48.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c3200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c40b4330 con 0x7f33c41603f0 2024-04-26T21:16:48.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c3200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f33c40b3030 con 0x7f33c40d35d0 2024-04-26T21:16:48.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c1400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f33c40d11c0 0x7f33c40b0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49444/0 (socket says 172.21.15.106:49444) 2024-04-26T21:16:48.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c1400640 1 -- 172.21.15.106:0/1384006275 learned_addr learned my addr 172.21.15.106:0/1384006275 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:48.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c2800640 1 --2- 172.21.15.106:0/1384006275 >> v2:172.21.15.112:3300/0 conn(0x7f33c40d35d0 0x7f33c40b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c0a00640 1 -- 172.21.15.106:0/1384006275 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027341397 0 0) 0x7f33b0001120 con 0x7f33c40d11c0 2024-04-26T21:16:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c0a00640 1 -- 172.21.15.106:0/1384006275 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33a8003530 con 0x7f33c40d11c0 2024-04-26T21:16:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c2800640 1 -- 172.21.15.106:0/1384006275 >> v1:172.21.15.112:6789/0 conn(0x7f33c41603f0 legacy=0x7f33c40d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c2800640 1 -- 172.21.15.106:0/1384006275 >> v1:172.21.15.106:6789/0 conn(0x7f33c40d11c0 legacy=0x7f33c40b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.467+0000 7f33c2800640 1 -- 172.21.15.106:0/1384006275 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c40b3310 con 0x7f33c40d35d0 2024-04-26T21:16:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c2800640 1 --2- 172.21.15.106:0/1384006275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c40d35d0 0x7f33c40b11a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009d90 tx=0x7f33c40b1ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f13a0b41ee8dd0a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c0a00640 1 -- 172.21.15.106:0/1384006275 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0b2070 con 0x7f33c40d35d0 2024-04-26T21:16:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c0a00640 1 -- 172.21.15.106:0/1384006275 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc0a5a20 con 0x7f33c40d35d0 2024-04-26T21:16:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c0a00640 1 -- 172.21.15.106:0/1384006275 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0a5df0 con 0x7f33c40d35d0 2024-04-26T21:16:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c3200640 1 -- 172.21.15.106:0/1384006275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c40d35d0 msgr2=0x7f33c40b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c3200640 1 --2- 172.21.15.106:0/1384006275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c40d35d0 0x7f33c40b11a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009d90 tx=0x7f33c40b1ef0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c3200640 1 -- 172.21.15.106:0/1384006275 shutdown_connections 2024-04-26T21:16:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c3200640 1 --2- 172.21.15.106:0/1384006275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c40d35d0 0x7f33c40b11a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c3200640 1 -- 172.21.15.106:0/1384006275 >> 172.21.15.106:0/1384006275 conn(0x7f33c40d2ab0 msgr2=0x7f33c40d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c3200640 1 -- 172.21.15.106:0/1384006275 shutdown_connections 2024-04-26T21:16:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c3200640 1 -- 172.21.15.106:0/1384006275 wait complete. 2024-04-26T21:16:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c3200640 1 Processor -- start 2024-04-26T21:16:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.471+0000 7f33c3200640 1 -- start start 2024-04-26T21:16:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c3200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33c40d11c0 0x7f33c414bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c3200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c40d35d0 0x7f33c414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c3200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33c41603f0 0x7f33c41503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c3200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f33c40b4090 con 0x7f33c40d11c0 2024-04-26T21:16:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c3200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33c40b3f10 con 0x7f33c40d35d0 2024-04-26T21:16:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c3200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f33c416ac00 con 0x7f33c41603f0 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33c40d11c0 0x7f33c414bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33c40d11c0 0x7f33c414bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40866/0 (socket says 172.21.15.106:40866) 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1e00640 1 -- 172.21.15.106:0/1506134229 learned_addr learned my addr 172.21.15.106:0/1506134229 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1400640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c40d35d0 0x7f33c414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c2800640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33c41603f0 0x7f33c41503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1e00640 1 -- 172.21.15.106:0/1506134229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33c41603f0 msgr2=0x7f33c41503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1e00640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33c41603f0 0x7f33c41503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1e00640 1 -- 172.21.15.106:0/1506134229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c40d35d0 msgr2=0x7f33c414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1e00640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c40d35d0 0x7f33c414fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1e00640 1 -- 172.21.15.106:0/1506134229 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c414c510 con 0x7f33c40d11c0 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c1e00640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33c40d11c0 0x7f33c414bfd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c370 tx=0x7f33b400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33ba000640 1 -- 172.21.15.106:0/1506134229 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b40052d0 con 0x7f33c40d11c0 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33ba000640 1 -- 172.21.15.106:0/1506134229 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b4005470 con 0x7f33c40d11c0 2024-04-26T21:16:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33ba000640 1 -- 172.21.15.106:0/1506134229 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4007260 con 0x7f33c40d11c0 2024-04-26T21:16:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c40c9ed0 con 0x7f33c40d11c0 2024-04-26T21:16:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c40ca490 con 0x7f33c40d11c0 2024-04-26T21:16:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c40506d0 con 0x7f33c40d11c0 2024-04-26T21:16:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.475+0000 7f33ba000640 1 -- 172.21.15.106:0/1506134229 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33b4007400 con 0x7f33c40d11c0 2024-04-26T21:16:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.479+0000 7f33ba000640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33a40683b0 0x7f33a406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.479+0000 7f33ba000640 1 -- 172.21.15.106:0/1506134229 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f33b4086260 con 0x7f33c40d11c0 2024-04-26T21:16:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.479+0000 7f33c1400640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33a40683b0 0x7f33a406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.479+0000 7f33c1400640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33a40683b0 0x7f33a406a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33c40c8e00 tx=0x7f33b0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.483+0000 7f33ba000640 1 -- 172.21.15.106:0/1506134229 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f33b4055ce0 con 0x7f33c40d11c0 2024-04-26T21:16:48.545 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:16:48.549 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:16:48.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.643+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f33c415f330 con 0x7f33c40d11c0 2024-04-26T21:16:48.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.643+0000 7f33ba000640 1 -- 172.21.15.106:0/1506134229 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f33b4059fe0 con 0x7f33c40d11c0 2024-04-26T21:16:48.650 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:16:48.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33a40683b0 msgr2=0x7f33a406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33a40683b0 0x7f33a406a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33c40c8e00 tx=0x7f33b0009040 comp rx=0 tx=0).stop 2024-04-26T21:16:48.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33c40d11c0 msgr2=0x7f33c414bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33c40d11c0 0x7f33c414bfd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c370 tx=0x7f33b400c830 comp rx=0 tx=0).stop 2024-04-26T21:16:48.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 shutdown_connections 2024-04-26T21:16:48.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c40d35d0 0x7f33c414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33a40683b0 0x7f33a406a870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33c41603f0 0x7f33c41503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 --2- 172.21.15.106:0/1506134229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33c40d11c0 0x7f33c414bfd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 >> 172.21.15.106:0/1506134229 conn(0x7f33c40d2ab0 msgr2=0x7f33c40b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 shutdown_connections 2024-04-26T21:16:48.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.647+0000 7f33c3200640 1 -- 172.21.15.106:0/1506134229 wait complete. 2024-04-26T21:16:48.668 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:16:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.799+0000 7f309a600640 1 Processor -- start 2024-04-26T21:16:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.799+0000 7f309a600640 1 -- start start 2024-04-26T21:16:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.799+0000 7f309a600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f309413ed60 0x7f309415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.799+0000 7f309a600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f309413f140 0x7f30940b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f309a600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30940b3d10 con 0x7f309406eb70 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f309a600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f30940b3ac0 con 0x7f309413ed60 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f309a600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f30940b4920 con 0x7f309413f140 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3093400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f309413ed60 0x7f309415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3093400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f309413ed60 0x7f309415c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40868/0 (socket says 172.21.15.106:40868) 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3093400640 1 -- 172.21.15.106:0/137487027 learned_addr learned my addr 172.21.15.106:0/137487027 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3092a00640 1 --2- 172.21.15.106:0/137487027 >> v2:172.21.15.112:3300/0 conn(0x7f309413f140 0x7f30940b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3093400640 1 -- 172.21.15.106:0/137487027 >> v2:172.21.15.112:3300/0 conn(0x7f309413f140 msgr2=0x7f30940b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3093400640 1 --2- 172.21.15.106:0/137487027 >> v2:172.21.15.112:3300/0 conn(0x7f309413f140 0x7f30940b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3093400640 1 -- 172.21.15.106:0/137487027 >> v1:172.21.15.112:6789/0 conn(0x7f309406eb70 legacy=0x7f30940d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3093400640 1 -- 172.21.15.106:0/137487027 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30940b3ff0 con 0x7f309413ed60 2024-04-26T21:16:48.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3092a00640 1 --2- 172.21.15.106:0/137487027 >> v2:172.21.15.112:3300/0 conn(0x7f309413f140 0x7f30940b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:48.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3093400640 1 --2- 172.21.15.106:0/137487027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 0x7f309415c3e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f309415f930 tx=0x7f307c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92b5ce0771329a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3092000640 1 -- 172.21.15.106:0/137487027 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c0ab600 con 0x7f309413ed60 2024-04-26T21:16:48.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.803+0000 7f3092000640 1 -- 172.21.15.106:0/137487027 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307c0b0070 con 0x7f309413ed60 2024-04-26T21:16:48.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f3092000640 1 -- 172.21.15.106:0/137487027 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c0ab9c0 con 0x7f309413ed60 2024-04-26T21:16:48.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 -- 172.21.15.106:0/137487027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 msgr2=0x7f309415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 --2- 172.21.15.106:0/137487027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 0x7f309415c3e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f309415f930 tx=0x7f307c01c400 comp rx=0 tx=0).stop 2024-04-26T21:16:48.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 -- 172.21.15.106:0/137487027 shutdown_connections 2024-04-26T21:16:48.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 --2- 172.21.15.106:0/137487027 >> v2:172.21.15.112:3300/0 conn(0x7f309413f140 0x7f30940b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 --2- 172.21.15.106:0/137487027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 0x7f309415c3e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 -- 172.21.15.106:0/137487027 >> 172.21.15.106:0/137487027 conn(0x7f3094068340 msgr2=0x7f3094068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 -- 172.21.15.106:0/137487027 shutdown_connections 2024-04-26T21:16:48.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 -- 172.21.15.106:0/137487027 wait complete. 2024-04-26T21:16:48.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 Processor -- start 2024-04-26T21:16:48.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 -- start start 2024-04-26T21:16:48.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 0x7f30940b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30940b0960 0x7f30941fa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30941fae80 0x7f3094156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f30940d1680 con 0x7f309413ed60 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f30940d1500 con 0x7f30940b0960 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f309a600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3094160420 con 0x7f30941fae80 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f3093400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 0x7f30940b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f3093400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 0x7f30940b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40878/0 (socket says 172.21.15.106:40878) 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f3093400640 1 -- 172.21.15.106:0/3245069091 learned_addr learned my addr 172.21.15.106:0/3245069091 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f3092a00640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30940b0960 0x7f30941fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.807+0000 7f3093e00640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30941fae80 0x7f3094156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f3093400640 1 -- 172.21.15.106:0/3245069091 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30941fae80 msgr2=0x7f3094156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f3093400640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30941fae80 0x7f3094156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f3093400640 1 -- 172.21.15.106:0/3245069091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30940b0960 msgr2=0x7f30941fa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f3093400640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30940b0960 0x7f30941fa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f3093400640 1 -- 172.21.15.106:0/3245069091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3094155b50 con 0x7f309413ed60 2024-04-26T21:16:48.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f3093400640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 0x7f30940b3020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f307c0ad040 tx=0x7f307c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f308b400640 1 -- 172.21.15.106:0/3245069091 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c0be5f0 con 0x7f309413ed60 2024-04-26T21:16:48.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f308b400640 1 -- 172.21.15.106:0/3245069091 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307c0be790 con 0x7f309413ed60 2024-04-26T21:16:48.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f308b400640 1 -- 172.21.15.106:0/3245069091 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c0beb60 con 0x7f309413ed60 2024-04-26T21:16:48.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3094155e30 con 0x7f309413ed60 2024-04-26T21:16:48.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30941563f0 con 0x7f309413ed60 2024-04-26T21:16:48.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3094069400 con 0x7f309413ed60 2024-04-26T21:16:48.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f308b400640 1 -- 172.21.15.106:0/3245069091 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f307c0aa070 con 0x7f309413ed60 2024-04-26T21:16:48.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f308b400640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3070068380 0x7f307006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f308b400640 1 -- 172.21.15.106:0/3245069091 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f307c121450 con 0x7f309413ed60 2024-04-26T21:16:48.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.811+0000 7f3092a00640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3070068380 0x7f307006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.815+0000 7f3092a00640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3070068380 0x7f307006a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f309415d200 tx=0x7f3084008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:48.815+0000 7f308b400640 1 -- 172.21.15.106:0/3245069091 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f307c016110 con 0x7f309413ed60 2024-04-26T21:16:49.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.007+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f309415cae0 con 0x7f309413ed60 2024-04-26T21:16:49.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.007+0000 7f308b400640 1 -- 172.21.15.106:0/3245069091 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f307c0f1230 con 0x7f309413ed60 2024-04-26T21:16:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:49.011 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:37.854892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:16:49.011 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 9 2024-04-26T21:16:49.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3070068380 msgr2=0x7f307006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3070068380 0x7f307006a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f309415d200 tx=0x7f3084008040 comp rx=0 tx=0).stop 2024-04-26T21:16:49.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 msgr2=0x7f30940b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 0x7f30940b3020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f307c0ad040 tx=0x7f307c01ac40 comp rx=0 tx=0).stop 2024-04-26T21:16:49.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 shutdown_connections 2024-04-26T21:16:49.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30940b0960 0x7f30941fa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3070068380 0x7f307006a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f30941fae80 0x7f3094156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 --2- 172.21.15.106:0/3245069091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f309413ed60 0x7f30940b3020 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 >> 172.21.15.106:0/3245069091 conn(0x7f3094068340 msgr2=0x7f3094165120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:49.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 shutdown_connections 2024-04-26T21:16:49.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.011+0000 7f309a600640 1 -- 172.21.15.106:0/3245069091 wait complete. 2024-04-26T21:16:49.032 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:16:49.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.163+0000 7fecdb800640 1 Processor -- start 2024-04-26T21:16:49.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.163+0000 7fecdb800640 1 -- start start 2024-04-26T21:16:49.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.163+0000 7fecdb800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fecd413f140 0x7fecd415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.163+0000 7fecdb800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd406eb70 0x7fecd40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.163+0000 7fecdb800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd40b3d10 con 0x7fecd413ed60 2024-04-26T21:16:49.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.163+0000 7fecdb800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fecd40b3ac0 con 0x7fecd413f140 2024-04-26T21:16:49.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.163+0000 7fecdb800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fecd40b4920 con 0x7fecd406eb70 2024-04-26T21:16:49.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.163+0000 7fecd8e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fecd413ed60 0x7fecd40b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49446/0 (socket says 172.21.15.106:49446) 2024-04-26T21:16:49.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.163+0000 7fecd8e00640 1 -- 172.21.15.106:0/4278979785 learned_addr learned my addr 172.21.15.106:0/4278979785 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:49.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd9800640 1 --2- 172.21.15.106:0/4278979785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd406eb70 0x7fecd40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd3e00640 1 --2- 172.21.15.106:0/4278979785 >> v2:172.21.15.112:3300/0 conn(0x7fecd413f140 0x7fecd415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd3400640 1 -- 172.21.15.106:0/4278979785 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997678530 0 0) 0x7fecd40b3d10 con 0x7fecd413ed60 2024-04-26T21:16:49.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd3400640 1 -- 172.21.15.106:0/4278979785 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecb8003530 con 0x7fecd413ed60 2024-04-26T21:16:49.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd3400640 1 -- 172.21.15.106:0/4278979785 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2810804018 0 0) 0x7fecb8003530 con 0x7fecd413ed60 2024-04-26T21:16:49.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd9800640 1 -- 172.21.15.106:0/4278979785 >> v2:172.21.15.112:3300/0 conn(0x7fecd413f140 msgr2=0x7fecd415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:49.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd9800640 1 --2- 172.21.15.106:0/4278979785 >> v2:172.21.15.112:3300/0 conn(0x7fecd413f140 0x7fecd415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd9800640 1 -- 172.21.15.106:0/4278979785 >> v1:172.21.15.106:6789/0 conn(0x7fecd413ed60 legacy=0x7fecd40b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd9800640 1 -- 172.21.15.106:0/4278979785 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd40b3ff0 con 0x7fecd406eb70 2024-04-26T21:16:49.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd3e00640 1 --2- 172.21.15.106:0/4278979785 >> v2:172.21.15.112:3300/0 conn(0x7fecd413f140 0x7fecd415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:49.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.167+0000 7fecd9800640 1 --2- 172.21.15.106:0/4278979785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd406eb70 0x7fecd40d0df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fecd40b3c40 tx=0x7feccc01c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a6e20907eb4cd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:49.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecd3400640 1 -- 172.21.15.106:0/4278979785 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc0b0070 con 0x7fecd406eb70 2024-04-26T21:16:49.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecd3400640 1 -- 172.21.15.106:0/4278979785 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feccc0ab400 con 0x7fecd406eb70 2024-04-26T21:16:49.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecd3400640 1 -- 172.21.15.106:0/4278979785 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4001a00 con 0x7fecd406eb70 2024-04-26T21:16:49.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 -- 172.21.15.106:0/4278979785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd406eb70 msgr2=0x7fecd40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 --2- 172.21.15.106:0/4278979785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd406eb70 0x7fecd40d0df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fecd40b3c40 tx=0x7feccc01c2a0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 -- 172.21.15.106:0/4278979785 shutdown_connections 2024-04-26T21:16:49.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 --2- 172.21.15.106:0/4278979785 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd406eb70 0x7fecd40d0df0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 --2- 172.21.15.106:0/4278979785 >> v2:172.21.15.112:3300/0 conn(0x7fecd413f140 0x7fecd415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 -- 172.21.15.106:0/4278979785 >> 172.21.15.106:0/4278979785 conn(0x7fecd4068340 msgr2=0x7fecd4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:49.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 -- 172.21.15.106:0/4278979785 shutdown_connections 2024-04-26T21:16:49.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 -- 172.21.15.106:0/4278979785 wait complete. 2024-04-26T21:16:49.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 Processor -- start 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 -- start start 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd413ed60 0x7fecd41feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecd41fbf20 0x7fecd41ff490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecd41ff9d0 0x7fecd41636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fecd41607b0 con 0x7fecd41fbf20 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fecd4160630 con 0x7fecd41ff9d0 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecdb800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fecd4071f50 con 0x7fecd413ed60 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecd3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecd41fbf20 0x7fecd41ff490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecd3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecd41fbf20 0x7fecd41ff490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40894/0 (socket says 172.21.15.106:40894) 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecd3e00640 1 -- 172.21.15.106:0/1764634030 learned_addr learned my addr 172.21.15.106:0/1764634030 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:49.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecd9800640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecd41ff9d0 0x7fecd41636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.171+0000 7fecd8e00640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd413ed60 0x7fecd41feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd3e00640 1 -- 172.21.15.106:0/1764634030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd413ed60 msgr2=0x7fecd41feea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd3e00640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd413ed60 0x7fecd41feea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd3e00640 1 -- 172.21.15.106:0/1764634030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecd41ff9d0 msgr2=0x7fecd41636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd3e00640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecd41ff9d0 0x7fecd41636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd3e00640 1 -- 172.21.15.106:0/1764634030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd40b1680 con 0x7fecd41fbf20 2024-04-26T21:16:49.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd3e00640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecd41fbf20 0x7fecd41ff490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fecc000e9b0 tx=0x7fecc000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:49.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd0c00640 1 -- 172.21.15.106:0/1764634030 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0017070 con 0x7fecd41fbf20 2024-04-26T21:16:49.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd0c00640 1 -- 172.21.15.106:0/1764634030 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc000ca00 con 0x7fecd41fbf20 2024-04-26T21:16:49.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd41643c0 con 0x7fecd41fbf20 2024-04-26T21:16:49.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd0c00640 1 -- 172.21.15.106:0/1764634030 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc000cdd0 con 0x7fecd41fbf20 2024-04-26T21:16:49.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd40b1c20 con 0x7fecd41fbf20 2024-04-26T21:16:49.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd4069400 con 0x7fecd41fbf20 2024-04-26T21:16:49.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd0c00640 1 -- 172.21.15.106:0/1764634030 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fecc001a070 con 0x7fecd41fbf20 2024-04-26T21:16:49.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.175+0000 7fecd0c00640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fecb40683b0 0x7fecb406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.179+0000 7fecd0c00640 1 -- 172.21.15.106:0/1764634030 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fecc0086f70 con 0x7fecd41fbf20 2024-04-26T21:16:49.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.179+0000 7fecd8e00640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fecb40683b0 0x7fecb406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.179+0000 7fecd8e00640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fecb40683b0 0x7fecb406a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecd415c040 tx=0x7fecc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:49.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.183+0000 7fecd0c00640 1 -- 172.21.15.106:0/1764634030 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fecc0057150 con 0x7fecd41fbf20 2024-04-26T21:16:49.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.339+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecd40d0040 con 0x7fecd41fbf20 2024-04-26T21:16:49.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecd0c00640 1 -- 172.21.15.106:0/1764634030 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7fecc0056a50 con 0x7fecd41fbf20 2024-04-26T21:16:49.346 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:49.346 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fecb40683b0 msgr2=0x7fecb406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fecb40683b0 0x7fecb406a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecd415c040 tx=0x7fecc4009040 comp rx=0 tx=0).stop 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecd41fbf20 msgr2=0x7fecd41ff490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecd41fbf20 0x7fecd41ff490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fecc000e9b0 tx=0x7fecc000ee70 comp rx=0 tx=0).stop 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 shutdown_connections 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecd41ff9d0 0x7fecd41636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fecb40683b0 0x7fecb406a870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecd41fbf20 0x7fecd41ff490 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 --2- 172.21.15.106:0/1764634030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecd413ed60 0x7fecd41feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 >> 172.21.15.106:0/1764634030 conn(0x7fecd4068340 msgr2=0x7fecd413d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 shutdown_connections 2024-04-26T21:16:49.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.343+0000 7fecdb800640 1 -- 172.21.15.106:0/1764634030 wait complete. 2024-04-26T21:16:49.367 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:16:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.499+0000 7f8edd800640 1 Processor -- start 2024-04-26T21:16:49.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.499+0000 7f8edd800640 1 -- start start 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.499+0000 7f8edd800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed815f4d0 0x7f8ed80706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.499+0000 7f8edd800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ed806f2e0 0x7f8ed8070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.499+0000 7f8edd800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed80d1f40 con 0x7f8ed8071170 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.499+0000 7f8edd800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8ed815f8b0 con 0x7f8ed806f2e0 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.499+0000 7f8edd800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed80d2220 con 0x7f8ed815f4d0 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed815f4d0 0x7f8ed80706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ece000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ed806f2e0 0x7f8ed8070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ece000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8ed806f2e0 0x7f8ed8070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:37724/0 (socket says 172.21.15.106:37724) 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed815f4d0 0x7f8ed80706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:34186/0 (socket says 172.21.15.106:34186) 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ece000640 1 -- 172.21.15.106:0/274795161 learned_addr learned my addr 172.21.15.106:0/274795161 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:49.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed7400640 1 --1- 172.21.15.106:0/274795161 >> v1:172.21.15.112:6789/0 conn(0x7f8ed8071170 0x7f8ed80cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:47548/0 (socket says 172.21.15.106:47548) 2024-04-26T21:16:49.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6a00640 1 -- 172.21.15.106:0/274795161 >> v2:172.21.15.112:3300/0 conn(0x7f8ed806f2e0 msgr2=0x7f8ed8070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:49.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6a00640 1 --2- 172.21.15.106:0/274795161 >> v2:172.21.15.112:3300/0 conn(0x7f8ed806f2e0 0x7f8ed8070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6000640 1 -- 172.21.15.106:0/274795161 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1527107612 0 0) 0x7f8ed80d1f40 con 0x7f8ed8071170 2024-04-26T21:16:49.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6a00640 1 -- 172.21.15.106:0/274795161 >> v1:172.21.15.112:6789/0 conn(0x7f8ed8071170 legacy=0x7f8ed80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6a00640 1 -- 172.21.15.106:0/274795161 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed80d0e80 con 0x7f8ed815f4d0 2024-04-26T21:16:49.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6a00640 1 --2- 172.21.15.106:0/274795161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed815f4d0 0x7f8ed80706f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009d90 tx=0x7f8ec801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bee1daa3402daec0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:49.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6000640 1 -- 172.21.15.106:0/274795161 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80b2070 con 0x7f8ed815f4d0 2024-04-26T21:16:49.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6000640 1 -- 172.21.15.106:0/274795161 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec80a5820 con 0x7f8ed815f4d0 2024-04-26T21:16:49.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.503+0000 7f8ed6000640 1 -- 172.21.15.106:0/274795161 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80a5bf0 con 0x7f8ed815f4d0 2024-04-26T21:16:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 -- 172.21.15.106:0/274795161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed815f4d0 msgr2=0x7f8ed80706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 --2- 172.21.15.106:0/274795161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed815f4d0 0x7f8ed80706f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009d90 tx=0x7f8ec801c850 comp rx=0 tx=0).stop 2024-04-26T21:16:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 -- 172.21.15.106:0/274795161 shutdown_connections 2024-04-26T21:16:49.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 --2- 172.21.15.106:0/274795161 >> v2:172.21.15.112:3300/0 conn(0x7f8ed806f2e0 0x7f8ed8070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 --2- 172.21.15.106:0/274795161 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed815f4d0 0x7f8ed80706f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 -- 172.21.15.106:0/274795161 >> 172.21.15.106:0/274795161 conn(0x7f8ed80d2d60 msgr2=0x7f8ed80d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 -- 172.21.15.106:0/274795161 shutdown_connections 2024-04-26T21:16:49.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 -- 172.21.15.106:0/274795161 wait complete. 2024-04-26T21:16:49.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 Processor -- start 2024-04-26T21:16:49.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 -- start start 2024-04-26T21:16:49.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ed806f2e0 0x7f8ed814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815f4d0 0x7f8ed80b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80c94b0 0x7f8ed80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed816c330 con 0x7f8ed806f2e0 2024-04-26T21:16:49.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed816c1b0 con 0x7f8ed815f4d0 2024-04-26T21:16:49.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8edd800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed816c4b0 con 0x7f8ed80c94b0 2024-04-26T21:16:49.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8ed6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ed806f2e0 0x7f8ed814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8ed6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ed806f2e0 0x7f8ed814e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40900/0 (socket says 172.21.15.106:40900) 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8ed6a00640 1 -- 172.21.15.106:0/2930441434 learned_addr learned my addr 172.21.15.106:0/2930441434 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8ece000640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815f4d0 0x7f8ed80b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.507+0000 7f8ed7400640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80c94b0 0x7f8ed80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ed6a00640 1 -- 172.21.15.106:0/2930441434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80c94b0 msgr2=0x7f8ed80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ed6a00640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80c94b0 0x7f8ed80ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ed6a00640 1 -- 172.21.15.106:0/2930441434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815f4d0 msgr2=0x7f8ed80b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ed6a00640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815f4d0 0x7f8ed80b7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ed6a00640 1 -- 172.21.15.106:0/2930441434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed80b5980 con 0x7f8ed806f2e0 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ed6a00640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ed806f2e0 0x7f8ed814e880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ec801a480 tx=0x7f8ec80195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ecf400640 1 -- 172.21.15.106:0/2930441434 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80b2050 con 0x7f8ed806f2e0 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ecf400640 1 -- 172.21.15.106:0/2930441434 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec80be070 con 0x7f8ed806f2e0 2024-04-26T21:16:49.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ecf400640 1 -- 172.21.15.106:0/2930441434 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8009450 con 0x7f8ed806f2e0 2024-04-26T21:16:49.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed80b53c0 con 0x7f8ed806f2e0 2024-04-26T21:16:49.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed80c8cb0 con 0x7f8ed806f2e0 2024-04-26T21:16:49.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed8069400 con 0x7f8ed806f2e0 2024-04-26T21:16:49.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ecf400640 1 -- 172.21.15.106:0/2930441434 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ec80adcc0 con 0x7f8ed806f2e0 2024-04-26T21:16:49.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ecf400640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8eb4068380 0x7f8eb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:49.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ecf400640 1 -- 172.21.15.106:0/2930441434 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8ec8121d40 con 0x7f8ed806f2e0 2024-04-26T21:16:49.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.511+0000 7f8ece000640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8eb4068380 0x7f8eb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:49.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.515+0000 7f8ece000640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8eb4068380 0x7f8eb406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80cd0f0 tx=0x7f8ec0009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:49.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.515+0000 7f8ecf400640 1 -- 172.21.15.106:0/2930441434 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8ec8016560 con 0x7f8ed806f2e0 2024-04-26T21:16:49.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.707+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ed80d2ad0 con 0x7f8ed806f2e0 2024-04-26T21:16:49.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.707+0000 7f8ecf400640 1 -- 172.21.15.106:0/2930441434 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f8ec80f1960 con 0x7f8ed806f2e0 2024-04-26T21:16:49.712 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:16:49.712 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:37.854892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:16:49.712 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 9 2024-04-26T21:16:49.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8eb4068380 msgr2=0x7f8eb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8eb4068380 0x7f8eb406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80cd0f0 tx=0x7f8ec0009240 comp rx=0 tx=0).stop 2024-04-26T21:16:49.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ed806f2e0 msgr2=0x7f8ed814e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ed806f2e0 0x7f8ed814e880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ec801a480 tx=0x7f8ec80195f0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 shutdown_connections 2024-04-26T21:16:49.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ed815f4d0 0x7f8ed80b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8eb4068380 0x7f8eb406a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8ed80c94b0 0x7f8ed80ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 --2- 172.21.15.106:0/2930441434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ed806f2e0 0x7f8ed814e880 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 >> 172.21.15.106:0/2930441434 conn(0x7f8ed80d2d60 msgr2=0x7f8ed8158800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:49.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 shutdown_connections 2024-04-26T21:16:49.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:49.711+0000 7f8edd800640 1 -- 172.21.15.106:0/2930441434 wait complete. 2024-04-26T21:16:50.135 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:16:19.820202+0000', 'modified': '2024-04-26T21:16:37.854892+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6835/3320582993', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6833', 'nonce': 3320582993}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 3320582993}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-04-26T21:16:50.135 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T21:16:50.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-26T21:16:50.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9903e00640 1 Processor -- start 2024-04-26T21:16:50.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9903e00640 1 -- start start 2024-04-26T21:16:50.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9903e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f99040d0c20 0x7f9904161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9903e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99040d1000 0x7f990415d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9903e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99041618a0 con 0x7f990415d950 2024-04-26T21:16:50.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9903e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f99040cf920 con 0x7f99040d0c20 2024-04-26T21:16:50.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9903e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f99040cfc00 con 0x7f99040d1000 2024-04-26T21:16:50.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9902a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f99040d0c20 0x7f9904161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9903400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f990415d950 0x7f99040cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49454/0 (socket says 172.21.15.106:49454) 2024-04-26T21:16:50.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9903400640 1 -- 172.21.15.106:0/1263383959 learned_addr learned my addr 172.21.15.106:0/1263383959 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:50.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f98fbe00640 1 --2- 172.21.15.106:0/1263383959 >> v2:172.21.15.112:3300/0 conn(0x7f99040d1000 0x7f990415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9902a00640 1 -- 172.21.15.106:0/1263383959 >> v2:172.21.15.112:3300/0 conn(0x7f99040d1000 msgr2=0x7f990415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9902a00640 1 --2- 172.21.15.106:0/1263383959 >> v2:172.21.15.112:3300/0 conn(0x7f99040d1000 0x7f990415d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9902a00640 1 -- 172.21.15.106:0/1263383959 >> v1:172.21.15.106:6789/0 conn(0x7f990415d950 legacy=0x7f99040cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9902a00640 1 -- 172.21.15.106:0/1263383959 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99040cfee0 con 0x7f99040d0c20 2024-04-26T21:16:50.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.271+0000 7f9902000640 1 -- 172.21.15.106:0/1263383959 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188631166 0 0) 0x7f99041618a0 con 0x7f990415d950 2024-04-26T21:16:50.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9902a00640 1 --2- 172.21.15.106:0/1263383959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 0x7f9904161360 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f990415b040 tx=0x7f98f401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238f2524876311d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9902000640 1 -- 172.21.15.106:0/1263383959 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40b0070 con 0x7f99040d0c20 2024-04-26T21:16:50.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9902000640 1 -- 172.21.15.106:0/1263383959 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f40ab600 con 0x7f99040d0c20 2024-04-26T21:16:50.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9902000640 1 -- 172.21.15.106:0/1263383959 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40ab9d0 con 0x7f99040d0c20 2024-04-26T21:16:50.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 -- 172.21.15.106:0/1263383959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 msgr2=0x7f9904161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 --2- 172.21.15.106:0/1263383959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 0x7f9904161360 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f990415b040 tx=0x7f98f401c3f0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 -- 172.21.15.106:0/1263383959 shutdown_connections 2024-04-26T21:16:50.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 --2- 172.21.15.106:0/1263383959 >> v2:172.21.15.112:3300/0 conn(0x7f99040d1000 0x7f990415d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 --2- 172.21.15.106:0/1263383959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 0x7f9904161360 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 -- 172.21.15.106:0/1263383959 >> 172.21.15.106:0/1263383959 conn(0x7f99040b46f0 msgr2=0x7f99040b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 -- 172.21.15.106:0/1263383959 shutdown_connections 2024-04-26T21:16:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 -- 172.21.15.106:0/1263383959 wait complete. 2024-04-26T21:16:50.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 Processor -- start 2024-04-26T21:16:50.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.279+0000 7f9903e00640 1 -- start start 2024-04-26T21:16:50.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9903e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 0x7f9904156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9903e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99040d1000 0x7f99041fc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9903e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990415d950 0x7f9904167fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9903e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f99040d1970 con 0x7f99040d0c20 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9903e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f990415e1b0 con 0x7f990415d950 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9903e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f99040d1400 con 0x7f99040d1000 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9902a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 0x7f9904156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9902a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 0x7f9904156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40910/0 (socket says 172.21.15.106:40910) 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9902a00640 1 -- 172.21.15.106:0/1852418786 learned_addr learned my addr 172.21.15.106:0/1852418786 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9903400640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990415d950 0x7f9904167fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f98fbe00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99040d1000 0x7f99041fc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9902a00640 1 -- 172.21.15.106:0/1852418786 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99040d1000 msgr2=0x7f99041fc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9902a00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99040d1000 0x7f99041fc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9902a00640 1 -- 172.21.15.106:0/1852418786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990415d950 msgr2=0x7f9904167fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9902a00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990415d950 0x7f9904167fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9902a00640 1 -- 172.21.15.106:0/1852418786 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99040b2ce0 con 0x7f99040d0c20 2024-04-26T21:16:50.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9902a00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 0x7f9904156c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f98f40ae040 tx=0x7f98f401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f98faa00640 1 -- 172.21.15.106:0/1852418786 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40b0050 con 0x7f99040d0c20 2024-04-26T21:16:50.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f98faa00640 1 -- 172.21.15.106:0/1852418786 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f40bc070 con 0x7f99040d0c20 2024-04-26T21:16:50.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f98faa00640 1 -- 172.21.15.106:0/1852418786 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4006e20 con 0x7f99040d0c20 2024-04-26T21:16:50.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9903e00640 1 -- 172.21.15.106:0/1852418786 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9904168510 con 0x7f99040d0c20 2024-04-26T21:16:50.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.283+0000 7f9903e00640 1 -- 172.21.15.106:0/1852418786 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99040b6c60 con 0x7f99040d0c20 2024-04-26T21:16:50.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.287+0000 7f98faa00640 1 -- 172.21.15.106:0/1852418786 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f99040ce940 con 0x7f99040d0c20 2024-04-26T21:16:50.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.287+0000 7f98faa00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98e0068380 0x7f98e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.287+0000 7f98faa00640 1 -- 172.21.15.106:0/1852418786 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f98f4121080 con 0x7f99040d0c20 2024-04-26T21:16:50.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.287+0000 7f990ccbc000 1 Processor -- start 2024-04-26T21:16:50.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.287+0000 7f98fbe00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98e0068380 0x7f98e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.287+0000 7f990ccbc000 1 -- start start 2024-04-26T21:16:50.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.287+0000 7f98fbe00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98e0068380 0x7f98e006a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9904168cd0 tx=0x7f98ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.287+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 0x562950637ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.287+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562950638020 0x5629505ee200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 0x5629505eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5629504a6140 con 0x562950638020 2024-04-26T21:16:50.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56295043be00 con 0x5629505ee740 2024-04-26T21:16:50.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5629503f4a00 con 0x562950637700 2024-04-26T21:16:50.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98fbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562950638020 0x5629505ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f9902a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 0x562950637ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98fbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562950638020 0x5629505ee200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40920/0 (socket says 172.21.15.106:40920) 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98fbe00640 1 -- 172.21.15.106:0/2051386456 learned_addr learned my addr 172.21.15.106:0/2051386456 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f9903400640 1 --2- 172.21.15.106:0/2051386456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 0x5629505eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98fbe00640 1 -- 172.21.15.106:0/2051386456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 msgr2=0x562950637ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98fbe00640 1 --2- 172.21.15.106:0/2051386456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 0x562950637ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98fbe00640 1 -- 172.21.15.106:0/2051386456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 msgr2=0x5629505eeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98fbe00640 1 --2- 172.21.15.106:0/2051386456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 0x5629505eeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98fbe00640 1 -- 172.21.15.106:0/2051386456 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629503f90e0 con 0x562950638020 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98fbe00640 1 --2- 172.21.15.106:0/2051386456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562950638020 0x5629505ee200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98ec011c80 tx=0x7f98ec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793532d94267c3f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98f3400640 1 -- 172.21.15.106:0/2051386456 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ec026070 con 0x562950638020 2024-04-26T21:16:50.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98f3400640 1 -- 172.21.15.106:0/2051386456 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ec01a030 con 0x562950638020 2024-04-26T21:16:50.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f98f3400640 1 -- 172.21.15.106:0/2051386456 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ec004030 con 0x562950638020 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 -- 172.21.15.106:0/2051386456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562950638020 msgr2=0x5629505ee200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 --2- 172.21.15.106:0/2051386456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562950638020 0x5629505ee200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98ec011c80 tx=0x7f98ec014000 comp rx=0 tx=0).stop 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 -- 172.21.15.106:0/2051386456 shutdown_connections 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 --2- 172.21.15.106:0/2051386456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 0x5629505eeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 --2- 172.21.15.106:0/2051386456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562950638020 0x5629505ee200 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 --2- 172.21.15.106:0/2051386456 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 0x562950637ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 -- 172.21.15.106:0/2051386456 >> 172.21.15.106:0/2051386456 conn(0x5629505ea6f0 msgr2=0x5629505ecae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 -- 172.21.15.106:0/2051386456 shutdown_connections 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 -- 172.21.15.106:0/2051386456 wait complete. 2024-04-26T21:16:50.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 -- start start 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.291+0000 7f990ccbc000 1 Processor -- start 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ee740 0x5629505f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 0x5629505f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562950638020 0x5629505f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x562950449200 con 0x5629505ee740 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629503dfe80 con 0x562950638020 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x562950436ae0 con 0x562950637700 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 10 client.0 _ll_register_callbacks cb 0x562950448da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9902a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ee740 0x5629505f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98fbe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 0x5629505f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9902a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ee740 0x5629505f90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40926/0 (socket says 172.21.15.106:40926) 2024-04-26T21:16:50.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9902a00640 1 -- 172.21.15.106:0/431220130 learned_addr learned my addr 172.21.15.106:0/431220130 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9903400640 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562950638020 0x5629505f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9902a00640 1 -- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 msgr2=0x5629505f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9902a00640 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 0x5629505f95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9902a00640 1 -- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562950638020 msgr2=0x5629505f9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9902a00640 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562950638020 0x5629505f9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9902a00640 1 -- 172.21.15.106:0/431220130 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629503db4e0 con 0x5629505ee740 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f9902a00640 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ee740 0x5629505f90a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98f40f0cb0 tx=0x7f98f4019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c32969c89b40a80 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98e7e00640 1 -- 172.21.15.106:0/431220130 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f411d060 con 0x5629505ee740 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98e7e00640 1 -- 172.21.15.106:0/431220130 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f98f4118bd0 con 0x5629505ee740 2024-04-26T21:16:50.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 -- 172.21.15.106:0/431220130 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98ec01a030 con 0x5629505ee740 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98e7e00640 1 -- 172.21.15.106:0/431220130 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f98f40fe050 con 0x5629505ee740 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 10 client.4800 fetch_fsmap learned FSMap version 9 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 -- 172.21.15.106:0/431220130 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5629503c1e80 con 0x5629505ee740 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98e7e00640 1 -- 172.21.15.106:0/431220130 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ec01a030 con 0x5629505ee740 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98e7e00640 1 -- 172.21.15.106:0/431220130 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f98f4101020 con 0x5629505ee740 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 10 client.4800 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 10 client.4800 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 20 client.4800 populate_metadata read hostname 'smithi106' 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x5629505fa530 0x5629506497b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 4 client.4800 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 -- 172.21.15.106:0/431220130 --> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629503d4bc0 con 0x5629505fa530 2024-04-26T21:16:50.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98fbe00640 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x5629505fa530 0x5629506497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98fbe00640 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x5629505fa530 0x5629506497b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daa6d311123e26af server_cookie=c4c877cdf74465e3 in_seq=0 out_seq=0 2024-04-26T21:16:50.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98e7e00640 10 client.4800 ms_handle_connect on v2:172.21.15.112:6833/3320582993 2024-04-26T21:16:50.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98e7e00640 1 -- 172.21.15.106:0/431220130 <== mds.0 v2:172.21.15.112:6833/3320582993 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5629503d4bc0 con 0x5629505fa530 2024-04-26T21:16:50.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f98e7e00640 10 client.4800 handle_command_reply: tid=0 2024-04-26T21:16:50.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.295+0000 7f990ccbc000 1 client.4800 shutdown 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 -- 172.21.15.106:0/431220130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ee740 msgr2=0x5629505f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ee740 0x5629505f90a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98f40f0cb0 tx=0x7f98f4019190 comp rx=0 tx=0).stop 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 -- 172.21.15.106:0/431220130 shutdown_connections 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x5629505fa530 0x5629506497b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562950638020 0x5629505f9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x562950637700 0x5629505f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 --2- 172.21.15.106:0/431220130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ee740 0x5629505f90a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 -- 172.21.15.106:0/431220130 >> 172.21.15.106:0/431220130 conn(0x5629505ea6f0 msgr2=0x5629505ed370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f98e7e00640 0 client.4800 ms_handle_reset on v2:172.21.15.112:6833/3320582993 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 -- 172.21.15.106:0/431220130 shutdown_connections 2024-04-26T21:16:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 1 -- 172.21.15.106:0/431220130 wait complete. 2024-04-26T21:16:50.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.299+0000 7f990ccbc000 20 client.4800 trim_cache size 0 max 16384 2024-04-26T21:16:50.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f990ccbc000 1 Processor -- start 2024-04-26T21:16:50.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f990ccbc000 1 -- start start 2024-04-26T21:16:50.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505f3de0 0x5629505edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ea6f0 0x5629505ee030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505ee740 0x5629506497b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f990ccbc000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9904204b40 con 0x5629505f3de0 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f990ccbc000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f99040b81e0 con 0x5629505ea6f0 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f990ccbc000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9904166b80 con 0x5629505ee740 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f9902a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505f3de0 0x5629505edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f9902a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505f3de0 0x5629505edaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40940/0 (socket says 172.21.15.106:40940) 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.315+0000 7f9902a00640 1 -- 172.21.15.106:0/2252590313 learned_addr learned my addr 172.21.15.106:0/2252590313 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f98fbe00640 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ea6f0 0x5629505ee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f9903400640 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505ee740 0x5629506497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f9902a00640 1 -- 172.21.15.106:0/2252590313 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505ee740 msgr2=0x5629506497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f9902a00640 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505ee740 0x5629506497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f9902a00640 1 -- 172.21.15.106:0/2252590313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ea6f0 msgr2=0x5629505ee030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f9902a00640 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ea6f0 0x5629505ee030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f9902a00640 1 -- 172.21.15.106:0/2252590313 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629505f2390 con 0x5629505f3de0 2024-04-26T21:16:50.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f98fbe00640 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ea6f0 0x5629505ee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:50.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f9902a00640 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505f3de0 0x5629505edaf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f98f40abe60 tx=0x7f98f40f3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bd5b480e748f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f98f2a00640 1 -- 172.21.15.106:0/2252590313 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40f9900 con 0x5629505f3de0 2024-04-26T21:16:50.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f98f2a00640 1 -- 172.21.15.106:0/2252590313 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f40b1040 con 0x5629505f3de0 2024-04-26T21:16:50.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f98f2a00640 1 -- 172.21.15.106:0/2252590313 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4118e10 con 0x5629505f3de0 2024-04-26T21:16:50.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 -- 172.21.15.106:0/2252590313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505f3de0 msgr2=0x5629505edaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505f3de0 0x5629505edaf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f98f40abe60 tx=0x7f98f40f3000 comp rx=0 tx=0).stop 2024-04-26T21:16:50.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 -- 172.21.15.106:0/2252590313 shutdown_connections 2024-04-26T21:16:50.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ea6f0 0x5629505ee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505ee740 0x5629506497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 --2- 172.21.15.106:0/2252590313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505f3de0 0x5629505edaf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 -- 172.21.15.106:0/2252590313 >> 172.21.15.106:0/2252590313 conn(0x562950636a80 msgr2=0x562950644460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 -- 172.21.15.106:0/2252590313 shutdown_connections 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 -- 172.21.15.106:0/2252590313 wait complete. 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 -- start start 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 Processor -- start 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ea6f0 0x56295064c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 0x562950663340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505f3de0 0x562950663880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56295043b110 con 0x5629505ea6f0 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5629503d17b0 con 0x5629505ee740 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x562950440430 con 0x5629505f3de0 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f990ccbc000 10 client.0 _ll_register_callbacks cb 0x7f98f40abf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.319+0000 7f9902a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ea6f0 0x56295064c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9902a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ea6f0 0x56295064c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40954/0 (socket says 172.21.15.106:40954) 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9902a00640 1 -- 172.21.15.106:0/1612225932 learned_addr learned my addr 172.21.15.106:0/1612225932 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9903400640 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505f3de0 0x562950663880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9902a00640 1 -- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505f3de0 msgr2=0x562950663880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9902a00640 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505f3de0 0x562950663880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98fbe00640 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 0x562950663340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9902a00640 1 -- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 msgr2=0x562950663340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9902a00640 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 0x562950663340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9902a00640 1 -- 172.21.15.106:0/1612225932 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629503f4c50 con 0x5629505ea6f0 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98fbe00640 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 0x562950663340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9902a00640 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ea6f0 0x56295064c830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f98f40f0cb0 tx=0x7f98f411f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebb3368ed6d6197 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-26T21:16:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 1 -- 172.21.15.106:0/1612225932 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40f9900 con 0x5629505ea6f0 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 1 -- 172.21.15.106:0/1612225932 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f98f4103de0 con 0x5629505ea6f0 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 -- 172.21.15.106:0/1612225932 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f40b1040 con 0x5629505ea6f0 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 1 -- 172.21.15.106:0/1612225932 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f98f4109040 con 0x5629505ea6f0 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 10 client.4806 fetch_fsmap learned FSMap version 9 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 -- 172.21.15.106:0/1612225932 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5629504be160 con 0x5629505ea6f0 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 1 -- 172.21.15.106:0/1612225932 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f40b1040 con 0x5629505ea6f0 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 1 -- 172.21.15.106:0/1612225932 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f98f4101070 con 0x5629505ea6f0 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 10 client.4806 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 10 client.4806 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 20 client.4806 populate_metadata read hostname 'smithi106' 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x562950637700 0x5629506a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 4 client.4806 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T21:16:50.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 -- 172.21.15.106:0/1612225932 --> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] -- command(tid 0: {"prefix": "status"}) -- 0x562950636e60 con 0x562950637700 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98fbe00640 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x562950637700 0x5629506a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98fbe00640 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x562950637700 0x5629506a6b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=772c95b8c382b4f7 server_cookie=9af5100bb20f31f6 in_seq=0 out_seq=0 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 10 client.4806 ms_handle_connect on v2:172.21.15.112:6833/3320582993 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 1 -- 172.21.15.106:0/1612225932 <== mds.0 v2:172.21.15.112:6833/3320582993 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x562950636e60 con 0x562950637700 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 10 client.4806 handle_command_reply: tid=0 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 client.4806 shutdown 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 -- 172.21.15.106:0/1612225932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ea6f0 msgr2=0x56295064c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ea6f0 0x56295064c830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f98f40f0cb0 tx=0x7f98f411f140 comp rx=0 tx=0).stop 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 -- 172.21.15.106:0/1612225932 shutdown_connections 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:6833/3320582993,v1:172.21.15.112:6835/3320582993] conn(0x562950637700 0x5629506a6b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5629505ee740 0x562950663340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5629505f3de0 0x562950663880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 --2- 172.21.15.106:0/1612225932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5629505ea6f0 0x56295064c830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 -- 172.21.15.106:0/1612225932 >> 172.21.15.106:0/1612225932 conn(0x562950636a80 msgr2=0x562950644cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:50.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f98e7e00640 0 client.4806 ms_handle_reset on v2:172.21.15.112:6833/3320582993 2024-04-26T21:16:50.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 -- 172.21.15.106:0/1612225932 shutdown_connections 2024-04-26T21:16:50.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 1 -- 172.21.15.106:0/1612225932 wait complete. 2024-04-26T21:16:50.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f990ccbc000 20 client.4806 trim_cache size 0 max 16384 2024-04-26T21:16:50.333 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:16:50.333 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "f2bfe958-5421-4d89-8d8f-237a3ca1f771", 2024-04-26T21:16:50.333 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4281, 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 29.932472039, 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 9, 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 27, 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 27, 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 36.686138628999998 2024-04-26T21:16:50.334 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:16:50.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9903e00640 1 -- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98e0068380 msgr2=0x7f98e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9903e00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98e0068380 0x7f98e006a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9904168cd0 tx=0x7f98ec008040 comp rx=0 tx=0).stop 2024-04-26T21:16:50.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9903e00640 1 -- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 msgr2=0x7f9904156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.323+0000 7f9903e00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 0x7f9904156c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f98f40ae040 tx=0x7f98f401ac30 comp rx=0 tx=0).stop 2024-04-26T21:16:50.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.327+0000 7f9903e00640 1 -- 172.21.15.106:0/1852418786 shutdown_connections 2024-04-26T21:16:50.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.327+0000 7f9903e00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990415d950 0x7f9904167fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.327+0000 7f9903e00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98e0068380 0x7f98e006a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.327+0000 7f9903e00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99040d1000 0x7f99041fc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.327+0000 7f9903e00640 1 --2- 172.21.15.106:0/1852418786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99040d0c20 0x7f9904156c20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.327+0000 7f9903e00640 1 -- 172.21.15.106:0/1852418786 >> 172.21.15.106:0/1852418786 conn(0x7f99040b46f0 msgr2=0x7f99040b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:50.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.327+0000 7f9903e00640 1 -- 172.21.15.106:0/1852418786 shutdown_connections 2024-04-26T21:16:50.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.327+0000 7f9903e00640 1 -- 172.21.15.106:0/1852418786 wait complete. 2024-04-26T21:16:50.386 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T21:16:50.402 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T21:16:50.402 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T21:16:50.402 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T21:16:50.403 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T21:16:50.416 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T21:16:50.416 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-26T21:16:50.416 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T21:16:50.416 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:16:50.416 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:16:50.416 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-26T21:16:50.416 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:16:50.417 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T21:16:50.417 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-26T21:16:50.417 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:16:50.417 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T21:16:50.417 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-26T21:16:50.417 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:16:50.417 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T21:16:50.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:50.417 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-04-26T21:16:50.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:50.428 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-04-26T21:16:50.494 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-04-26T21:16:50.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:16:50.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:50.497 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-26T21:16:50.506 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-26T21:16:50.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:50.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T21:16:50.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:50.570 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-04-26T21:16:50.751 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T21:16:50.751 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:16:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.883+0000 7f2555c00640 1 Processor -- start 2024-04-26T21:16:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.883+0000 7f2555c00640 1 -- start start 2024-04-26T21:16:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.883+0000 7f2555c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f255006eb70 0x7f255015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.883+0000 7f2555c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25500b3d10 con 0x7f255013ed60 2024-04-26T21:16:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.883+0000 7f2555c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25500b3ff0 con 0x7f255013f140 2024-04-26T21:16:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.883+0000 7f2555c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f25500b3ac0 con 0x7f255006eb70 2024-04-26T21:16:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.883+0000 7f254ea00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f255013ed60 0x7f25500b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49456/0 (socket says 172.21.15.106:49456) 2024-04-26T21:16:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.883+0000 7f254ea00640 1 -- 172.21.15.106:0/2466324550 learned_addr learned my addr 172.21.15.106:0/2466324550 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.883+0000 7f254f400640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f255006eb70 0x7f255015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491660129 0 0) 0x7f25500b3d10 con 0x7f255013ed60 2024-04-26T21:16:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2534005740 con 0x7f255013ed60 2024-04-26T21:16:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2915105477 0 0) 0x7f25500b3ff0 con 0x7f255013f140 2024-04-26T21:16:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25500b3d10 con 0x7f255013f140 2024-04-26T21:16:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1692237679 0 0) 0x7f2534005740 con 0x7f255013ed60 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f255006eb70 msgr2=0x7f255015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f255006eb70 0x7f255015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 >> v1:172.21.15.112:6789/0 conn(0x7f255013f140 legacy=0x7f25500d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25500b42d0 con 0x7f255013ed60 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f2540001680 con 0x7f255013ed60 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 >> v1:172.21.15.106:6789/0 conn(0x7f255013ed60 legacy=0x7f25500b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534005d90 0x7f2534006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2534006a20 0x7f2534006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2534007430 0x7f253400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f25500b3ac0 con 0x7f2534005d90 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f253400e1a0 con 0x7f2534006a20 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f253400e3a0 con 0x7f2534007430 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254ea00640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534005d90 0x7f2534006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254e000640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2534006a20 0x7f2534006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254f400640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2534007430 0x7f253400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254e000640 1 -- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2534007430 msgr2=0x7f253400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254e000640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2534007430 0x7f253400dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254e000640 1 -- 172.21.15.106:0/2466324550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534005d90 msgr2=0x7f2534006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254e000640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534005d90 0x7f2534006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254e000640 1 -- 172.21.15.106:0/2466324550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2534005740 con 0x7f2534006a20 2024-04-26T21:16:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.887+0000 7f254ea00640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534005d90 0x7f2534006190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:16:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f254e000640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2534006a20 0x7f2534006ea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f253c0018d0 tx=0x7f253c01c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c45aaa52a760cd3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c001520 con 0x7f2534006a20 2024-04-26T21:16:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c0052f0 con 0x7f2534006a20 2024-04-26T21:16:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f254d600640 1 -- 172.21.15.106:0/2466324550 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c003840 con 0x7f2534006a20 2024-04-26T21:16:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f2555c00640 1 -- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2534006a20 msgr2=0x7f2534006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f2555c00640 1 --2- 172.21.15.106:0/2466324550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2534006a20 0x7f2534006ea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f253c0018d0 tx=0x7f253c01c4c0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f254f400640 1 -- 172.21.15.106:0/2466324550 reap_dead start 2024-04-26T21:16:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f2555c00640 1 -- 172.21.15.106:0/2466324550 shutdown_connections 2024-04-26T21:16:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f2555c00640 1 -- 172.21.15.106:0/2466324550 >> 172.21.15.106:0/2466324550 conn(0x7f2550068340 msgr2=0x7f2550068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f2555c00640 1 -- 172.21.15.106:0/2466324550 shutdown_connections 2024-04-26T21:16:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f2555c00640 1 -- 172.21.15.106:0/2466324550 wait complete. 2024-04-26T21:16:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f2555c00640 1 Processor -- start 2024-04-26T21:16:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.891+0000 7f2555c00640 1 -- start start 2024-04-26T21:16:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2555c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2534006a20 0x7f25500b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2555c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2550158fa0 0x7f2550158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2555c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f255013d290 0x7f255013d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2555c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2550160580 con 0x7f2550158fa0 2024-04-26T21:16:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2555c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2550160400 con 0x7f255013d290 2024-04-26T21:16:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2555c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2550160700 con 0x7f2534006a20 2024-04-26T21:16:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2550158fa0 0x7f2550158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2550158fa0 0x7f2550158920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40974/0 (socket says 172.21.15.106:40974) 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254e000640 1 -- 172.21.15.106:0/4141662300 learned_addr learned my addr 172.21.15.106:0/4141662300 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254ea00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2534006a20 0x7f25500b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254f400640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f255013d290 0x7f255013d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254e000640 1 -- 172.21.15.106:0/4141662300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2534006a20 msgr2=0x7f25500b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254e000640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2534006a20 0x7f25500b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254e000640 1 -- 172.21.15.106:0/4141662300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f255013d290 msgr2=0x7f255013d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254e000640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f255013d290 0x7f255013d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254e000640 1 -- 172.21.15.106:0/4141662300 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25500b11c0 con 0x7f2550158fa0 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254f400640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f255013d290 0x7f255013d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f254e000640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2550158fa0 0x7f2550158920 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f253c01c2f0 tx=0x7f2534007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2546a00640 1 -- 172.21.15.106:0/4141662300 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c0bf070 con 0x7f2550158fa0 2024-04-26T21:16:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2546a00640 1 -- 172.21.15.106:0/4141662300 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c0054a0 con 0x7f2550158fa0 2024-04-26T21:16:50.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25500b14a0 con 0x7f2550158fa0 2024-04-26T21:16:50.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2546a00640 1 -- 172.21.15.106:0/4141662300 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c001500 con 0x7f2550158fa0 2024-04-26T21:16:50.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25500b1a60 con 0x7f2550158fa0 2024-04-26T21:16:50.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2550069400 con 0x7f2550158fa0 2024-04-26T21:16:50.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.895+0000 7f2546a00640 1 -- 172.21.15.106:0/4141662300 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f253c0c2070 con 0x7f2550158fa0 2024-04-26T21:16:50.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.899+0000 7f2546a00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2530068380 0x7f253006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:50.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.899+0000 7f2546a00640 1 -- 172.21.15.106:0/4141662300 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f253c120220 con 0x7f2550158fa0 2024-04-26T21:16:50.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.899+0000 7f254ea00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2530068380 0x7f253006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:50.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.899+0000 7f254ea00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2530068380 0x7f253006a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2540007fd0 tx=0x7f2540001e30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:50.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:50.903+0000 7f2546a00640 1 -- 172.21.15.106:0/4141662300 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f253c0161d0 con 0x7f2550158fa0 2024-04-26T21:16:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.095+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f255015f6c0 con 0x7f2550158fa0 2024-04-26T21:16:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.095+0000 7f2546a00640 1 -- 172.21.15.106:0/4141662300 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f253c0efdb0 con 0x7f2550158fa0 2024-04-26T21:16:51.099 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T21:16:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2530068380 msgr2=0x7f253006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2530068380 0x7f253006a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2540007fd0 tx=0x7f2540001e30 comp rx=0 tx=0).stop 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2550158fa0 msgr2=0x7f2550158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2550158fa0 0x7f2550158920 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f253c01c2f0 tx=0x7f2534007a50 comp rx=0 tx=0).stop 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 shutdown_connections 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f255013d290 0x7f255013d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2530068380 0x7f253006a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2550158fa0 0x7f2550158920 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 --2- 172.21.15.106:0/4141662300 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2534006a20 0x7f25500b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 >> 172.21.15.106:0/4141662300 conn(0x7f2550068340 msgr2=0x7f25500d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 shutdown_connections 2024-04-26T21:16:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51.099+0000 7f2555c00640 1 -- 172.21.15.106:0/4141662300 wait complete. 2024-04-26T21:16:51.120 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:16:51.120 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:16:51.120 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-04-26T21:16:51.120 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T21:16:51.120 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:16:51.120 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:16:51.121 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:16:51.121 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:16:51.121 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:16:51.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:51.121 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-04-26T21:16:51.130 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:16:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:16:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:16:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-26T21:16:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:51.130 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42405sec preferred_lft 42405sec 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T21:16:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 02:42:e8:de:01:3d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T21:16:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:51.132 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:16:51.133 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:51.133 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:51.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:16:51.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2024-04-26T21:16:51.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2024-04-26T21:16:51.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:16:51.133 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:51.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:51.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:51.287 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:16:51.305 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-04-26T21:16:51.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:51.308 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-04-26T21:16:51.359 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:16:51.361 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:51.361 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:51.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:16:51.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:16:51.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:16:51.361 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:51.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:51.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:51.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:51.498 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-26T21:16:51.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:51.549 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-04-26T21:16:51.601 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:51.601 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:51.601 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:51.601 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T21:16:51.601 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:51.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:51.725 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T21:16:51.726 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:51.726 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:51.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T21:16:51.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:16:51.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T21:16:51.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T21:16:51.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T21:16:51.726 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:51.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:51.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:51.905 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:51.906 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:51.906 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2024-04-26T21:16:51.906 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:16:51.906 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:51.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:51.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:51.990 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T21:16:51.990 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:51.990 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T21:16:52.040 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:16:52.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:52.041 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:16:52.096 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-26T21:16:52.160 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:52.209 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/run/lock 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-26T21:16:52.210 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/fs/nfsd 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/run/rpc_pipefs 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:16:52.211 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:16:52.212 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:16:52.212 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:16:52.212 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-26T21:16:52.212 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:52.212 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:52.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:52.213 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-26T21:16:52.268 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T21:16:52.268 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T21:16:52.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-26T21:16:52.331 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:52.386 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/run/lock 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-26T21:16:52.387 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/fs/nfsd 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/run/rpc_pipefs 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-26T21:16:52.388 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:16:52.389 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:16:52.389 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:16:52.389 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:16:52.389 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-26T21:16:52.389 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:52.389 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:52.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:52.390 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-26T21:16:52.406 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:2024-04-26T21:16:52.403+0000 7fa9a0e5e580 -1 init, newargv = 0x562521af4ad0 newargc=15 2024-04-26T21:16:52.406 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:ceph-fuse[35370]: starting ceph client 2024-04-26T21:16:52.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:ceph-fuse[35370]: starting fuse 2024-04-26T21:16:52.415 INFO:teuthology.orchestra.run.smithi106.stdout:44 2024-04-26T21:16:52.415 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> import glob 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> import re 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> import os 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> import subprocess 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> def _find_admin_socket(client_name): 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> files = glob.glob(asok_path) 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> # Given a non-glob path, it better be there 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> if "*" not in asok_path: 2024-04-26T21:16:52.416 DEBUG:teuthology.orchestra.run.smithi106:> assert(len(files) == 1) 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> return files[0] 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> for f in files: 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> contents = proc_f.read() 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> if mountpoint in contents: 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> return f 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> print(_find_admin_socket("client.0")) 2024-04-26T21:16:52.417 DEBUG:teuthology.orchestra.run.smithi106:> ' 2024-04-26T21:16:52.540 INFO:teuthology.orchestra.run.smithi106.stdout:/var/run/ceph/ceph-client.0.35370.asok 2024-04-26T21:16:52.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:52.552 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35370.asok 2024-04-26T21:16:52.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:52.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35370.asok status 2024-04-26T21:16:52.722 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:16:52.722 INFO:teuthology.orchestra.run.smithi106.stdout: "metadata": { 2024-04-26T21:16:52.722 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:16:52.722 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T21:16:52.722 INFO:teuthology.orchestra.run.smithi106.stdout: "entity_id": "0", 2024-04-26T21:16:52.722 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": "smithi106", 2024-04-26T21:16:52.722 INFO:teuthology.orchestra.run.smithi106.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T21:16:52.722 INFO:teuthology.orchestra.run.smithi106.stdout: "pid": "35370", 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "root": "/" 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_count": 0, 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_pinned_count": 0, 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4818, 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "inst": { 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "name": { 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "client", 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4818 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:16:52.723 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3562840778 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3562840778 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: "inst_str": "client.4818 192.168.0.1:0/3562840778", 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addr_str": "192.168.0.1:0/3562840778", 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: "inode_count": 1, 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_epoch": 9, 2024-04-26T21:16:52.724 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch": 27, 2024-04-26T21:16:52.725 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:16:52.725 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklisted": false, 2024-04-26T21:16:52.725 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs" 2024-04-26T21:16:52.725 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:16:52.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:16:52.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.867+0000 7fa3eb200640 1 Processor -- start 2024-04-26T21:16:52.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.867+0000 7fa3eb200640 1 -- start start 2024-04-26T21:16:52.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3eb200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3e40724d0 0x7fa3e4070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:52.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3eb200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e4072b00 con 0x7fa3e40af640 2024-04-26T21:16:52.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3eb200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e4072de0 con 0x7fa3e4148a90 2024-04-26T21:16:52.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3eb200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e4070660 con 0x7fa3e40724d0 2024-04-26T21:16:52.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3e3400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3e40724d0 0x7fa3e4070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:52.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3e9200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa3e40af640 0x7fa3e40d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49470/0 (socket says 172.21.15.106:49470) 2024-04-26T21:16:52.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3e9200640 1 -- 172.21.15.106:0/1532820359 learned_addr learned my addr 172.21.15.106:0/1532820359 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:52.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3e3400640 1 -- 172.21.15.106:0/1532820359 >> v1:172.21.15.112:6789/0 conn(0x7fa3e4148a90 legacy=0x7fa3e40b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:52.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3e3400640 1 -- 172.21.15.106:0/1532820359 >> v1:172.21.15.106:6789/0 conn(0x7fa3e40af640 legacy=0x7fa3e40d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:52.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3e3400640 1 -- 172.21.15.106:0/1532820359 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e40aee40 con 0x7fa3e40724d0 2024-04-26T21:16:52.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.871+0000 7fa3e2a00640 1 -- 172.21.15.106:0/1532820359 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 332618612 0 0) 0x7fa3e4072b00 con 0x7fa3e40af640 2024-04-26T21:16:52.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3e3400640 1 --2- 172.21.15.106:0/1532820359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40724d0 0x7fa3e4070120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00097c0 tx=0x7fa3d001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ea2927bcc1c4ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:52.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3e2a00640 1 -- 172.21.15.106:0/1532820359 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00b0070 con 0x7fa3e40724d0 2024-04-26T21:16:52.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3e2a00640 1 -- 172.21.15.106:0/1532820359 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d00ab600 con 0x7fa3e40724d0 2024-04-26T21:16:52.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3e2a00640 1 -- 172.21.15.106:0/1532820359 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00ab9d0 con 0x7fa3e40724d0 2024-04-26T21:16:52.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 -- 172.21.15.106:0/1532820359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40724d0 msgr2=0x7fa3e4070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:52.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 --2- 172.21.15.106:0/1532820359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40724d0 0x7fa3e4070120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00097c0 tx=0x7fa3d001c410 comp rx=0 tx=0).stop 2024-04-26T21:16:52.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 -- 172.21.15.106:0/1532820359 shutdown_connections 2024-04-26T21:16:52.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 --2- 172.21.15.106:0/1532820359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40724d0 0x7fa3e4070120 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:52.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 -- 172.21.15.106:0/1532820359 >> 172.21.15.106:0/1532820359 conn(0x7fa3e406e440 msgr2=0x7fa3e406e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:52.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 -- 172.21.15.106:0/1532820359 shutdown_connections 2024-04-26T21:16:52.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 -- 172.21.15.106:0/1532820359 wait complete. 2024-04-26T21:16:52.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 Processor -- start 2024-04-26T21:16:52.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 -- start start 2024-04-26T21:16:52.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3e40724d0 0x7fa3e4147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40af640 0x7fa3e41439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3e4148a90 0x7fa3e41fb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4148e70 con 0x7fa3e40af640 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e40d1700 con 0x7fa3e4148a90 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.875+0000 7fa3eb200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e40afa70 con 0x7fa3e40724d0 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40af640 0x7fa3e41439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40af640 0x7fa3e41439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40988/0 (socket says 172.21.15.106:40988) 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3400640 1 -- 172.21.15.106:0/3545123972 learned_addr learned my addr 172.21.15.106:0/3545123972 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3e00640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3e40724d0 0x7fa3e4147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e9200640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3e4148a90 0x7fa3e41fb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3400640 1 -- 172.21.15.106:0/3545123972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3e40724d0 msgr2=0x7fa3e4147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:52.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3400640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3e40724d0 0x7fa3e4147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3400640 1 -- 172.21.15.106:0/3545123972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3e4148a90 msgr2=0x7fa3e41fb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3400640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3e4148a90 0x7fa3e41fb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3400640 1 -- 172.21.15.106:0/3545123972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e4141c80 con 0x7fa3e40af640 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e9200640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3e4148a90 0x7fa3e41fb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3e3400640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40af640 0x7fa3e41439d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0019020 tx=0x7fa3d00191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3dbe00640 1 -- 172.21.15.106:0/3545123972 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00b8020 con 0x7fa3e40af640 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3dbe00640 1 -- 172.21.15.106:0/3545123972 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d00b4630 con 0x7fa3e40af640 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3dbe00640 1 -- 172.21.15.106:0/3545123972 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00b0040 con 0x7fa3e40af640 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e4141f60 con 0x7fa3e40af640 2024-04-26T21:16:52.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e4142520 con 0x7fa3e40af640 2024-04-26T21:16:52.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e4069400 con 0x7fa3e40af640 2024-04-26T21:16:52.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3dbe00640 1 -- 172.21.15.106:0/3545123972 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa3d00bb020 con 0x7fa3e40af640 2024-04-26T21:16:52.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.879+0000 7fa3dbe00640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa3c4068380 0x7fa3c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:52.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.883+0000 7fa3dbe00640 1 -- 172.21.15.106:0/3545123972 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa3d0120a00 con 0x7fa3e40af640 2024-04-26T21:16:52.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.883+0000 7fa3e3e00640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa3c4068380 0x7fa3c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:52.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.883+0000 7fa3e3e00640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa3c4068380 0x7fa3c406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4007fd0 tx=0x7fa3d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:52.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:52.883+0000 7fa3dbe00640 1 -- 172.21.15.106:0/3545123972 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa3d00c2030 con 0x7fa3e40af640 2024-04-26T21:16:53.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.079+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa3e4070aa0 con 0x7fa3e40af640 2024-04-26T21:16:53.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3dbe00640 1 -- 172.21.15.106:0/3545123972 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fa3d0016090 con 0x7fa3e40af640 2024-04-26T21:16:53.085 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T21:16:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa3c4068380 msgr2=0x7fa3c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa3c4068380 0x7fa3c406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4007fd0 tx=0x7fa3d4009040 comp rx=0 tx=0).stop 2024-04-26T21:16:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40af640 msgr2=0x7fa3e41439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40af640 0x7fa3e41439d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0019020 tx=0x7fa3d00191b0 comp rx=0 tx=0).stop 2024-04-26T21:16:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 shutdown_connections 2024-04-26T21:16:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3e4148a90 0x7fa3e41fb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa3c4068380 0x7fa3c406a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e40af640 0x7fa3e41439d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 --2- 172.21.15.106:0/3545123972 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3e40724d0 0x7fa3e4147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:53.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 >> 172.21.15.106:0/3545123972 conn(0x7fa3e406e440 msgr2=0x7fa3e40afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:53.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 shutdown_connections 2024-04-26T21:16:53.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53.083+0000 7fa3eb200640 1 -- 172.21.15.106:0/3545123972 wait complete. 2024-04-26T21:16:53.107 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:16:53.107 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:16:53.107 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-04-26T21:16:53.107 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-26T21:16:53.107 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T21:16:53.107 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:16:53.107 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:16:53.107 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:16:53.107 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-26T21:16:53.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:53.108 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-04-26T21:16:53.116 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:16:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:16:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:16:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-26T21:16:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42403sec preferred_lft 42403sec 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-04-26T21:16:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 02:42:e8:de:01:3d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-26T21:16:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:53.120 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:16:53.177 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-04-26T21:16:53.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:53.179 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:53.231 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:16:53.232 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:53.232 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:53.232 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:16:53.232 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:16:53.232 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:16:53.232 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:53.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:53.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:53.370 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-26T21:16:53.420 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T21:16:53.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:53.421 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-04-26T21:16:53.472 INFO:teuthology.orchestra.run.smithi106.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-26T21:16:53.472 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:53.472 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:53.472 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:16:53.472 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-26T21:16:53.472 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:53.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:53.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:53.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:53.594 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T21:16:53.659 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 86:72:04:83:ab:0e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::8472:4ff:fe83:ab0e/64 scope link 2024-04-26T21:16:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:53.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T21:16:53.727 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 86:72:04:83:ab:0e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::8472:4ff:fe83:ab0e/64 scope link 2024-04-26T21:16:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:53.730 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-26T21:16:53.730 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:53.730 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:53.730 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-26T21:16:53.730 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T21:16:53.730 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-26T21:16:53.730 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-26T21:16:53.730 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-26T21:16:53.730 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:53.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:53.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:53.908 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:53.908 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:16:53.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.1 up 2024-04-26T21:16:53.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T21:16:53.908 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:16:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:54.033 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-26T21:16:54.033 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:54.034 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-26T21:16:54.042 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-26T21:16:54.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:54.042 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-26T21:16:54.091 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-26T21:16:54.156 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:54.209 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-26T21:16:54.209 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-26T21:16:54.209 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-26T21:16:54.209 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-26T21:16:54.209 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/run/lock 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-26T21:16:54.210 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/fs/nfsd 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/run/rpc_pipefs 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:16:54.211 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-26T21:16:54.212 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:54.212 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:54.212 INFO:teuthology.orchestra.run.smithi106.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T21:16:54.212 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:16:54.212 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:16:54.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:54.213 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-26T21:16:54.268 INFO:teuthology.orchestra.run.smithi106.stdout:44 2024-04-26T21:16:54.268 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-04-26T21:16:54.268 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-26T21:16:54.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-26T21:16:54.331 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/run/lock 2024-04-26T21:16:54.386 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/fs/nfsd 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/run/rpc_pipefs 2024-04-26T21:16:54.387 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:16:54.388 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:16:54.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:54.389 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-26T21:16:54.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi106.stderr:2024-04-26T21:16:54.403+0000 7faa41416580 -1 init, newargv = 0x562ab0bdb0b0 newargc=15 2024-04-26T21:16:54.406 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi106.stderr:ceph-fuse[35509]: starting ceph client 2024-04-26T21:16:54.413 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi106.stderr:ceph-fuse[35509]: starting fuse 2024-04-26T21:16:54.414 INFO:teuthology.orchestra.run.smithi106.stdout:44 2024-04-26T21:16:54.414 INFO:teuthology.orchestra.run.smithi106.stdout:45 2024-04-26T21:16:54.414 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-04-26T21:16:54.414 DEBUG:teuthology.orchestra.run.smithi106:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:16:54.414 DEBUG:teuthology.orchestra.run.smithi106:> import glob 2024-04-26T21:16:54.414 DEBUG:teuthology.orchestra.run.smithi106:> import re 2024-04-26T21:16:54.414 DEBUG:teuthology.orchestra.run.smithi106:> import os 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> import subprocess 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> def _find_admin_socket(client_name): 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> files = glob.glob(asok_path) 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> # Given a non-glob path, it better be there 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> if "*" not in asok_path: 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> assert(len(files) == 1) 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> return files[0] 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> for f in files: 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:16:54.415 DEBUG:teuthology.orchestra.run.smithi106:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:16:54.416 DEBUG:teuthology.orchestra.run.smithi106:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:16:54.416 DEBUG:teuthology.orchestra.run.smithi106:> contents = proc_f.read() 2024-04-26T21:16:54.416 DEBUG:teuthology.orchestra.run.smithi106:> if mountpoint in contents: 2024-04-26T21:16:54.416 DEBUG:teuthology.orchestra.run.smithi106:> return f 2024-04-26T21:16:54.416 DEBUG:teuthology.orchestra.run.smithi106:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:16:54.416 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:16:54.416 DEBUG:teuthology.orchestra.run.smithi106:> print(_find_admin_socket("client.2")) 2024-04-26T21:16:54.416 DEBUG:teuthology.orchestra.run.smithi106:> ' 2024-04-26T21:16:54.535 INFO:teuthology.orchestra.run.smithi106.stdout:/var/run/ceph/ceph-client.2.35509.asok 2024-04-26T21:16:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:54.546 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35509.asok 2024-04-26T21:16:54.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:54.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.35509.asok status 2024-04-26T21:16:54.715 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "metadata": { 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "entity_id": "2", 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": "smithi106", 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "pid": "35509", 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "root": "/" 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_count": 0, 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_pinned_count": 0, 2024-04-26T21:16:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4843, 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "inst": { 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "name": { 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "client", 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4843 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:0", 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 439934189 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:0", 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 439934189 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "inst_str": "client.4843 172.21.15.106:0/439934189", 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "addr_str": "172.21.15.106:0/439934189", 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "inode_count": 1, 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_epoch": 9, 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch": 27, 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklisted": false, 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs" 2024-04-26T21:16:54.718 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:16:54.730 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:16:54.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7db5200640 1 Processor -- start 2024-04-26T21:16:54.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7db5200640 1 -- start start 2024-04-26T21:16:54.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7db5200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0146710 0x7f7db006c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7db5200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db0161810 con 0x7f7db01611f0 2024-04-26T21:16:54.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7db5200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db00b0a30 con 0x7f7db00b1510 2024-04-26T21:16:54.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7db5200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7db00b0d10 con 0x7f7db0146710 2024-04-26T21:16:54.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dae800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7db01611f0 0x7f7db006f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49476/0 (socket says 172.21.15.106:49476) 2024-04-26T21:16:54.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dae800640 1 -- 172.21.15.106:0/2602834054 learned_addr learned my addr 172.21.15.106:0/2602834054 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:16:54.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210152832 0 0) 0x7f7db0161810 con 0x7f7db01611f0 2024-04-26T21:16:54.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d94003530 con 0x7f7db01611f0 2024-04-26T21:16:54.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dade00640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0146710 0x7f7db006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2043356399 0 0) 0x7f7d94003530 con 0x7f7db01611f0 2024-04-26T21:16:54.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0146710 msgr2=0x7f7db006c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0146710 0x7f7db006c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 >> v1:172.21.15.112:6789/0 conn(0x7f7db00b1510 legacy=0x7f7db0160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db00b0ff0 con 0x7f7db01611f0 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f7da8001a00 con 0x7f7db01611f0 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 >> v1:172.21.15.106:6789/0 conn(0x7f7db01611f0 legacy=0x7f7db006f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0146710 0x7f7d940039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d94003f70 0x7f7d94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d94004d50 0x7f7d940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7db00b0d10 con 0x7f7d94004d50 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9400bb60 con 0x7f7d94003f70 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9400bd60 con 0x7f7db0146710 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dae800640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d94004d50 0x7f7d940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7dade00640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0146710 0x7f7d940039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.863+0000 7f7da5400640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d94003f70 0x7f7d94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dae800640 1 -- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0146710 msgr2=0x7f7d940039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dae800640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0146710 0x7f7d940039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dae800640 1 -- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d94003f70 msgr2=0x7f7d94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dae800640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d94003f70 0x7f7d94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dae800640 1 -- 172.21.15.106:0/2602834054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d94003530 con 0x7f7d94004d50 2024-04-26T21:16:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dae800640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d94004d50 0x7f7d940051d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7da800a840 tx=0x7f7da801fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9c5686f978cb22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da800a460 con 0x7f7d94004d50 2024-04-26T21:16:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da80aa710 con 0x7f7d94004d50 2024-04-26T21:16:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dad400640 1 -- 172.21.15.106:0/2602834054 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da80aab00 con 0x7f7d94004d50 2024-04-26T21:16:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7db5200640 1 -- 172.21.15.106:0/2602834054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d94004d50 msgr2=0x7f7d940051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7db5200640 1 --2- 172.21.15.106:0/2602834054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d94004d50 0x7f7d940051d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7da800a840 tx=0x7f7da801fac0 comp rx=0 tx=0).stop 2024-04-26T21:16:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7dae800640 1 -- 172.21.15.106:0/2602834054 reap_dead start 2024-04-26T21:16:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7db5200640 1 -- 172.21.15.106:0/2602834054 shutdown_connections 2024-04-26T21:16:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7db5200640 1 -- 172.21.15.106:0/2602834054 >> 172.21.15.106:0/2602834054 conn(0x7f7db0068140 msgr2=0x7f7db0068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.867+0000 7f7db5200640 1 -- 172.21.15.106:0/2602834054 shutdown_connections 2024-04-26T21:16:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7db5200640 1 -- 172.21.15.106:0/2602834054 wait complete. 2024-04-26T21:16:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7db5200640 1 Processor -- start 2024-04-26T21:16:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7db5200640 1 -- start start 2024-04-26T21:16:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7db5200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d94004d50 0x7f7db015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7db5200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0137b30 0x7f7db009e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7db5200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db009e680 0x7f7db00b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7db5200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0146c70 con 0x7f7db009e680 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7db5200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0146af0 con 0x7f7d94004d50 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7db5200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7db006f810 con 0x7f7db0137b30 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dae800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db009e680 0x7f7db00b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dae800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db009e680 0x7f7db00b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41004/0 (socket says 172.21.15.106:41004) 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dae800640 1 -- 172.21.15.106:0/560123720 learned_addr learned my addr 172.21.15.106:0/560123720 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7da5400640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0137b30 0x7f7db009e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dade00640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d94004d50 0x7f7db015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dae800640 1 -- 172.21.15.106:0/560123720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0137b30 msgr2=0x7f7db009e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dae800640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0137b30 0x7f7db009e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dae800640 1 -- 172.21.15.106:0/560123720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d94004d50 msgr2=0x7f7db015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dae800640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d94004d50 0x7f7db015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dae800640 1 -- 172.21.15.106:0/560123720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db01367f0 con 0x7f7db009e680 2024-04-26T21:16:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7dae800640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db009e680 0x7f7db00b19a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7da80aad80 tx=0x7f7d94005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7da6a00640 1 -- 172.21.15.106:0/560123720 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da80b7070 con 0x7f7db009e680 2024-04-26T21:16:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7da6a00640 1 -- 172.21.15.106:0/560123720 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8001800 con 0x7f7db009e680 2024-04-26T21:16:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.871+0000 7f7da6a00640 1 -- 172.21.15.106:0/560123720 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da800a460 con 0x7f7db009e680 2024-04-26T21:16:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.875+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db0136ad0 con 0x7f7db009e680 2024-04-26T21:16:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.875+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db0137090 con 0x7f7db009e680 2024-04-26T21:16:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.875+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db0069400 con 0x7f7db009e680 2024-04-26T21:16:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.875+0000 7f7da6a00640 1 -- 172.21.15.106:0/560123720 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7da80bb400 con 0x7f7db009e680 2024-04-26T21:16:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.875+0000 7f7da6a00640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7d8c0683b0 0x7f7d8c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.875+0000 7f7da6a00640 1 -- 172.21.15.106:0/560123720 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7da8123e80 con 0x7f7db009e680 2024-04-26T21:16:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.875+0000 7f7dade00640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7d8c0683b0 0x7f7d8c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.875+0000 7f7dade00640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7d8c0683b0 0x7f7d8c06a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009be0 tx=0x7f7da0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:54.879+0000 7f7da6a00640 1 -- 172.21.15.106:0/560123720 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7da80c2030 con 0x7f7db009e680 2024-04-26T21:16:55.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.071+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7db0073620 con 0x7f7db009e680 2024-04-26T21:16:55.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.071+0000 7f7da6a00640 1 -- 172.21.15.106:0/560123720 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f7da80ae030 con 0x7f7db009e680 2024-04-26T21:16:55.076 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7d8c0683b0 msgr2=0x7f7d8c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7d8c0683b0 0x7f7d8c06a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009be0 tx=0x7f7da0009190 comp rx=0 tx=0).stop 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db009e680 msgr2=0x7f7db00b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db009e680 0x7f7db00b19a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7da80aad80 tx=0x7f7d94005840 comp rx=0 tx=0).stop 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 shutdown_connections 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7d8c0683b0 0x7f7d8c06a870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7db009e680 0x7f7db00b19a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0137b30 0x7f7db009e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 --2- 172.21.15.106:0/560123720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d94004d50 0x7f7db015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:55.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 >> 172.21.15.106:0/560123720 conn(0x7f7db0068140 msgr2=0x7f7db006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:55.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 shutdown_connections 2024-04-26T21:16:55.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:55.075+0000 7f7db5200640 1 -- 172.21.15.106:0/560123720 wait complete. 2024-04-26T21:16:55.096 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:16:55.096 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:16:55.096 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-04-26T21:16:55.096 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T21:16:55.096 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T21:16:55.096 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:16:55.097 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:16:55.097 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:16:55.097 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T21:16:55.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:55.097 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:55.107 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42396sec preferred_lft 42396sec 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:af:9c:95:ea brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T21:16:55.108 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:55.109 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:16:55.109 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:55.109 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-26T21:16:55.109 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:16:55.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2024-04-26T21:16:55.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2024-04-26T21:16:55.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:16:55.110 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-26T21:16:55.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:55.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:55.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:55.273 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:16:55.291 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-04-26T21:16:55.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:55.294 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-04-26T21:16:55.365 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:55.366 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:16:55.367 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:55.367 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-26T21:16:55.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:16:55.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:16:55.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:16:55.367 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-26T21:16:55.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:55.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:55.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:55.503 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-04-26T21:16:55.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:55.512 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-04-26T21:16:55.562 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:55.562 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-26T21:16:55.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:55.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T21:16:55.562 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-26T21:16:55.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:55.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:55.692 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T21:16:55.692 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:55.693 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-26T21:16:55.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T21:16:55.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:16:55.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T21:16:55.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T21:16:55.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T21:16:55.693 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-26T21:16:55.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:55.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:55.852 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:55.852 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-26T21:16:55.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-04-26T21:16:55.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:16:55.852 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-26T21:16:55.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:55.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:55.936 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T21:16:55.937 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:55.937 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T21:16:55.945 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T21:16:55.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:55.945 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T21:16:55.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-04-26T21:16:56.062 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-04-26T21:16:56.115 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:56.116 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-04-26T21:16:56.117 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-04-26T21:16:56.117 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-04-26T21:16:56.117 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T21:16:56.117 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T21:16:56.117 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T21:16:56.117 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T21:16:56.117 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-04-26T21:16:56.117 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:56.117 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:56.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:56.118 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-04-26T21:16:56.169 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T21:16:56.169 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T21:16:56.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-04-26T21:16:56.232 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-04-26T21:16:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-04-26T21:16:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-04-26T21:16:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-04-26T21:16:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-04-26T21:16:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-04-26T21:16:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-04-26T21:16:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-04-26T21:16:56.287 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-04-26T21:16:56.288 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-04-26T21:16:56.289 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-04-26T21:16:56.289 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T21:16:56.289 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T21:16:56.289 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T21:16:56.289 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T21:16:56.289 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-04-26T21:16:56.289 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:56.289 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:56.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:56.290 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-04-26T21:16:56.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi112.stderr:2024-04-26T21:16:56.306+0000 7fe1f7e94580 -1 init, newargv = 0x56452d4019e0 newargc=15 2024-04-26T21:16:56.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi112.stderr:ceph-fuse[33373]: starting ceph client 2024-04-26T21:16:56.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi112.stderr:ceph-fuse[33373]: starting fuse 2024-04-26T21:16:57.416 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-04-26T21:16:57.440 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:57.496 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-04-26T21:16:57.496 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-04-26T21:16:57.496 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-04-26T21:16:57.496 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-04-26T21:16:57.496 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-04-26T21:16:57.496 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:57.497 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:57.498 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T21:16:57.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:57.499 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-04-26T21:16:57.550 INFO:teuthology.orchestra.run.smithi112.stdout:44 2024-04-26T21:16:57.550 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-04-26T21:16:57.551 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.1")) 2024-04-26T21:16:57.552 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-04-26T21:16:57.681 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.1.33373.asok 2024-04-26T21:16:57.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:57.694 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33373.asok 2024-04-26T21:16:57.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:57.694 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33373.asok status 2024-04-26T21:16:57.866 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T21:16:57.866 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "1", 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "33373", 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4855, 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-04-26T21:16:57.867 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 4855 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 4066061280 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 4066061280 2024-04-26T21:16:57.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T21:16:57.869 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.4855 192.168.0.1:0/4066061280", 2024-04-26T21:16:57.869 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/4066061280", 2024-04-26T21:16:57.869 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-04-26T21:16:57.869 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 9, 2024-04-26T21:16:57.869 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 27, 2024-04-26T21:16:57.869 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:16:57.869 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-04-26T21:16:57.869 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-04-26T21:16:57.869 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T21:16:57.881 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:16:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff664c00640 1 Processor -- start 2024-04-26T21:16:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff664c00640 1 -- start start 2024-04-26T21:16:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff664c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff66015f3d0 0x7ff6600cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff664c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff6600d37f0 0x7ff6600cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff664c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6600cff60 0x7ff66006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff664c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff6600d1d70 con 0x7ff66015f3d0 2024-04-26T21:16:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff664c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff6600d2050 con 0x7ff6600d37f0 2024-04-26T21:16:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff664c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff6600cd450 con 0x7ff6600cff60 2024-04-26T21:16:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff65de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff66015f3d0 0x7ff6600cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff65de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff66015f3d0 0x7ff6600cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58870/0 (socket says 172.21.15.106:58870) 2024-04-26T21:16:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff65de00640 1 -- 172.21.15.106:0/1176184182 learned_addr learned my addr 172.21.15.106:0/1176184182 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff65de00640 1 -- 172.21.15.106:0/1176184182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6600cff60 msgr2=0x7ff66006d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff65de00640 1 --2- 172.21.15.106:0/1176184182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6600cff60 0x7ff66006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff65de00640 1 -- 172.21.15.106:0/1176184182 >> v2:172.21.15.112:3300/0 conn(0x7ff6600d37f0 msgr2=0x7ff6600cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:16:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff65de00640 1 --2- 172.21.15.106:0/1176184182 >> v2:172.21.15.112:3300/0 conn(0x7ff6600d37f0 0x7ff6600cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.023+0000 7ff65de00640 1 -- 172.21.15.106:0/1176184182 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6600cd730 con 0x7ff66015f3d0 2024-04-26T21:16:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff65de00640 1 --2- 172.21.15.106:0/1176184182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff66015f3d0 0x7ff6600cf4e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff660162d10 tx=0x7ff65001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb2bc2b3ff82d6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff65d400640 1 -- 172.21.15.106:0/1176184182 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6500b0070 con 0x7ff66015f3d0 2024-04-26T21:16:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff65d400640 1 -- 172.21.15.106:0/1176184182 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6500ab600 con 0x7ff66015f3d0 2024-04-26T21:16:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff65d400640 1 -- 172.21.15.106:0/1176184182 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6500ab9d0 con 0x7ff66015f3d0 2024-04-26T21:16:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff664c00640 1 -- 172.21.15.106:0/1176184182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff66015f3d0 msgr2=0x7ff6600cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff664c00640 1 --2- 172.21.15.106:0/1176184182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff66015f3d0 0x7ff6600cf4e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff660162d10 tx=0x7ff65001c260 comp rx=0 tx=0).stop 2024-04-26T21:16:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff664c00640 1 -- 172.21.15.106:0/1176184182 shutdown_connections 2024-04-26T21:16:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff664c00640 1 --2- 172.21.15.106:0/1176184182 >> v2:172.21.15.112:3300/0 conn(0x7ff6600d37f0 0x7ff6600cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff664c00640 1 --2- 172.21.15.106:0/1176184182 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6600cff60 0x7ff66006d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff664c00640 1 --2- 172.21.15.106:0/1176184182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff66015f3d0 0x7ff6600cf4e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff664c00640 1 -- 172.21.15.106:0/1176184182 >> 172.21.15.106:0/1176184182 conn(0x7ff6600d2c60 msgr2=0x7ff6600d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff664c00640 1 -- 172.21.15.106:0/1176184182 shutdown_connections 2024-04-26T21:16:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.027+0000 7ff664c00640 1 -- 172.21.15.106:0/1176184182 wait complete. 2024-04-26T21:16:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 Processor -- start 2024-04-26T21:16:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 -- start start 2024-04-26T21:16:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6600cff60 0x7ff6600b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6600d37f0 0x7ff6600ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff66015f3d0 0x7ff660157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600ce830 con 0x7ff6600cff60 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff6600ce6b0 con 0x7ff6600d37f0 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff6600ce9b0 con 0x7ff66015f3d0 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6600cff60 0x7ff6600b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6600cff60 0x7ff6600b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58876/0 (socket says 172.21.15.106:58876) 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65de00640 1 -- 172.21.15.106:0/525614618 learned_addr learned my addr 172.21.15.106:0/525614618 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff655400640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6600d37f0 0x7ff6600ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65e800640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff66015f3d0 0x7ff660157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65de00640 1 -- 172.21.15.106:0/525614618 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff66015f3d0 msgr2=0x7ff660157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65de00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff66015f3d0 0x7ff660157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65de00640 1 -- 172.21.15.106:0/525614618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6600d37f0 msgr2=0x7ff6600ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65de00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6600d37f0 0x7ff6600ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65de00640 1 -- 172.21.15.106:0/525614618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6600caca0 con 0x7ff6600cff60 2024-04-26T21:16:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff65de00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6600cff60 0x7ff6600b4fd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff65001a910 tx=0x7ff65001aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff656a00640 1 -- 172.21.15.106:0/525614618 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6500b0040 con 0x7ff6600cff60 2024-04-26T21:16:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff656a00640 1 -- 172.21.15.106:0/525614618 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6500bc070 con 0x7ff6600cff60 2024-04-26T21:16:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6600b5660 con 0x7ff6600cff60 2024-04-26T21:16:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff656a00640 1 -- 172.21.15.106:0/525614618 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6500aac30 con 0x7ff6600cff60 2024-04-26T21:16:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6600b5c20 con 0x7ff6600cff60 2024-04-26T21:16:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.031+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff660069400 con 0x7ff6600cff60 2024-04-26T21:16:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.035+0000 7ff656a00640 1 -- 172.21.15.106:0/525614618 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff6500c1460 con 0x7ff6600cff60 2024-04-26T21:16:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.035+0000 7ff656a00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff63c068380 0x7ff63c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.035+0000 7ff656a00640 1 -- 172.21.15.106:0/525614618 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff650121160 con 0x7ff6600cff60 2024-04-26T21:16:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.035+0000 7ff655400640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff63c068380 0x7ff63c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.035+0000 7ff655400640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff63c068380 0x7ff63c06a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff66015e540 tx=0x7ff64800d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.039+0000 7ff656a00640 1 -- 172.21.15.106:0/525614618 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff650016110 con 0x7ff6600cff60 2024-04-26T21:16:58.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.231+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff6600d28c0 con 0x7ff6600cff60 2024-04-26T21:16:58.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.231+0000 7ff656a00640 1 -- 172.21.15.106:0/525614618 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7ff6500f0e10 con 0x7ff6600cff60 2024-04-26T21:16:58.236 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T21:16:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff63c068380 msgr2=0x7ff63c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff63c068380 0x7ff63c06a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff66015e540 tx=0x7ff64800d040 comp rx=0 tx=0).stop 2024-04-26T21:16:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6600cff60 msgr2=0x7ff6600b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6600cff60 0x7ff6600b4fd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff65001a910 tx=0x7ff65001aaa0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 shutdown_connections 2024-04-26T21:16:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6600d37f0 0x7ff6600ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff63c068380 0x7ff63c06a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff66015f3d0 0x7ff660157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 --2- 172.21.15.106:0/525614618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6600cff60 0x7ff6600b4fd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:58.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 >> 172.21.15.106:0/525614618 conn(0x7ff6600d2c60 msgr2=0x7ff6600c7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:58.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 shutdown_connections 2024-04-26T21:16:58.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:16:58.235+0000 7ff664c00640 1 -- 172.21.15.106:0/525614618 wait complete. 2024-04-26T21:16:58.257 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:16:58.257 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:16:58.257 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-04-26T21:16:58.257 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-26T21:16:58.257 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T21:16:58.257 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:16:58.257 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:16:58.257 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:16:58.257 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-26T21:16:58.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:58.258 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-04-26T21:16:58.266 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:16:58.267 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42393sec preferred_lft 42393sec 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:af:9c:95:ea brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:16:58.268 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T21:16:58.269 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T21:16:58.269 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.269 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T21:16:58.269 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.269 INFO:teuthology.orchestra.run.smithi112.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T21:16:58.269 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:58.269 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T21:16:58.269 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:58.270 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:16:58.336 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-04-26T21:16:58.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:58.338 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-04-26T21:16:58.393 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-04-26T21:16:58.393 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:16:58.393 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T21:16:58.393 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:16:58.393 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T21:16:58.393 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T21:16:58.393 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:16:58.393 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:58.393 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:58.394 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:16:58.394 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:16:58.394 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:58.394 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-26T21:16:58.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:16:58.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:16:58.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:16:58.394 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-26T21:16:58.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:58.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:58.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:58.531 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-04-26T21:16:58.540 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T21:16:58.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:58.540 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-04-26T21:16:58.594 INFO:teuthology.orchestra.run.smithi112.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-26T21:16:58.595 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:58.595 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-26T21:16:58.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T21:16:58.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-26T21:16:58.595 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-26T21:16:58.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:58.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:58.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:58.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T21:16:58.744 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:16:58.744 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:16:58.744 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:16:58.744 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.744 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-04-26T21:16:58.744 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.744 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:16:58.744 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether e2:08:1b:01:35:31 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T21:16:58.745 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T21:16:58.745 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.745 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::e008:1bff:fe01:3531/64 scope link 2024-04-26T21:16:58.745 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:58.746 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T21:16:58.813 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:16:58.813 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:16:58.813 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:16:58.813 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.814 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-04-26T21:16:58.814 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.814 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:16:58.814 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether e2:08:1b:01:35:31 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T21:16:58.814 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T21:16:58.814 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.814 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::e008:1bff:fe01:3531/64 scope link 2024-04-26T21:16:58.814 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:16:58.815 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-26T21:16:58.815 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:58.816 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-26T21:16:58.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-26T21:16:58.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T21:16:58.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-26T21:16:58.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-26T21:16:58.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-26T21:16:58.816 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-26T21:16:58.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:58.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:58.993 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:16:58.993 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-26T21:16:58.993 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.1 up 2024-04-26T21:16:58.993 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T21:16:58.993 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-26T21:16:59.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:16:59.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:59.120 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-26T21:16:59.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:59.120 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-26T21:16:59.129 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-26T21:16:59.129 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:16:59.129 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-26T21:16:59.181 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-04-26T21:16:59.246 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-04-26T21:16:59.299 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-04-26T21:16:59.300 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T21:16:59.301 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T21:16:59.301 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T21:16:59.301 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T21:16:59.301 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-04-26T21:16:59.301 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:59.301 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:59.301 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T21:16:59.301 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T21:16:59.301 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T21:16:59.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:59.302 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-04-26T21:16:59.357 INFO:teuthology.orchestra.run.smithi112.stdout:44 2024-04-26T21:16:59.358 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-04-26T21:16:59.358 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-26T21:16:59.404 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-04-26T21:16:59.426 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-04-26T21:16:59.479 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T21:16:59.480 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T21:16:59.481 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T21:16:59.481 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-04-26T21:16:59.481 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:59.481 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:16:59.481 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T21:16:59.481 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T21:16:59.481 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T21:16:59.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:59.482 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-04-26T21:16:59.499 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi112.stderr:2024-04-26T21:16:59.498+0000 7f3403a9b580 -1 init, newargv = 0x557665a73990 newargc=15 2024-04-26T21:16:59.499 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi112.stderr:ceph-fuse[33492]: starting ceph client 2024-04-26T21:16:59.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi112.stderr:ceph-fuse[33492]: starting fuse 2024-04-26T21:16:59.508 INFO:teuthology.orchestra.run.smithi112.stdout:44 2024-04-26T21:16:59.508 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-04-26T21:16:59.508 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-04-26T21:16:59.508 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:16:59.508 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-04-26T21:16:59.508 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-04-26T21:16:59.508 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-04-26T21:16:59.508 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:16:59.509 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:16:59.510 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-04-26T21:16:59.510 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-04-26T21:16:59.510 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-04-26T21:16:59.510 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:16:59.510 DEBUG:teuthology.orchestra.run.smithi112:> 2024-04-26T21:16:59.510 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.3")) 2024-04-26T21:16:59.510 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-04-26T21:16:59.630 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.3.33492.asok 2024-04-26T21:16:59.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T21:16:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:16:59.641 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33492.asok 2024-04-26T21:16:59.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:59.641 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33492.asok status 2024-04-26T21:16:59.808 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T21:16:59.808 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-04-26T21:16:59.808 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:16:59.808 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "3", 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "33492", 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4655, 2024-04-26T21:16:59.809 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 4655 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.2:0", 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 682425725 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T21:16:59.810 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.2:0", 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 682425725 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.4655 192.168.0.2:0/682425725", 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.2:0/682425725", 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 9, 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 27, 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:16:59.811 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-04-26T21:16:59.812 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-04-26T21:16:59.812 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T21:16:59.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:59.823 DEBUG:teuthology.orchestra.run.smithi106:> stat --file-system '--printf=%T 2024-04-26T21:16:59.823 DEBUG:teuthology.orchestra.run.smithi106:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T21:16:59.835 INFO:teuthology.orchestra.run.smithi106.stdout:fuseblk 2024-04-26T21:16:59.835 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T21:16:59.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:59.835 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:16:59.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:59.899 DEBUG:teuthology.orchestra.run.smithi106:> stat --file-system '--printf=%T 2024-04-26T21:16:59.899 DEBUG:teuthology.orchestra.run.smithi106:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-26T21:16:59.950 INFO:teuthology.orchestra.run.smithi106.stdout:fuseblk 2024-04-26T21:16:59.950 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-26T21:16:59.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:16:59.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-26T21:17:00.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:00.013 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-04-26T21:17:00.013 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T21:17:00.023 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-04-26T21:17:00.023 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T21:17:00.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:00.023 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T21:17:00.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:00.085 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-04-26T21:17:00.085 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-26T21:17:00.134 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-04-26T21:17:00.134 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-26T21:17:00.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:00.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-26T21:17:00.197 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-26T21:17:00.213 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff445c00640 1 Processor -- start 2024-04-26T21:17:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff445c00640 1 -- start start 2024-04-26T21:17:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff445c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff44013f140 0x7ff44015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff445c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff44006eb70 0x7ff4400d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff445c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4400b3d10 con 0x7ff44013ed60 2024-04-26T21:17:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff445c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff4400b3ac0 con 0x7ff44006eb70 2024-04-26T21:17:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff445c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4400b4920 con 0x7ff44013f140 2024-04-26T21:17:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff43f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff44006eb70 0x7ff4400d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff43f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff44006eb70 0x7ff4400d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58892/0 (socket says 172.21.15.106:58892) 2024-04-26T21:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff43f400640 1 -- 172.21.15.106:0/1406604594 learned_addr learned my addr 172.21.15.106:0/1406604594 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.355+0000 7ff436000640 1 --2- 172.21.15.106:0/1406604594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff44013f140 0x7ff44015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff43f400640 1 -- 172.21.15.106:0/1406604594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff44013f140 msgr2=0x7ff44015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff43f400640 1 --2- 172.21.15.106:0/1406604594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff44013f140 0x7ff44015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff43f400640 1 -- 172.21.15.106:0/1406604594 >> v1:172.21.15.112:6789/0 conn(0x7ff44013ed60 legacy=0x7ff4400b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff43f400640 1 -- 172.21.15.106:0/1406604594 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4400b3ff0 con 0x7ff44006eb70 2024-04-26T21:17:00.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff43e000640 1 -- 172.21.15.106:0/1406604594 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107263833 0 0) 0x7ff4400b3d10 con 0x7ff44013ed60 2024-04-26T21:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff43f400640 1 --2- 172.21.15.106:0/1406604594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff44006eb70 0x7ff4400d0df0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff438009e50 tx=0x7ff43801eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e65afd8928cf9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:00.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff43e000640 1 -- 172.21.15.106:0/1406604594 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4380a7900 con 0x7ff44006eb70 2024-04-26T21:17:00.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff43e000640 1 -- 172.21.15.106:0/1406604594 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4380a7aa0 con 0x7ff44006eb70 2024-04-26T21:17:00.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff43e000640 1 -- 172.21.15.106:0/1406604594 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4380af3f0 con 0x7ff44006eb70 2024-04-26T21:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff445c00640 1 -- 172.21.15.106:0/1406604594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff44006eb70 msgr2=0x7ff4400d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff445c00640 1 --2- 172.21.15.106:0/1406604594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff44006eb70 0x7ff4400d0df0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff438009e50 tx=0x7ff43801eb20 comp rx=0 tx=0).stop 2024-04-26T21:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff445c00640 1 -- 172.21.15.106:0/1406604594 shutdown_connections 2024-04-26T21:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff445c00640 1 --2- 172.21.15.106:0/1406604594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff44006eb70 0x7ff4400d0df0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff445c00640 1 --2- 172.21.15.106:0/1406604594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff44013f140 0x7ff44015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff445c00640 1 -- 172.21.15.106:0/1406604594 >> 172.21.15.106:0/1406604594 conn(0x7ff440068340 msgr2=0x7ff440068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.359+0000 7ff445c00640 1 -- 172.21.15.106:0/1406604594 shutdown_connections 2024-04-26T21:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 -- 172.21.15.106:0/1406604594 wait complete. 2024-04-26T21:17:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 Processor -- start 2024-04-26T21:17:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 -- start start 2024-04-26T21:17:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff44013ed60 0x7ff44013d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff440140100 0x7ff440141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440141d40 0x7ff4400b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff4401607b0 con 0x7ff440141d40 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff440160630 con 0x7ff44013ed60 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff440071f50 con 0x7ff440140100 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440141d40 0x7ff4400b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440141d40 0x7ff4400b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58900/0 (socket says 172.21.15.106:58900) 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43f400640 1 -- 172.21.15.106:0/346059794 learned_addr learned my addr 172.21.15.106:0/346059794 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff436000640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff440140100 0x7ff440141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43ea00640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff44013ed60 0x7ff44013d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43f400640 1 -- 172.21.15.106:0/346059794 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff440140100 msgr2=0x7ff440141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43f400640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff440140100 0x7ff440141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43f400640 1 -- 172.21.15.106:0/346059794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff44013ed60 msgr2=0x7ff44013d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43f400640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff44013ed60 0x7ff44013d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43f400640 1 -- 172.21.15.106:0/346059794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4400b1060 con 0x7ff440141d40 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff43f400640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440141d40 0x7ff4400b1e20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4380b1040 tx=0x7ff43801b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff437400640 1 -- 172.21.15.106:0/346059794 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4380be070 con 0x7ff440141d40 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff437400640 1 -- 172.21.15.106:0/346059794 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff438009250 con 0x7ff440141d40 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff437400640 1 -- 172.21.15.106:0/346059794 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438007840 con 0x7ff440141d40 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4400b1340 con 0x7ff440141d40 2024-04-26T21:17:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.363+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4400b1900 con 0x7ff440141d40 2024-04-26T21:17:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.367+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff440069400 con 0x7ff440141d40 2024-04-26T21:17:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.367+0000 7ff437400640 1 -- 172.21.15.106:0/346059794 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff438007aa0 con 0x7ff440141d40 2024-04-26T21:17:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.367+0000 7ff437400640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff41c068380 0x7ff41c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.367+0000 7ff437400640 1 -- 172.21.15.106:0/346059794 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff438120c00 con 0x7ff440141d40 2024-04-26T21:17:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.367+0000 7ff43ea00640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff41c068380 0x7ff41c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.367+0000 7ff43ea00640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff41c068380 0x7ff41c06a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff430000f70 tx=0x7ff430009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.371+0000 7ff437400640 1 -- 172.21.15.106:0/346059794 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff438018830 con 0x7ff440141d40 2024-04-26T21:17:00.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.531+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4400cff00 con 0x7ff440141d40 2024-04-26T21:17:00.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff437400640 1 -- 172.21.15.106:0/346059794 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18562 (secure 0 0 0) 0x7ff4380f0790 con 0x7ff440141d40 2024-04-26T21:17:00.537 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:00.537 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:16:24.824726+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff41c068380 msgr2=0x7ff41c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff41c068380 0x7ff41c06a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff430000f70 tx=0x7ff430009040 comp rx=0 tx=0).stop 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440141d40 msgr2=0x7ff4400b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440141d40 0x7ff4400b1e20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4380b1040 tx=0x7ff43801b8c0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 shutdown_connections 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff41c068380 0x7ff41c06a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440141d40 0x7ff4400b1e20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff440140100 0x7ff440141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 --2- 172.21.15.106:0/346059794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff44013ed60 0x7ff44013d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 >> 172.21.15.106:0/346059794 conn(0x7ff440068340 msgr2=0x7ff44015b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:00.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 shutdown_connections 2024-04-26T21:17:00.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.535+0000 7ff445c00640 1 -- 172.21.15.106:0/346059794 wait complete. 2024-04-26T21:17:00.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:00.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:00.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9d0a00640 1 Processor -- start 2024-04-26T21:17:00.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9d0a00640 1 -- start start 2024-04-26T21:17:00.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9d0a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff9cc0b5260 0x7ff9cc15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9d0a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff9cc15de50 0x7ff9cc166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9d0a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9cc0b44a0 con 0x7ff9cc15d530 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9d0a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff9cc0b4780 con 0x7ff9cc15de50 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9d0a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff9cc0b4a60 con 0x7ff9cc0b5260 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9c9e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff9cc15d530 0x7ff9cc0cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49224/0 (socket says 172.21.15.106:49224) 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9c9e00640 1 -- 172.21.15.106:0/2799416257 learned_addr learned my addr 172.21.15.106:0/2799416257 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9ca800640 1 --2- 172.21.15.106:0/2799416257 >> v2:172.21.15.106:3300/0 conn(0x7ff9cc15de50 0x7ff9cc166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9c3e00640 1 --2- 172.21.15.106:0/2799416257 >> v2:172.21.15.112:3300/0 conn(0x7ff9cc0b5260 0x7ff9cc15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9c9400640 1 -- 172.21.15.106:0/2799416257 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134576573 0 0) 0x7ff9cc0b44a0 con 0x7ff9cc15d530 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9c9400640 1 -- 172.21.15.106:0/2799416257 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9b0003530 con 0x7ff9cc15d530 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9ca800640 1 -- 172.21.15.106:0/2799416257 >> v2:172.21.15.112:3300/0 conn(0x7ff9cc0b5260 msgr2=0x7ff9cc15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9ca800640 1 --2- 172.21.15.106:0/2799416257 >> v2:172.21.15.112:3300/0 conn(0x7ff9cc0b5260 0x7ff9cc15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9ca800640 1 -- 172.21.15.106:0/2799416257 >> v1:172.21.15.106:6789/0 conn(0x7ff9cc15d530 legacy=0x7ff9cc0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.703+0000 7ff9ca800640 1 -- 172.21.15.106:0/2799416257 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc0b4d40 con 0x7ff9cc15de50 2024-04-26T21:17:00.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9ca800640 1 --2- 172.21.15.106:0/2799416257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc15de50 0x7ff9cc166ae0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0b0820 tx=0x7ff9c401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bde4708acae721 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:00.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9c9400640 1 -- 172.21.15.106:0/2799416257 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40b2070 con 0x7ff9cc15de50 2024-04-26T21:17:00.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9c9400640 1 -- 172.21.15.106:0/2799416257 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c40a59b0 con 0x7ff9cc15de50 2024-04-26T21:17:00.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9c9400640 1 -- 172.21.15.106:0/2799416257 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40a5d80 con 0x7ff9cc15de50 2024-04-26T21:17:00.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2799416257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc15de50 msgr2=0x7ff9cc166ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 --2- 172.21.15.106:0/2799416257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc15de50 0x7ff9cc166ae0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0b0820 tx=0x7ff9c401c930 comp rx=0 tx=0).stop 2024-04-26T21:17:00.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2799416257 shutdown_connections 2024-04-26T21:17:00.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 --2- 172.21.15.106:0/2799416257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc15de50 0x7ff9cc166ae0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 --2- 172.21.15.106:0/2799416257 >> v2:172.21.15.112:3300/0 conn(0x7ff9cc0b5260 0x7ff9cc15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2799416257 >> 172.21.15.106:0/2799416257 conn(0x7ff9cc0b2910 msgr2=0x7ff9cc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:00.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2799416257 shutdown_connections 2024-04-26T21:17:00.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2799416257 wait complete. 2024-04-26T21:17:00.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 Processor -- start 2024-04-26T21:17:00.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.707+0000 7ff9d0a00640 1 -- start start 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9d0a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc0b5260 0x7ff9cc15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9d0a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff9cc15d530 0x7ff9cc15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9d0a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9cc15de50 0x7ff9cc0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9d0a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc0d06b0 con 0x7ff9cc0b5260 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9d0a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc0d0530 con 0x7ff9cc15de50 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9d0a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff9cc169840 con 0x7ff9cc15d530 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc0b5260 0x7ff9cc15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc0b5260 0x7ff9cc15c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58910/0 (socket says 172.21.15.106:58910) 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c9e00640 1 -- 172.21.15.106:0/2750782144 learned_addr learned my addr 172.21.15.106:0/2750782144 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c3e00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff9cc15d530 0x7ff9cc15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9ca800640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9cc15de50 0x7ff9cc0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c9e00640 1 -- 172.21.15.106:0/2750782144 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff9cc15d530 msgr2=0x7ff9cc15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c9e00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff9cc15d530 0x7ff9cc15c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c9e00640 1 -- 172.21.15.106:0/2750782144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9cc15de50 msgr2=0x7ff9cc0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c9e00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9cc15de50 0x7ff9cc0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c9e00640 1 -- 172.21.15.106:0/2750782144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc133dd0 con 0x7ff9cc0b5260 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c9e00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc0b5260 0x7ff9cc15c1d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c450 tx=0x7ff9bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c2000640 1 -- 172.21.15.106:0/2750782144 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc017070 con 0x7ff9cc0b5260 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c2000640 1 -- 172.21.15.106:0/2750782144 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc005cf0 con 0x7ff9cc0b5260 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9c2000640 1 -- 172.21.15.106:0/2750782144 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc007290 con 0x7ff9cc0b5260 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9cc1340b0 con 0x7ff9cc0b5260 2024-04-26T21:17:00.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9cc134670 con 0x7ff9cc0b5260 2024-04-26T21:17:00.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.711+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9cc069400 con 0x7ff9cc0b5260 2024-04-26T21:17:00.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.715+0000 7ff9c2000640 1 -- 172.21.15.106:0/2750782144 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff9bc01a070 con 0x7ff9cc0b5260 2024-04-26T21:17:00.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.715+0000 7ff9c2000640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff9a8068380 0x7ff9a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:00.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.715+0000 7ff9c2000640 1 -- 172.21.15.106:0/2750782144 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff9bc086140 con 0x7ff9cc0b5260 2024-04-26T21:17:00.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.715+0000 7ff9c3e00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff9a8068380 0x7ff9a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:00.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.715+0000 7ff9c3e00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff9a8068380 0x7ff9a806a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc139e00 tx=0x7ff9b4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:00.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.719+0000 7ff9c2000640 1 -- 172.21.15.106:0/2750782144 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff9bc055c00 con 0x7ff9cc0b5260 2024-04-26T21:17:00.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.875+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff9cc160510 con 0x7ff9cc0b5260 2024-04-26T21:17:00.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.875+0000 7ff9c2000640 1 -- 172.21.15.106:0/2750782144 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7ff9bc059f00 con 0x7ff9cc0b5260 2024-04-26T21:17:00.879 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:00.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff9a8068380 msgr2=0x7ff9a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff9a8068380 0x7ff9a806a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc139e00 tx=0x7ff9b4009190 comp rx=0 tx=0).stop 2024-04-26T21:17:00.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc0b5260 msgr2=0x7ff9cc15c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:00.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc0b5260 0x7ff9cc15c1d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c450 tx=0x7ff9bc00c910 comp rx=0 tx=0).stop 2024-04-26T21:17:00.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 shutdown_connections 2024-04-26T21:17:00.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9cc15de50 0x7ff9cc0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff9a8068380 0x7ff9a806a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff9cc15d530 0x7ff9cc15c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 --2- 172.21.15.106:0/2750782144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9cc0b5260 0x7ff9cc15c1d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:00.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 >> 172.21.15.106:0/2750782144 conn(0x7ff9cc0b2910 msgr2=0x7ff9cc0b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:00.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 shutdown_connections 2024-04-26T21:17:00.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:00.879+0000 7ff9d0a00640 1 -- 172.21.15.106:0/2750782144 wait complete. 2024-04-26T21:17:00.900 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:01.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f9400640 1 Processor -- start 2024-04-26T21:17:01.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f9400640 1 -- start start 2024-04-26T21:17:01.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc2f406ef90 0x7fc2f415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f9400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f4159600 con 0x7fc2f4159220 2024-04-26T21:17:01.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f9400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f40b3d40 con 0x7fc2f40d0580 2024-04-26T21:17:01.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f9400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f40b4020 con 0x7fc2f406ef90 2024-04-26T21:17:01.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f1e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc2f406ef90 0x7fc2f415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f2800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc2f4159220 0x7fc2f406e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49240/0 (socket says 172.21.15.106:49240) 2024-04-26T21:17:01.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f2800640 1 -- 172.21.15.106:0/1690649521 learned_addr learned my addr 172.21.15.106:0/1690649521 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:01.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f1e00640 1 -- 172.21.15.106:0/1690649521 >> v1:172.21.15.112:6789/0 conn(0x7fc2f40d0580 legacy=0x7fc2f415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f1e00640 1 -- 172.21.15.106:0/1690649521 >> v1:172.21.15.106:6789/0 conn(0x7fc2f4159220 legacy=0x7fc2f406e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.035+0000 7fc2f1e00640 1 -- 172.21.15.106:0/1690649521 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f40b4300 con 0x7fc2f406ef90 2024-04-26T21:17:01.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f1e00640 1 --2- 172.21.15.106:0/1690649521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f406ef90 0x7fc2f415bb30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097c0 tx=0x7fc2f415dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681f6d66ae12c62d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:01.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f1400640 1 -- 172.21.15.106:0/1690649521 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40b0070 con 0x7fc2f406ef90 2024-04-26T21:17:01.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f1400640 1 -- 172.21.15.106:0/1690649521 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e40ab600 con 0x7fc2f406ef90 2024-04-26T21:17:01.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f1400640 1 -- 172.21.15.106:0/1690649521 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40ab9d0 con 0x7fc2f406ef90 2024-04-26T21:17:01.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f9400640 1 -- 172.21.15.106:0/1690649521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f406ef90 msgr2=0x7fc2f415bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f9400640 1 --2- 172.21.15.106:0/1690649521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f406ef90 0x7fc2f415bb30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097c0 tx=0x7fc2f415dc90 comp rx=0 tx=0).stop 2024-04-26T21:17:01.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f9400640 1 -- 172.21.15.106:0/1690649521 shutdown_connections 2024-04-26T21:17:01.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f9400640 1 --2- 172.21.15.106:0/1690649521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f406ef90 0x7fc2f415bb30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f9400640 1 -- 172.21.15.106:0/1690649521 >> 172.21.15.106:0/1690649521 conn(0x7fc2f40b2910 msgr2=0x7fc2f40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:01.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f9400640 1 -- 172.21.15.106:0/1690649521 shutdown_connections 2024-04-26T21:17:01.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.039+0000 7fc2f9400640 1 -- 172.21.15.106:0/1690649521 wait complete. 2024-04-26T21:17:01.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 Processor -- start 2024-04-26T21:17:01.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 -- start start 2024-04-26T21:17:01.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f406ef90 0x7fc2f413c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2f40d0580 0x7fc2f415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f4159220 0x7fc2f4150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f406e170 con 0x7fc2f4159220 2024-04-26T21:17:01.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f406dff0 con 0x7fc2f406ef90 2024-04-26T21:17:01.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f406e2f0 con 0x7fc2f40d0580 2024-04-26T21:17:01.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f3200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f4159220 0x7fc2f4150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f1e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2f40d0580 0x7fc2f415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f2800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f406ef90 0x7fc2f413c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f3200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f4159220 0x7fc2f4150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58916/0 (socket says 172.21.15.106:58916) 2024-04-26T21:17:01.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f3200640 1 -- 172.21.15.106:0/3222195412 learned_addr learned my addr 172.21.15.106:0/3222195412 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:01.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f3200640 1 -- 172.21.15.106:0/3222195412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2f40d0580 msgr2=0x7fc2f415b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f3200640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2f40d0580 0x7fc2f415b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f3200640 1 -- 172.21.15.106:0/3222195412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f406ef90 msgr2=0x7fc2f413c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f3200640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f406ef90 0x7fc2f413c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f3200640 1 -- 172.21.15.106:0/3222195412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f414aa00 con 0x7fc2f4159220 2024-04-26T21:17:01.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f3200640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f4159220 0x7fc2f4150560 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c7d0 tx=0x7fc2ec00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:01.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2eaa00640 1 -- 172.21.15.106:0/3222195412 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec003b80 con 0x7fc2f4159220 2024-04-26T21:17:01.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2eaa00640 1 -- 172.21.15.106:0/3222195412 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec003d20 con 0x7fc2f4159220 2024-04-26T21:17:01.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f414ace0 con 0x7fc2f4159220 2024-04-26T21:17:01.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2eaa00640 1 -- 172.21.15.106:0/3222195412 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00aa30 con 0x7fc2f4159220 2024-04-26T21:17:01.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.043+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f414b2a0 con 0x7fc2f4159220 2024-04-26T21:17:01.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.047+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f4069400 con 0x7fc2f4159220 2024-04-26T21:17:01.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.047+0000 7fc2eaa00640 1 -- 172.21.15.106:0/3222195412 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2ec00abd0 con 0x7fc2f4159220 2024-04-26T21:17:01.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.047+0000 7fc2eaa00640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc2d0068380 0x7fc2d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.047+0000 7fc2eaa00640 1 -- 172.21.15.106:0/3222195412 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc2ec086c60 con 0x7fc2f4159220 2024-04-26T21:17:01.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.047+0000 7fc2f2800640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc2d0068380 0x7fc2d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.047+0000 7fc2f2800640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc2d0068380 0x7fc2d006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005890 tx=0x7fc2dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:01.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.051+0000 7fc2eaa00640 1 -- 172.21.15.106:0/3222195412 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc2ec0566a0 con 0x7fc2f4159220 2024-04-26T21:17:01.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc2f40b24e0 con 0x7fc2f4159220 2024-04-26T21:17:01.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2eaa00640 1 -- 172.21.15.106:0/3222195412 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fc2ec05a9a0 con 0x7fc2f4159220 2024-04-26T21:17:01.210 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:01.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc2d0068380 msgr2=0x7fc2d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc2d0068380 0x7fc2d006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005890 tx=0x7fc2dc009040 comp rx=0 tx=0).stop 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f4159220 msgr2=0x7fc2f4150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f4159220 0x7fc2f4150560 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00c7d0 tx=0x7fc2ec00cc90 comp rx=0 tx=0).stop 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 shutdown_connections 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc2d0068380 0x7fc2d006a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f4159220 0x7fc2f4150560 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc2f40d0580 0x7fc2f415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 --2- 172.21.15.106:0/3222195412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f406ef90 0x7fc2f413c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 >> 172.21.15.106:0/3222195412 conn(0x7fc2f40b2910 msgr2=0x7fc2f40b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 shutdown_connections 2024-04-26T21:17:01.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.207+0000 7fc2f9400640 1 -- 172.21.15.106:0/3222195412 wait complete. 2024-04-26T21:17:01.232 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:01.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.367+0000 7f81b3c00640 1 Processor -- start 2024-04-26T21:17:01.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.367+0000 7f81b3c00640 1 -- start start 2024-04-26T21:17:01.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.367+0000 7f81b3c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f81ac15ea90 0x7f81ac166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.367+0000 7f81b3c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ac0b4f00 con 0x7f81ac15c4e0 2024-04-26T21:17:01.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.367+0000 7f81b3c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ac0b51e0 con 0x7f81ac15d080 2024-04-26T21:17:01.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.367+0000 7f81b3c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f81ac15d5f0 con 0x7f81ac15ea90 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81b1200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f81ac15c4e0 0x7f81ac15c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49246/0 (socket says 172.21.15.106:49246) 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81b1200640 1 -- 172.21.15.106:0/1763242761 learned_addr learned my addr 172.21.15.106:0/1763242761 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81b1c00640 1 --2- 172.21.15.106:0/1763242761 >> v2:172.21.15.112:3300/0 conn(0x7f81ac15ea90 0x7f81ac166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81abe00640 1 -- 172.21.15.106:0/1763242761 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053904344 0 0) 0x7f81ac0b4f00 con 0x7f81ac15c4e0 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81abe00640 1 -- 172.21.15.106:0/1763242761 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8190003530 con 0x7f81ac15c4e0 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81abe00640 1 -- 172.21.15.106:0/1763242761 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109520256 0 0) 0x7f81ac0b51e0 con 0x7f81ac15d080 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81abe00640 1 -- 172.21.15.106:0/1763242761 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81ac0b4f00 con 0x7f81ac15d080 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81b1c00640 1 -- 172.21.15.106:0/1763242761 >> v1:172.21.15.112:6789/0 conn(0x7f81ac15d080 legacy=0x7f81ac0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81b1c00640 1 -- 172.21.15.106:0/1763242761 >> v1:172.21.15.106:6789/0 conn(0x7f81ac15c4e0 legacy=0x7f81ac15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81abe00640 1 -- 172.21.15.106:0/1763242761 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 190001634 0 0) 0x7f8190003530 con 0x7f81ac15c4e0 2024-04-26T21:17:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81b1c00640 1 -- 172.21.15.106:0/1763242761 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac0b54c0 con 0x7f81ac15ea90 2024-04-26T21:17:01.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.371+0000 7f81b1c00640 1 --2- 172.21.15.106:0/1763242761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ac15ea90 0x7f81ac166db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009d90 tx=0x7f81a401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b10f9bc42b3b1577 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:01.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81abe00640 1 -- 172.21.15.106:0/1763242761 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c001680 con 0x7f81ac15ea90 2024-04-26T21:17:01.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81abe00640 1 -- 172.21.15.106:0/1763242761 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a40a6490 con 0x7f81ac15ea90 2024-04-26T21:17:01.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81abe00640 1 -- 172.21.15.106:0/1763242761 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40a6840 con 0x7f81ac15ea90 2024-04-26T21:17:01.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 -- 172.21.15.106:0/1763242761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ac15ea90 msgr2=0x7f81ac166db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 --2- 172.21.15.106:0/1763242761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ac15ea90 0x7f81ac166db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009d90 tx=0x7f81a401c890 comp rx=0 tx=0).stop 2024-04-26T21:17:01.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 -- 172.21.15.106:0/1763242761 shutdown_connections 2024-04-26T21:17:01.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 --2- 172.21.15.106:0/1763242761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ac15ea90 0x7f81ac166db0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 -- 172.21.15.106:0/1763242761 >> 172.21.15.106:0/1763242761 conn(0x7f81ac0b2910 msgr2=0x7f81ac0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:01.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 -- 172.21.15.106:0/1763242761 shutdown_connections 2024-04-26T21:17:01.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 -- 172.21.15.106:0/1763242761 wait complete. 2024-04-26T21:17:01.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 Processor -- start 2024-04-26T21:17:01.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 -- start start 2024-04-26T21:17:01.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81ac15c4e0 0x7f81ac15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ac15d080 0x7f81ac1f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ac15ea90 0x7f81ac1fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac06f460 con 0x7f81ac15d080 2024-04-26T21:17:01.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac06f2e0 con 0x7f81ac15ea90 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b3c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f81ac06f5e0 con 0x7f81ac15c4e0 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81a3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ac15d080 0x7f81ac1f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81a3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ac15d080 0x7f81ac1f9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58930/0 (socket says 172.21.15.106:58930) 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81a3e00640 1 -- 172.21.15.106:0/2623809318 learned_addr learned my addr 172.21.15.106:0/2623809318 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b1c00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ac15ea90 0x7f81ac1fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81b1200640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81ac15c4e0 0x7f81ac15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81a3e00640 1 -- 172.21.15.106:0/2623809318 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81ac15c4e0 msgr2=0x7f81ac15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81a3e00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81ac15c4e0 0x7f81ac15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81a3e00640 1 -- 172.21.15.106:0/2623809318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ac15ea90 msgr2=0x7f81ac1fb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81a3e00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ac15ea90 0x7f81ac1fb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.375+0000 7f81a3e00640 1 -- 172.21.15.106:0/2623809318 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac142700 con 0x7f81ac15d080 2024-04-26T21:17:01.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81a3e00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ac15d080 0x7f81ac1f9010 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f819400c500 tx=0x7f819400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:01.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81a9600640 1 -- 172.21.15.106:0/2623809318 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81940052d0 con 0x7f81ac15d080 2024-04-26T21:17:01.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81a9600640 1 -- 172.21.15.106:0/2623809318 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8194005470 con 0x7f81ac15d080 2024-04-26T21:17:01.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81a9600640 1 -- 172.21.15.106:0/2623809318 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194012870 con 0x7f81ac15d080 2024-04-26T21:17:01.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ac1429e0 con 0x7f81ac15d080 2024-04-26T21:17:01.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ac142fa0 con 0x7f81ac15d080 2024-04-26T21:17:01.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ac069400 con 0x7f81ac15d080 2024-04-26T21:17:01.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81a9600640 1 -- 172.21.15.106:0/2623809318 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8194012a10 con 0x7f81ac15d080 2024-04-26T21:17:01.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81a9600640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81880683b0 0x7f818806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81a9600640 1 -- 172.21.15.106:0/2623809318 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f8194086b60 con 0x7f81ac15d080 2024-04-26T21:17:01.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.379+0000 7f81b1200640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81880683b0 0x7f818806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.383+0000 7f81b1200640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81880683b0 0x7f818806a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f819c0011f0 tx=0x7f819c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:01.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.383+0000 7f81a9600640 1 -- 172.21.15.106:0/2623809318 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8194056c90 con 0x7f81ac15d080 2024-04-26T21:17:01.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f81ac0cd1c0 con 0x7f81ac15d080 2024-04-26T21:17:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81a9600640 1 -- 172.21.15.106:0/2623809318 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f8194056590 con 0x7f81ac15d080 2024-04-26T21:17:01.546 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:01.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81880683b0 msgr2=0x7f818806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81880683b0 0x7f818806a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f819c0011f0 tx=0x7f819c009040 comp rx=0 tx=0).stop 2024-04-26T21:17:01.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ac15d080 msgr2=0x7f81ac1f9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ac15d080 0x7f81ac1f9010 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f819400c500 tx=0x7f819400c9c0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 shutdown_connections 2024-04-26T21:17:01.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81ac15ea90 0x7f81ac1fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81880683b0 0x7f818806a870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ac15d080 0x7f81ac1f9010 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 --2- 172.21.15.106:0/2623809318 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81ac15c4e0 0x7f81ac15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 >> 172.21.15.106:0/2623809318 conn(0x7f81ac0b2910 msgr2=0x7f81ac0c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:01.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 shutdown_connections 2024-04-26T21:17:01.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.543+0000 7f81b3c00640 1 -- 172.21.15.106:0/2623809318 wait complete. 2024-04-26T21:17:01.567 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:01.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.707+0000 7f1715e00640 1 Processor -- start 2024-04-26T21:17:01.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.707+0000 7f1715e00640 1 -- start start 2024-04-26T21:17:01.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f1715e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f171015aad0 0x7f1710070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f1715e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171006e7b0 0x7f171006ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f1715e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17100ce460 con 0x7f171015ddf0 2024-04-26T21:17:01.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f1715e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f171006f140 con 0x7f171015aad0 2024-04-26T21:17:01.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f1715e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f171015eca0 con 0x7f171006e7b0 2024-04-26T21:17:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f170f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171006e7b0 0x7f171006ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f1706000640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f171015ddf0 0x7f171015e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:48556/0 (socket says 172.21.15.106:48556) 2024-04-26T21:17:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f170ea00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f171015aad0 0x7f1710070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f1706000640 1 -- 172.21.15.106:0/3029985606 learned_addr learned my addr 172.21.15.106:0/3029985606 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f170f400640 1 -- 172.21.15.106:0/3029985606 >> v2:172.21.15.112:3300/0 conn(0x7f171015aad0 msgr2=0x7f1710070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f170f400640 1 --2- 172.21.15.106:0/3029985606 >> v2:172.21.15.112:3300/0 conn(0x7f171015aad0 0x7f1710070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f170f400640 1 -- 172.21.15.106:0/3029985606 >> v1:172.21.15.112:6789/0 conn(0x7f171015ddf0 legacy=0x7f171015e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f170f400640 1 -- 172.21.15.106:0/3029985606 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17100cdea0 con 0x7f171006e7b0 2024-04-26T21:17:01.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.711+0000 7f170ea00640 1 --2- 172.21.15.106:0/3029985606 >> v2:172.21.15.112:3300/0 conn(0x7f171015aad0 0x7f1710070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:01.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f170f400640 1 --2- 172.21.15.106:0/3029985606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171006e7b0 0x7f171006ec00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f17080097c0 tx=0x7f170801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8abca8d4a55158 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f170e000640 1 -- 172.21.15.106:0/3029985606 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080b0070 con 0x7f171006e7b0 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f170e000640 1 -- 172.21.15.106:0/3029985606 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17080ab600 con 0x7f171006e7b0 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f170e000640 1 -- 172.21.15.106:0/3029985606 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080ab9d0 con 0x7f171006e7b0 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 -- 172.21.15.106:0/3029985606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171006e7b0 msgr2=0x7f171006ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 --2- 172.21.15.106:0/3029985606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171006e7b0 0x7f171006ec00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f17080097c0 tx=0x7f170801c410 comp rx=0 tx=0).stop 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 -- 172.21.15.106:0/3029985606 shutdown_connections 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 --2- 172.21.15.106:0/3029985606 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171006e7b0 0x7f171006ec00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 --2- 172.21.15.106:0/3029985606 >> v2:172.21.15.112:3300/0 conn(0x7f171015aad0 0x7f1710070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 -- 172.21.15.106:0/3029985606 >> 172.21.15.106:0/3029985606 conn(0x7f171006c400 msgr2=0x7f171006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 -- 172.21.15.106:0/3029985606 shutdown_connections 2024-04-26T21:17:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 -- 172.21.15.106:0/3029985606 wait complete. 2024-04-26T21:17:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 Processor -- start 2024-04-26T21:17:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.715+0000 7f1715e00640 1 -- start start 2024-04-26T21:17:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1715e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f171006e7b0 0x7f1710154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1715e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f171015aad0 0x7f17100b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1715e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171015ddf0 0x7f17100d0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1715e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1710075ee0 con 0x7f171015aad0 2024-04-26T21:17:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1715e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1710075d60 con 0x7f171006e7b0 2024-04-26T21:17:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1715e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1710169b30 con 0x7f171015ddf0 2024-04-26T21:17:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1706000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f171015aad0 0x7f17100b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f170f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171015ddf0 0x7f17100d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1706000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f171015aad0 0x7f17100b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58944/0 (socket says 172.21.15.106:58944) 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1706000640 1 -- 172.21.15.106:0/4248276385 learned_addr learned my addr 172.21.15.106:0/4248276385 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f170ea00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f171006e7b0 0x7f1710154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f170f400640 1 -- 172.21.15.106:0/4248276385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f171006e7b0 msgr2=0x7f1710154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f170f400640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f171006e7b0 0x7f1710154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f170f400640 1 -- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f171015aad0 msgr2=0x7f17100b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f170f400640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f171015aad0 0x7f17100b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f170f400640 1 -- 172.21.15.106:0/4248276385 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17100b1e90 con 0x7f171015ddf0 2024-04-26T21:17:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1706000640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f171015aad0 0x7f17100b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:01.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f170f400640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171015ddf0 0x7f17100d0890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17080ab000 tx=0x7f17080191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:01.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1707e00640 1 -- 172.21.15.106:0/4248276385 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080b8020 con 0x7f171015ddf0 2024-04-26T21:17:01.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1707e00640 1 -- 172.21.15.106:0/4248276385 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17080b4410 con 0x7f171015ddf0 2024-04-26T21:17:01.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17100b2170 con 0x7f171015ddf0 2024-04-26T21:17:01.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1707e00640 1 -- 172.21.15.106:0/4248276385 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080b0040 con 0x7f171015ddf0 2024-04-26T21:17:01.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17100b2730 con 0x7f171015ddf0 2024-04-26T21:17:01.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17100b2900 con 0x7f171015ddf0 2024-04-26T21:17:01.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.719+0000 7f1707e00640 1 -- 172.21.15.106:0/4248276385 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17080bb020 con 0x7f171015ddf0 2024-04-26T21:17:01.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.723+0000 7f1707e00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f16ec068380 0x7f16ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:01.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.723+0000 7f1707e00640 1 -- 172.21.15.106:0/4248276385 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f1708120b40 con 0x7f171015ddf0 2024-04-26T21:17:01.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.723+0000 7f170ea00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f16ec068380 0x7f16ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.723+0000 7f170ea00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f16ec068380 0x7f16ec06a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1700009bd0 tx=0x7f170000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:01.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.727+0000 7f1707e00640 1 -- 172.21.15.106:0/4248276385 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f17080c2030 con 0x7f171015ddf0 2024-04-26T21:17:01.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1710069400 con 0x7f171015ddf0 2024-04-26T21:17:01.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1707e00640 1 -- 172.21.15.106:0/4248276385 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f1708016090 con 0x7f171015ddf0 2024-04-26T21:17:01.890 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:01.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f16ec068380 msgr2=0x7f16ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f16ec068380 0x7f16ec06a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1700009bd0 tx=0x7f170000b040 comp rx=0 tx=0).stop 2024-04-26T21:17:01.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171015ddf0 msgr2=0x7f17100d0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:01.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171015ddf0 0x7f17100d0890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17080ab000 tx=0x7f17080191b0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 shutdown_connections 2024-04-26T21:17:01.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f16ec068380 0x7f16ec06a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f171015ddf0 0x7f17100d0890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f171015aad0 0x7f17100b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 --2- 172.21.15.106:0/4248276385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f171006e7b0 0x7f1710154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:01.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 >> 172.21.15.106:0/4248276385 conn(0x7f171006c400 msgr2=0x7f171015c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:01.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 shutdown_connections 2024-04-26T21:17:01.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:01.887+0000 7f1715e00640 1 -- 172.21.15.106:0/4248276385 wait complete. 2024-04-26T21:17:01.912 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.043+0000 7fc73c800640 1 Processor -- start 2024-04-26T21:17:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.043+0000 7fc73c800640 1 -- start start 2024-04-26T21:17:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.043+0000 7fc73c800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc73413ed60 0x7fc73415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.043+0000 7fc73c800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc73406eb70 0x7fc7340d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.043+0000 7fc73c800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7340b3d10 con 0x7fc73413f140 2024-04-26T21:17:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.043+0000 7fc73c800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc7340b3ac0 con 0x7fc73413ed60 2024-04-26T21:17:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.043+0000 7fc73c800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc7340b4920 con 0x7fc73406eb70 2024-04-26T21:17:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.043+0000 7fc73a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc73406eb70 0x7fc7340d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc73a800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc73406eb70 0x7fc7340d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:50976/0 (socket says 172.21.15.106:50976) 2024-04-26T21:17:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc73a800640 1 -- 172.21.15.106:0/2301905222 learned_addr learned my addr 172.21.15.106:0/2301905222 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc739e00640 1 --2- 172.21.15.106:0/2301905222 >> v2:172.21.15.112:3300/0 conn(0x7fc73413ed60 0x7fc73415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc739e00640 1 -- 172.21.15.106:0/2301905222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc73406eb70 msgr2=0x7fc7340d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc739e00640 1 --2- 172.21.15.106:0/2301905222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc73406eb70 0x7fc7340d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc739e00640 1 -- 172.21.15.106:0/2301905222 >> v1:172.21.15.112:6789/0 conn(0x7fc73413f140 legacy=0x7fc7340b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc739e00640 1 -- 172.21.15.106:0/2301905222 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7340b3ff0 con 0x7fc73413ed60 2024-04-26T21:17:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc73a800640 1 --2- 172.21.15.106:0/2301905222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc73406eb70 0x7fc7340d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:02.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc739e00640 1 --2- 172.21.15.106:0/2301905222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc73413ed60 0x7fc73415c3e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7340b3c40 tx=0x7fc72801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=337d713713329703 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:02.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc738a00640 1 -- 172.21.15.106:0/2301905222 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7280b0070 con 0x7fc73413ed60 2024-04-26T21:17:02.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc738a00640 1 -- 172.21.15.106:0/2301905222 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7280ab600 con 0x7fc73413ed60 2024-04-26T21:17:02.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.047+0000 7fc738a00640 1 -- 172.21.15.106:0/2301905222 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7280ab9d0 con 0x7fc73413ed60 2024-04-26T21:17:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 -- 172.21.15.106:0/2301905222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc73413ed60 msgr2=0x7fc73415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 --2- 172.21.15.106:0/2301905222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc73413ed60 0x7fc73415c3e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7340b3c40 tx=0x7fc72801c380 comp rx=0 tx=0).stop 2024-04-26T21:17:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 -- 172.21.15.106:0/2301905222 shutdown_connections 2024-04-26T21:17:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 --2- 172.21.15.106:0/2301905222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc73406eb70 0x7fc7340d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 --2- 172.21.15.106:0/2301905222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc73413ed60 0x7fc73415c3e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 -- 172.21.15.106:0/2301905222 >> 172.21.15.106:0/2301905222 conn(0x7fc734068340 msgr2=0x7fc734068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 -- 172.21.15.106:0/2301905222 shutdown_connections 2024-04-26T21:17:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 -- 172.21.15.106:0/2301905222 wait complete. 2024-04-26T21:17:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 Processor -- start 2024-04-26T21:17:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 -- start start 2024-04-26T21:17:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc73413ed60 0x7fc73413acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc734159460 0x7fc73413b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc734168bd0 0x7fc734169080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc7341607b0 con 0x7fc734159460 2024-04-26T21:17:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc734160630 con 0x7fc73413ed60 2024-04-26T21:17:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73c800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc734166b50 con 0x7fc734168bd0 2024-04-26T21:17:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc734159460 0x7fc73413b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc734159460 0x7fc73413b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58948/0 (socket says 172.21.15.106:58948) 2024-04-26T21:17:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739400640 1 -- 172.21.15.106:0/758630765 learned_addr learned my addr 172.21.15.106:0/758630765 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739e00640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc73413ed60 0x7fc73413acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc73a800640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc734168bd0 0x7fc734169080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739400640 1 -- 172.21.15.106:0/758630765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc734168bd0 msgr2=0x7fc734169080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739400640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc734168bd0 0x7fc734169080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739400640 1 -- 172.21.15.106:0/758630765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc73413ed60 msgr2=0x7fc73413acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739400640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc73413ed60 0x7fc73413acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739400640 1 -- 172.21.15.106:0/758630765 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7341598e0 con 0x7fc734159460 2024-04-26T21:17:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc739400640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc734159460 0x7fc73413b810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c370 tx=0x7fc72400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.051+0000 7fc72e000640 1 -- 172.21.15.106:0/758630765 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7240052d0 con 0x7fc734159460 2024-04-26T21:17:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc72e000640 1 -- 172.21.15.106:0/758630765 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc724005470 con 0x7fc734159460 2024-04-26T21:17:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc72e000640 1 -- 172.21.15.106:0/758630765 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724007260 con 0x7fc734159460 2024-04-26T21:17:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73415cc90 con 0x7fc734159460 2024-04-26T21:17:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73415d250 con 0x7fc734159460 2024-04-26T21:17:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc734069400 con 0x7fc734159460 2024-04-26T21:17:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc72e000640 1 -- 172.21.15.106:0/758630765 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc724007400 con 0x7fc734159460 2024-04-26T21:17:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc72e000640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc718068380 0x7fc71806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc72e000640 1 -- 172.21.15.106:0/758630765 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc7240861c0 con 0x7fc734159460 2024-04-26T21:17:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc739e00640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc718068380 0x7fc71806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.055+0000 7fc739e00640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc718068380 0x7fc71806a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7280ad000 tx=0x7fc7280a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:02.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.059+0000 7fc72e000640 1 -- 172.21.15.106:0/758630765 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc724055d20 con 0x7fc734159460 2024-04-26T21:17:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.215+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7341695c0 con 0x7fc734159460 2024-04-26T21:17:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.215+0000 7fc72e000640 1 -- 172.21.15.106:0/758630765 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7fc72405c020 con 0x7fc734159460 2024-04-26T21:17:02.220 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:02.220 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc718068380 msgr2=0x7fc71806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc718068380 0x7fc71806a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7280ad000 tx=0x7fc7280a6000 comp rx=0 tx=0).stop 2024-04-26T21:17:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc734159460 msgr2=0x7fc73413b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc734159460 0x7fc73413b810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c370 tx=0x7fc72400c830 comp rx=0 tx=0).stop 2024-04-26T21:17:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 shutdown_connections 2024-04-26T21:17:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc718068380 0x7fc71806a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc734168bd0 0x7fc734169080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc734159460 0x7fc73413b810 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 --2- 172.21.15.106:0/758630765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc73413ed60 0x7fc73413acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 >> 172.21.15.106:0/758630765 conn(0x7fc734068340 msgr2=0x7fc73413d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 shutdown_connections 2024-04-26T21:17:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.219+0000 7fc73c800640 1 -- 172.21.15.106:0/758630765 wait complete. 2024-04-26T21:17:02.242 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:02.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:02.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.379+0000 7f90e1200640 1 Processor -- start 2024-04-26T21:17:02.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.379+0000 7f90e1200640 1 -- start start 2024-04-26T21:17:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.379+0000 7f90e1200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90dc06ef90 0x7f90dc15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90e1200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90dc159600 con 0x7f90dc0d0580 2024-04-26T21:17:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90e1200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90dc0b3d40 con 0x7f90dc159220 2024-04-26T21:17:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90e1200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f90dc0b4020 con 0x7f90dc06ef90 2024-04-26T21:17:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90da800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f90dc0d0580 0x7f90dc15cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49254/0 (socket says 172.21.15.106:49254) 2024-04-26T21:17:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90da800640 1 -- 172.21.15.106:0/3677460265 learned_addr learned my addr 172.21.15.106:0/3677460265 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:02.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d9400640 1 --2- 172.21.15.106:0/3677460265 >> v2:172.21.15.112:3300/0 conn(0x7f90dc06ef90 0x7f90dc15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149532555 0 0) 0x7f90dc159600 con 0x7f90dc0d0580 2024-04-26T21:17:02.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90c0003530 con 0x7f90dc0d0580 2024-04-26T21:17:02.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2521310137 0 0) 0x7f90c0003530 con 0x7f90dc0d0580 2024-04-26T21:17:02.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 >> v2:172.21.15.112:3300/0 conn(0x7f90dc06ef90 msgr2=0x7f90dc15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:02.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 --2- 172.21.15.106:0/3677460265 >> v2:172.21.15.112:3300/0 conn(0x7f90dc06ef90 0x7f90dc15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 >> v1:172.21.15.112:6789/0 conn(0x7f90dc159220 legacy=0x7f90dc06e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc0b4300 con 0x7f90dc0d0580 2024-04-26T21:17:02.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f90d4001a00 con 0x7f90dc0d0580 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 >> v1:172.21.15.106:6789/0 conn(0x7f90dc0d0580 legacy=0x7f90dc15cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90c00039c0 0x7f90c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c00043c0 0x7f90c0004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90c000cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc0b4020 con 0x7f90c0005130 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f90c000d180 con 0x7f90c00043c0 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f90c0005a20 con 0x7f90c00039c0 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d9e00640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90c00039c0 0x7f90c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d9400640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c00043c0 0x7f90c0004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90da800640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90c000cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90da800640 1 -- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90c00039c0 msgr2=0x7f90c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:02.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90da800640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90c00039c0 0x7f90c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90da800640 1 -- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c00043c0 msgr2=0x7f90c0004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:02.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90da800640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c00043c0 0x7f90c0004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90da800640 1 -- 172.21.15.106:0/3677460265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c0003530 con 0x7f90c0005130 2024-04-26T21:17:02.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d9400640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90c00043c0 0x7f90c0004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:02.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.383+0000 7f90d9e00640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90c00039c0 0x7f90c0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:02.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90da800640 1 -- 172.21.15.106:0/3677460265 reap_dead start 2024-04-26T21:17:02.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90da800640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90c000cae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f90d400a870 tx=0x7f90dc15dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37febb0d8998012 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:02.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c4001510 con 0x7f90c0005130 2024-04-26T21:17:02.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d40ac620 con 0x7f90c0005130 2024-04-26T21:17:02.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90d8a00640 1 -- 172.21.15.106:0/3677460265 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0096b0 con 0x7f90c0005130 2024-04-26T21:17:02.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90e1200640 1 -- 172.21.15.106:0/3677460265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 msgr2=0x7f90c000cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90e1200640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90c000cae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f90d400a870 tx=0x7f90dc15dc90 comp rx=0 tx=0).stop 2024-04-26T21:17:02.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90e1200640 1 -- 172.21.15.106:0/3677460265 shutdown_connections 2024-04-26T21:17:02.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90e1200640 1 --2- 172.21.15.106:0/3677460265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90c000cae0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90e1200640 1 -- 172.21.15.106:0/3677460265 >> 172.21.15.106:0/3677460265 conn(0x7f90dc0b2910 msgr2=0x7f90dc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:02.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90e1200640 1 -- 172.21.15.106:0/3677460265 shutdown_connections 2024-04-26T21:17:02.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90e1200640 1 -- 172.21.15.106:0/3677460265 wait complete. 2024-04-26T21:17:02.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90e1200640 1 Processor -- start 2024-04-26T21:17:02.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.387+0000 7f90e1200640 1 -- start start 2024-04-26T21:17:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90e1200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90dc13e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90e1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90dc155670 0x7f90dc155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90e1200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90dc1578d0 0x7f90dc157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90e1200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc15bcb0 con 0x7f90c0005130 2024-04-26T21:17:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90e1200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc15bb30 con 0x7f90dc155670 2024-04-26T21:17:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90e1200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f90dc15be30 con 0x7f90dc1578d0 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90dc13e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90dc13e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58968/0 (socket says 172.21.15.106:58968) 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9e00640 1 -- 172.21.15.106:0/2850770394 learned_addr learned my addr 172.21.15.106:0/2850770394 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90da800640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90dc1578d0 0x7f90dc157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9e00640 1 -- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90dc1578d0 msgr2=0x7f90dc157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9400640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90dc155670 0x7f90dc155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9e00640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90dc1578d0 0x7f90dc157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9e00640 1 -- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90dc155670 msgr2=0x7f90dc155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9e00640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90dc155670 0x7f90dc155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9e00640 1 -- 172.21.15.106:0/2850770394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc158290 con 0x7f90c0005130 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90da800640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90dc1578d0 0x7f90dc157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9400640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90dc155670 0x7f90dc155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d9e00640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90dc13e540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f90c400f840 tx=0x7f90c400fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d2000640 1 -- 172.21.15.106:0/2850770394 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c40052e0 con 0x7f90c0005130 2024-04-26T21:17:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d2000640 1 -- 172.21.15.106:0/2850770394 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c4018070 con 0x7f90c0005130 2024-04-26T21:17:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d2000640 1 -- 172.21.15.106:0/2850770394 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c400d910 con 0x7f90c0005130 2024-04-26T21:17:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90dc140fe0 con 0x7f90c0005130 2024-04-26T21:17:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90dc158820 con 0x7f90c0005130 2024-04-26T21:17:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90dc069400 con 0x7f90c0005130 2024-04-26T21:17:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.391+0000 7f90d2000640 1 -- 172.21.15.106:0/2850770394 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f90c400dab0 con 0x7f90c0005130 2024-04-26T21:17:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.395+0000 7f90d2000640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f90b80683b0 0x7f90b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.395+0000 7f90d2000640 1 -- 172.21.15.106:0/2850770394 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f90c4086cc0 con 0x7f90c0005130 2024-04-26T21:17:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.395+0000 7f90d9400640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f90b80683b0 0x7f90b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.395+0000 7f90d9400640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f90b80683b0 0x7f90b806a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90dc151e30 tx=0x7f90cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.399+0000 7f90d2000640 1 -- 172.21.15.106:0/2850770394 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f90c408d080 con 0x7f90c0005130 2024-04-26T21:17:02.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90dc154d50 con 0x7f90c0005130 2024-04-26T21:17:02.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90d2000640 1 -- 172.21.15.106:0/2850770394 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f90c4056de0 con 0x7f90c0005130 2024-04-26T21:17:02.559 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f90b80683b0 msgr2=0x7f90b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f90b80683b0 0x7f90b806a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90dc151e30 tx=0x7f90cc008040 comp rx=0 tx=0).stop 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 msgr2=0x7f90dc13e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90dc13e540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f90c400f840 tx=0x7f90c400fd00 comp rx=0 tx=0).stop 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 shutdown_connections 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90dc155670 0x7f90dc155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f90b80683b0 0x7f90b806a870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90dc1578d0 0x7f90dc157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 --2- 172.21.15.106:0/2850770394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90c0005130 0x7f90dc13e540 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.555+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 >> 172.21.15.106:0/2850770394 conn(0x7f90dc0b2910 msgr2=0x7f90dc15cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.559+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 shutdown_connections 2024-04-26T21:17:02.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.559+0000 7f90e1200640 1 -- 172.21.15.106:0/2850770394 wait complete. 2024-04-26T21:17:02.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.715+0000 7f3333000640 1 Processor -- start 2024-04-26T21:17:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.715+0000 7f3333000640 1 -- start start 2024-04-26T21:17:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.715+0000 7f3333000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c0ae8d0 0x7f332c0b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.715+0000 7f3333000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332c0726a0 con 0x7f332c159890 2024-04-26T21:17:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.715+0000 7f3333000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332c072af0 con 0x7f332c0aed30 2024-04-26T21:17:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.715+0000 7f3333000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f332c0b3e20 con 0x7f332c0ae8d0 2024-04-26T21:17:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332be00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f332c159890 0x7f332c071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49264/0 (socket says 172.21.15.106:49264) 2024-04-26T21:17:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332be00640 1 -- 172.21.15.106:0/889709320 learned_addr learned my addr 172.21.15.106:0/889709320 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198585043 0 0) 0x7f332c0726a0 con 0x7f332c159890 2024-04-26T21:17:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f3323400640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c0ae8d0 0x7f332c0b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3310003530 con 0x7f332c159890 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3591959211 0 0) 0x7f3310003530 con 0x7f332c159890 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c0ae8d0 msgr2=0x7f332c0b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c0ae8d0 0x7f332c0b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 >> v1:172.21.15.112:6789/0 conn(0x7f332c0aed30 legacy=0x7f332c0b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c072dd0 con 0x7f332c159890 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f331c001680 con 0x7f332c159890 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 >> v1:172.21.15.106:6789/0 conn(0x7f332c159890 legacy=0x7f332c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33100039f0 0x7f3310003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c0ae8d0 0x7f3310004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3310004d50 0x7f33100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f331000bbf0 con 0x7f33100039f0 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f331000bd70 con 0x7f3310004d50 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f331000bf40 con 0x7f332c0ae8d0 2024-04-26T21:17:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332be00640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33100039f0 0x7f3310003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f3323400640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c0ae8d0 0x7f3310004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f3331000640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3310004d50 0x7f33100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332be00640 1 -- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c0ae8d0 msgr2=0x7f3310004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332be00640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c0ae8d0 0x7f3310004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332be00640 1 -- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3310004d50 msgr2=0x7f33100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332be00640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3310004d50 0x7f33100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.719+0000 7f332be00640 1 -- 172.21.15.106:0/889709320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3310003530 con 0x7f33100039f0 2024-04-26T21:17:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f332be00640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33100039f0 0x7f3310003e10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f331c00c1f0 tx=0x7f331c01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5d00f0d66012f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c007d00 con 0x7f33100039f0 2024-04-26T21:17:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331c005b00 con 0x7f33100039f0 2024-04-26T21:17:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f332b400640 1 -- 172.21.15.106:0/889709320 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c007070 con 0x7f33100039f0 2024-04-26T21:17:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 -- 172.21.15.106:0/889709320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33100039f0 msgr2=0x7f3310003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 --2- 172.21.15.106:0/889709320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33100039f0 0x7f3310003e10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f331c00c1f0 tx=0x7f331c01f3b0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3331000640 1 -- 172.21.15.106:0/889709320 reap_dead start 2024-04-26T21:17:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 -- 172.21.15.106:0/889709320 shutdown_connections 2024-04-26T21:17:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 -- 172.21.15.106:0/889709320 >> 172.21.15.106:0/889709320 conn(0x7f332c0b2910 msgr2=0x7f332c0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 -- 172.21.15.106:0/889709320 shutdown_connections 2024-04-26T21:17:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 -- 172.21.15.106:0/889709320 wait complete. 2024-04-26T21:17:02.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 Processor -- start 2024-04-26T21:17:02.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 -- start start 2024-04-26T21:17:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33100039f0 0x7f332c14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c157f30 0x7f332c152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f332c153470 0x7f332c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f332c160580 con 0x7f332c153470 2024-04-26T21:17:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0b43c0 con 0x7f33100039f0 2024-04-26T21:17:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.723+0000 7f3333000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f332c0730b0 con 0x7f332c157f30 2024-04-26T21:17:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3331000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f332c153470 0x7f332c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3323400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c157f30 0x7f332c152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3331000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f332c153470 0x7f332c1550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58976/0 (socket says 172.21.15.106:58976) 2024-04-26T21:17:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3331000640 1 -- 172.21.15.106:0/2382174974 learned_addr learned my addr 172.21.15.106:0/2382174974 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f332be00640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33100039f0 0x7f332c14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3331000640 1 -- 172.21.15.106:0/2382174974 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c157f30 msgr2=0x7f332c152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3331000640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c157f30 0x7f332c152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3331000640 1 -- 172.21.15.106:0/2382174974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33100039f0 msgr2=0x7f332c14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3331000640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33100039f0 0x7f332c14e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3331000640 1 -- 172.21.15.106:0/2382174974 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c153200 con 0x7f332c153470 2024-04-26T21:17:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3331000640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f332c153470 0x7f332c1550a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f332c06e060 tx=0x7f332400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:02.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3328c00640 1 -- 172.21.15.106:0/2382174974 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324003980 con 0x7f332c153470 2024-04-26T21:17:02.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3328c00640 1 -- 172.21.15.106:0/2382174974 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3324018070 con 0x7f332c153470 2024-04-26T21:17:02.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3328c00640 1 -- 172.21.15.106:0/2382174974 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324003d60 con 0x7f332c153470 2024-04-26T21:17:02.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332c157170 con 0x7f332c153470 2024-04-26T21:17:02.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f332c157730 con 0x7f332c153470 2024-04-26T21:17:02.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f332c069400 con 0x7f332c153470 2024-04-26T21:17:02.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.727+0000 7f3328c00640 1 -- 172.21.15.106:0/2382174974 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33240050d0 con 0x7f332c153470 2024-04-26T21:17:02.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.731+0000 7f3328c00640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33080683b0 0x7f330806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:02.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.731+0000 7f3328c00640 1 -- 172.21.15.106:0/2382174974 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f33240869a0 con 0x7f332c153470 2024-04-26T21:17:02.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.731+0000 7f332be00640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33080683b0 0x7f330806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:02.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.731+0000 7f332be00640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33080683b0 0x7f330806a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f331c0ae000 tx=0x7f331c0b4040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:02.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.735+0000 7f3328c00640 1 -- 172.21.15.106:0/2382174974 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3324056500 con 0x7f332c153470 2024-04-26T21:17:02.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.891+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f332c14eab0 con 0x7f332c153470 2024-04-26T21:17:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.891+0000 7f3328c00640 1 -- 172.21.15.106:0/2382174974 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f332405a800 con 0x7f332c153470 2024-04-26T21:17:02.896 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:02.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33080683b0 msgr2=0x7f330806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33080683b0 0x7f330806a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f331c0ae000 tx=0x7f331c0b4040 comp rx=0 tx=0).stop 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f332c153470 msgr2=0x7f332c1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f332c153470 0x7f332c1550a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f332c06e060 tx=0x7f332400ec10 comp rx=0 tx=0).stop 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 shutdown_connections 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33080683b0 0x7f330806a870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f332c153470 0x7f332c1550a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f332c157f30 0x7f332c152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 --2- 172.21.15.106:0/2382174974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33100039f0 0x7f332c14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 >> 172.21.15.106:0/2382174974 conn(0x7f332c0b2910 msgr2=0x7f332c158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 shutdown_connections 2024-04-26T21:17:02.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:02.895+0000 7f3333000640 1 -- 172.21.15.106:0/2382174974 wait complete. 2024-04-26T21:17:02.918 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:03.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.051+0000 7fe749a00640 1 Processor -- start 2024-04-26T21:17:03.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.051+0000 7fe749a00640 1 -- start start 2024-04-26T21:17:03.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe749a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe74415ea90 0x7fe744166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe749a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7440b4f00 con 0x7fe74415c4e0 2024-04-26T21:17:03.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe749a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7440b51e0 con 0x7fe74415d080 2024-04-26T21:17:03.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe749a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe74415d5f0 con 0x7fe74415ea90 2024-04-26T21:17:03.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe742a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe74415c4e0 0x7fe74415c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49272/0 (socket says 172.21.15.106:49272) 2024-04-26T21:17:03.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe742a00640 1 -- 172.21.15.106:0/3499552777 learned_addr learned my addr 172.21.15.106:0/3499552777 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:03.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe743400640 1 --2- 172.21.15.106:0/3499552777 >> v2:172.21.15.106:3300/0 conn(0x7fe74415ea90 0x7fe744166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe741600640 1 -- 172.21.15.106:0/3499552777 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806475076 0 0) 0x7fe7440b4f00 con 0x7fe74415c4e0 2024-04-26T21:17:03.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe741600640 1 -- 172.21.15.106:0/3499552777 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe728003530 con 0x7fe74415c4e0 2024-04-26T21:17:03.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe743400640 1 -- 172.21.15.106:0/3499552777 >> v1:172.21.15.112:6789/0 conn(0x7fe74415d080 legacy=0x7fe7440b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe743400640 1 -- 172.21.15.106:0/3499552777 >> v1:172.21.15.106:6789/0 conn(0x7fe74415c4e0 legacy=0x7fe74415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.055+0000 7fe743400640 1 -- 172.21.15.106:0/3499552777 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7440b54c0 con 0x7fe74415ea90 2024-04-26T21:17:03.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe743400640 1 --2- 172.21.15.106:0/3499552777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415ea90 0x7fe744166db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009d90 tx=0x7fe73c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f2e87abd30e847 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:03.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe741600640 1 -- 172.21.15.106:0/3499552777 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0b2070 con 0x7fe74415ea90 2024-04-26T21:17:03.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe741600640 1 -- 172.21.15.106:0/3499552777 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73c0a58e0 con 0x7fe74415ea90 2024-04-26T21:17:03.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe741600640 1 -- 172.21.15.106:0/3499552777 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0a5c90 con 0x7fe74415ea90 2024-04-26T21:17:03.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 -- 172.21.15.106:0/3499552777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415ea90 msgr2=0x7fe744166db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 --2- 172.21.15.106:0/3499552777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415ea90 0x7fe744166db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009d90 tx=0x7fe73c01c970 comp rx=0 tx=0).stop 2024-04-26T21:17:03.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 -- 172.21.15.106:0/3499552777 shutdown_connections 2024-04-26T21:17:03.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 --2- 172.21.15.106:0/3499552777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415ea90 0x7fe744166db0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 -- 172.21.15.106:0/3499552777 >> 172.21.15.106:0/3499552777 conn(0x7fe7440b2910 msgr2=0x7fe7440b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:03.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 -- 172.21.15.106:0/3499552777 shutdown_connections 2024-04-26T21:17:03.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 -- 172.21.15.106:0/3499552777 wait complete. 2024-04-26T21:17:03.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 Processor -- start 2024-04-26T21:17:03.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 -- start start 2024-04-26T21:17:03.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415c4e0 0x7fe74415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe74415d080 0x7fe7440cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74415ea90 0x7fe7441f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe744169ea0 con 0x7fe74415c4e0 2024-04-26T21:17:03.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe744169d20 con 0x7fe74415ea90 2024-04-26T21:17:03.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe749a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe74416a020 con 0x7fe74415d080 2024-04-26T21:17:03.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.059+0000 7fe742a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415c4e0 0x7fe74415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe742a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415c4e0 0x7fe74415b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58992/0 (socket says 172.21.15.106:58992) 2024-04-26T21:17:03.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe742a00640 1 -- 172.21.15.106:0/2774440915 learned_addr learned my addr 172.21.15.106:0/2774440915 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:03.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe743400640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74415ea90 0x7fe7441f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe742000640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe74415d080 0x7fe7440cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe742a00640 1 -- 172.21.15.106:0/2774440915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe74415d080 msgr2=0x7fe7440cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe742a00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe74415d080 0x7fe7440cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe742a00640 1 -- 172.21.15.106:0/2774440915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74415ea90 msgr2=0x7fe7441f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe742a00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74415ea90 0x7fe7441f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe742a00640 1 -- 172.21.15.106:0/2774440915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7440cfd90 con 0x7fe74415c4e0 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe742a00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415c4e0 0x7fe74415b8b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c420 tx=0x7fe73400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe73aa00640 1 -- 172.21.15.106:0/2774440915 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734017070 con 0x7fe74415c4e0 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe73aa00640 1 -- 172.21.15.106:0/2774440915 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe734005cf0 con 0x7fe74415c4e0 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7440d0070 con 0x7fe74415c4e0 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe73aa00640 1 -- 172.21.15.106:0/2774440915 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7340072d0 con 0x7fe74415c4e0 2024-04-26T21:17:03.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7440d0910 con 0x7fe74415c4e0 2024-04-26T21:17:03.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7440d0240 con 0x7fe74415c4e0 2024-04-26T21:17:03.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe73aa00640 1 -- 172.21.15.106:0/2774440915 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe73401a070 con 0x7fe74415c4e0 2024-04-26T21:17:03.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe73aa00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe7240683b0 0x7fe72406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.063+0000 7fe73aa00640 1 -- 172.21.15.106:0/2774440915 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe734086090 con 0x7fe74415c4e0 2024-04-26T21:17:03.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.067+0000 7fe742000640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe7240683b0 0x7fe72406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.067+0000 7fe742000640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe7240683b0 0x7fe72406a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe74413df60 tx=0x7fe730009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:03.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.071+0000 7fe73aa00640 1 -- 172.21.15.106:0/2774440915 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe734055bf0 con 0x7fe74415c4e0 2024-04-26T21:17:03.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe74406fb90 con 0x7fe74415c4e0 2024-04-26T21:17:03.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe73aa00640 1 -- 172.21.15.106:0/2774440915 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fe734059ef0 con 0x7fe74415c4e0 2024-04-26T21:17:03.229 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:03.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe7240683b0 msgr2=0x7fe72406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe7240683b0 0x7fe72406a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe74413df60 tx=0x7fe730009040 comp rx=0 tx=0).stop 2024-04-26T21:17:03.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415c4e0 msgr2=0x7fe74415b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415c4e0 0x7fe74415b8b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c420 tx=0x7fe73400c8e0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 shutdown_connections 2024-04-26T21:17:03.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe74415ea90 0x7fe7441f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe7240683b0 0x7fe72406a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe74415d080 0x7fe7440cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 --2- 172.21.15.106:0/2774440915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe74415c4e0 0x7fe74415b8b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 >> 172.21.15.106:0/2774440915 conn(0x7fe7440b2910 msgr2=0x7fe7440ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:03.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 shutdown_connections 2024-04-26T21:17:03.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.227+0000 7fe749a00640 1 -- 172.21.15.106:0/2774440915 wait complete. 2024-04-26T21:17:03.251 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:03.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dee00640 1 Processor -- start 2024-04-26T21:17:03.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dee00640 1 -- start start 2024-04-26T21:17:03.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dee00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f08d815cf50 0x7f08d80d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dee00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d80ce460 con 0x7f08d815d330 2024-04-26T21:17:03.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dee00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d80ce740 con 0x7f08d80c7960 2024-04-26T21:17:03.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dee00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f08d80ce210 con 0x7f08d815cf50 2024-04-26T21:17:03.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dd000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f08d815d330 0x7f08d80d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49280/0 (socket says 172.21.15.106:49280) 2024-04-26T21:17:03.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dd000640 1 -- 172.21.15.106:0/237144681 learned_addr learned my addr 172.21.15.106:0/237144681 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:03.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dda00640 1 --2- 172.21.15.106:0/237144681 >> v2:172.21.15.106:3300/0 conn(0x7f08d815cf50 0x7f08d80d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dda00640 1 -- 172.21.15.106:0/237144681 >> v1:172.21.15.112:6789/0 conn(0x7f08d80c7960 legacy=0x7f08d80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dda00640 1 -- 172.21.15.106:0/237144681 >> v1:172.21.15.106:6789/0 conn(0x7f08d815d330 legacy=0x7f08d80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.387+0000 7f08dda00640 1 -- 172.21.15.106:0/237144681 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d80cea20 con 0x7f08d815cf50 2024-04-26T21:17:03.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dda00640 1 --2- 172.21.15.106:0/237144681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 0x7f08d80d0940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0097c0 tx=0x7f08cc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31b4500ba343a33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:03.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08d7e00640 1 -- 172.21.15.106:0/237144681 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0b1070 con 0x7f08d815cf50 2024-04-26T21:17:03.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08d7e00640 1 -- 172.21.15.106:0/237144681 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08cc0ac410 con 0x7f08d815cf50 2024-04-26T21:17:03.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08d7e00640 1 -- 172.21.15.106:0/237144681 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0ac7e0 con 0x7f08d815cf50 2024-04-26T21:17:03.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dee00640 1 -- 172.21.15.106:0/237144681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 msgr2=0x7f08d80d0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dee00640 1 --2- 172.21.15.106:0/237144681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 0x7f08d80d0940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0097c0 tx=0x7f08cc01c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dee00640 1 -- 172.21.15.106:0/237144681 shutdown_connections 2024-04-26T21:17:03.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dee00640 1 --2- 172.21.15.106:0/237144681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 0x7f08d80d0940 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dee00640 1 -- 172.21.15.106:0/237144681 >> 172.21.15.106:0/237144681 conn(0x7f08d80b4610 msgr2=0x7f08d80b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:03.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dee00640 1 -- 172.21.15.106:0/237144681 shutdown_connections 2024-04-26T21:17:03.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dee00640 1 -- 172.21.15.106:0/237144681 wait complete. 2024-04-26T21:17:03.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dee00640 1 Processor -- start 2024-04-26T21:17:03.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.391+0000 7f08dee00640 1 -- start start 2024-04-26T21:17:03.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dee00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08d80c7960 0x7f08d814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dee00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 0x7f08d815f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dee00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08d815d330 0x7f08d80c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dee00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f08d80d0360 con 0x7f08d815cf50 2024-04-26T21:17:03.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dee00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08d80d01e0 con 0x7f08d80c7960 2024-04-26T21:17:03.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dee00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f08d816ad70 con 0x7f08d815d330 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dd000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 0x7f08d815f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dd000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 0x7f08d815f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59018/0 (socket says 172.21.15.106:59018) 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dd000640 1 -- 172.21.15.106:0/2372150845 learned_addr learned my addr 172.21.15.106:0/2372150845 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dda00640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08d80c7960 0x7f08d814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08de400640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08d815d330 0x7f08d80c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dd000640 1 -- 172.21.15.106:0/2372150845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08d815d330 msgr2=0x7f08d80c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dd000640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08d815d330 0x7f08d80c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dd000640 1 -- 172.21.15.106:0/2372150845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08d80c7960 msgr2=0x7f08d814ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dd000640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08d80c7960 0x7f08d814ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dd000640 1 -- 172.21.15.106:0/2372150845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d80b59e0 con 0x7f08d815cf50 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dd000640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 0x7f08d815f890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f08c400c500 tx=0x7f08c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08d5600640 1 -- 172.21.15.106:0/2372150845 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4017070 con 0x7f08d815cf50 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08d5600640 1 -- 172.21.15.106:0/2372150845 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c4005cf0 con 0x7f08d815cf50 2024-04-26T21:17:03.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08d5600640 1 -- 172.21.15.106:0/2372150845 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c40072f0 con 0x7f08d815cf50 2024-04-26T21:17:03.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d80b5cc0 con 0x7f08d815cf50 2024-04-26T21:17:03.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d80b6280 con 0x7f08d815cf50 2024-04-26T21:17:03.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d80506d0 con 0x7f08d815cf50 2024-04-26T21:17:03.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.395+0000 7f08d5600640 1 -- 172.21.15.106:0/2372150845 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08c401a070 con 0x7f08d815cf50 2024-04-26T21:17:03.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.399+0000 7f08d5600640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f08b8068380 0x7f08b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.399+0000 7f08d5600640 1 -- 172.21.15.106:0/2372150845 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f08c4085ff0 con 0x7f08d815cf50 2024-04-26T21:17:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.399+0000 7f08dda00640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f08b8068380 0x7f08b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.399+0000 7f08dda00640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f08b8068380 0x7f08b806a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0ae000 tx=0x7f08cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:03.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.403+0000 7f08d5600640 1 -- 172.21.15.106:0/2372150845 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f08c4055b70 con 0x7f08d815cf50 2024-04-26T21:17:03.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.559+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f08d8075c70 con 0x7f08d815cf50 2024-04-26T21:17:03.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.559+0000 7f08d5600640 1 -- 172.21.15.106:0/2372150845 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f08c4059e70 con 0x7f08d815cf50 2024-04-26T21:17:03.563 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:03.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f08b8068380 msgr2=0x7f08b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f08b8068380 0x7f08b806a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0ae000 tx=0x7f08cc008040 comp rx=0 tx=0).stop 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 msgr2=0x7f08d815f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 0x7f08d815f890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f08c400c500 tx=0x7f08c400c9c0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 shutdown_connections 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f08b8068380 0x7f08b806a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f08d815d330 0x7f08d80c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08d815cf50 0x7f08d815f890 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 --2- 172.21.15.106:0/2372150845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08d80c7960 0x7f08d814ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 >> 172.21.15.106:0/2372150845 conn(0x7f08d80b4610 msgr2=0x7f08d806fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 shutdown_connections 2024-04-26T21:17:03.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.563+0000 7f08dee00640 1 -- 172.21.15.106:0/2372150845 wait complete. 2024-04-26T21:17:03.584 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:03.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.715+0000 7fe6b8000640 1 Processor -- start 2024-04-26T21:17:03.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.715+0000 7fe6b8000640 1 -- start start 2024-04-26T21:17:03.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b8000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6b0146490 0x7fe6b015df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b8000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b0160ac0 0x7fe6b00cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b8000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b00cf730 con 0x7fe6b0146870 2024-04-26T21:17:03.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b8000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe6b00b3da0 con 0x7fe6b0146490 2024-04-26T21:17:03.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b8000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b0160fa0 con 0x7fe6b0160ac0 2024-04-26T21:17:03.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b6000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe6b0146870 0x7fe6b00d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49292/0 (socket says 172.21.15.106:49292) 2024-04-26T21:17:03.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b6000640 1 -- 172.21.15.106:0/1042466548 learned_addr learned my addr 172.21.15.106:0/1042466548 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b4c00640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b0160ac0 0x7fe6b00cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b5600640 1 --2- 172.21.15.106:0/1042466548 >> v2:172.21.15.112:3300/0 conn(0x7fe6b0146490 0x7fe6b015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998553265 0 0) 0x7fe6a80014a0 con 0x7fe6b0146870 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe698003530 con 0x7fe6b0146870 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 685504964 0 0) 0x7fe698003530 con 0x7fe6b0146870 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b0160ac0 msgr2=0x7fe6b00cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b0160ac0 0x7fe6b00cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 >> v2:172.21.15.112:3300/0 conn(0x7fe6b0146490 msgr2=0x7fe6b015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 --2- 172.21.15.106:0/1042466548 >> v2:172.21.15.112:3300/0 conn(0x7fe6b0146490 0x7fe6b015df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b0161280 con 0x7fe6b0146870 2024-04-26T21:17:03.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7fe6a8001bd0 con 0x7fe6b0146870 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 >> v1:172.21.15.106:6789/0 conn(0x7fe6b0146870 legacy=0x7fe6b00d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6980039c0 0x7fe698003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b0160ac0 0x7fe698004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe698004d50 0x7fe6980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b00b3da0 con 0x7fe698004d50 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0160fa0 con 0x7fe6980039c0 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe69800b9d0 con 0x7fe6b0160ac0 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b6000640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe698004d50 0x7fe6980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b4c00640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b0160ac0 0x7fe698004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b5600640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6980039c0 0x7fe698003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b4c00640 1 -- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6980039c0 msgr2=0x7fe698003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b4c00640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6980039c0 0x7fe698003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b4c00640 1 -- 172.21.15.106:0/1042466548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe698004d50 msgr2=0x7fe6980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:03.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b4c00640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe698004d50 0x7fe6980051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b4c00640 1 -- 172.21.15.106:0/1042466548 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe698003530 con 0x7fe6b0160ac0 2024-04-26T21:17:03.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.719+0000 7fe6b6000640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe698004d50 0x7fe6980051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:03.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6b4c00640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b0160ac0 0x7fe698004810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009ae0 tx=0x7fe69c01cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd265a584d553ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:03.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0b2070 con 0x7fe6b0160ac0 2024-04-26T21:17:03.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69c0a56a0 con 0x7fe6b0160ac0 2024-04-26T21:17:03.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6afe00640 1 -- 172.21.15.106:0/1042466548 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0096b0 con 0x7fe6b0160ac0 2024-04-26T21:17:03.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6b8000640 1 -- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b0160ac0 msgr2=0x7fe698004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6b8000640 1 --2- 172.21.15.106:0/1042466548 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b0160ac0 0x7fe698004810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009ae0 tx=0x7fe69c01cab0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6b6000640 1 -- 172.21.15.106:0/1042466548 reap_dead start 2024-04-26T21:17:03.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6b8000640 1 -- 172.21.15.106:0/1042466548 shutdown_connections 2024-04-26T21:17:03.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6b8000640 1 -- 172.21.15.106:0/1042466548 >> 172.21.15.106:0/1042466548 conn(0x7fe6b0068340 msgr2=0x7fe6b0068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:03.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6b8000640 1 -- 172.21.15.106:0/1042466548 shutdown_connections 2024-04-26T21:17:03.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.723+0000 7fe6b8000640 1 -- 172.21.15.106:0/1042466548 wait complete. 2024-04-26T21:17:03.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 Processor -- start 2024-04-26T21:17:03.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 -- start start 2024-04-26T21:17:03.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b0160ac0 0x7fe6b0156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b006ebc0 0x7fe6b006f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6b0140920 0x7fe6b0140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b00b4090 con 0x7fe6b0160ac0 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0161840 con 0x7fe6b0140920 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b00d14b0 con 0x7fe6b006ebc0 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b5600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b0160ac0 0x7fe6b0156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b5600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b0160ac0 0x7fe6b0156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59024/0 (socket says 172.21.15.106:59024) 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b5600640 1 -- 172.21.15.106:0/790002181 learned_addr learned my addr 172.21.15.106:0/790002181 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b4c00640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b006ebc0 0x7fe6b006f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b6000640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6b0140920 0x7fe6b0140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b5600640 1 -- 172.21.15.106:0/790002181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b006ebc0 msgr2=0x7fe6b006f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b5600640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b006ebc0 0x7fe6b006f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b5600640 1 -- 172.21.15.106:0/790002181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6b0140920 msgr2=0x7fe6b0140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b5600640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6b0140920 0x7fe6b0140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b5600640 1 -- 172.21.15.106:0/790002181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b006f660 con 0x7fe6b0160ac0 2024-04-26T21:17:03.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b6000640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6b0140920 0x7fe6b0140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:03.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b5600640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b0160ac0 0x7fe6b0156a70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4011a30 tx=0x7fe6a4011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:03.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6ad600640 1 -- 172.21.15.106:0/790002181 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a400fb50 con 0x7fe6b0160ac0 2024-04-26T21:17:03.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6ad600640 1 -- 172.21.15.106:0/790002181 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a400fcf0 con 0x7fe6b0160ac0 2024-04-26T21:17:03.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6ad600640 1 -- 172.21.15.106:0/790002181 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a400fea0 con 0x7fe6b0160ac0 2024-04-26T21:17:03.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b006f940 con 0x7fe6b0160ac0 2024-04-26T21:17:03.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b006ff00 con 0x7fe6b0160ac0 2024-04-26T21:17:03.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.727+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b0069400 con 0x7fe6b0160ac0 2024-04-26T21:17:03.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.731+0000 7fe6ad600640 1 -- 172.21.15.106:0/790002181 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe6a4012040 con 0x7fe6b0160ac0 2024-04-26T21:17:03.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.731+0000 7fe6ad600640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe690068380 0x7fe69006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:03.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.731+0000 7fe6ad600640 1 -- 172.21.15.106:0/790002181 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe6a4087400 con 0x7fe6b0160ac0 2024-04-26T21:17:03.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.731+0000 7fe6b4c00640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe690068380 0x7fe69006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:03.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.731+0000 7fe6b4c00640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe690068380 0x7fe69006a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009ae0 tx=0x7fe69c0046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:03.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.735+0000 7fe6ad600640 1 -- 172.21.15.106:0/790002181 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe6a4019030 con 0x7fe6b0160ac0 2024-04-26T21:17:03.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.891+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6b0073d70 con 0x7fe6b0160ac0 2024-04-26T21:17:03.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.891+0000 7fe6ad600640 1 -- 172.21.15.106:0/790002181 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7fe6a40575f0 con 0x7fe6b0160ac0 2024-04-26T21:17:03.896 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:03.897 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:03.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe690068380 msgr2=0x7fe69006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe690068380 0x7fe69006a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009ae0 tx=0x7fe69c0046d0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b0160ac0 msgr2=0x7fe6b0156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:03.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b0160ac0 0x7fe6b0156a70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4011a30 tx=0x7fe6a4011ef0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 shutdown_connections 2024-04-26T21:17:03.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6b0140920 0x7fe6b0140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe690068380 0x7fe69006a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6b006ebc0 0x7fe6b006f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 --2- 172.21.15.106:0/790002181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b0160ac0 0x7fe6b0156a70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:03.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 >> 172.21.15.106:0/790002181 conn(0x7fe6b0068340 msgr2=0x7fe6b0144330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:03.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 shutdown_connections 2024-04-26T21:17:03.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:03.895+0000 7fe6b8000640 1 -- 172.21.15.106:0/790002181 wait complete. 2024-04-26T21:17:03.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:03.918 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:04.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc492200640 1 Processor -- start 2024-04-26T21:17:04.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc492200640 1 -- start start 2024-04-26T21:17:04.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc492200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc48c162bf0 0x7fc48c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc492200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc48c0d1e50 0x7fc48c162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc492200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc48c06dc60 con 0x7fc48c15e8c0 2024-04-26T21:17:04.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc492200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc48c06eaf0 con 0x7fc48c0d1e50 2024-04-26T21:17:04.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc492200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc48c163510 con 0x7fc48c162bf0 2024-04-26T21:17:04.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc482a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc48c0d1e50 0x7fc48c162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc48be00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc48c15e8c0 0x7fc48c15ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49306/0 (socket says 172.21.15.106:49306) 2024-04-26T21:17:04.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc48be00640 1 -- 172.21.15.106:0/138021168 learned_addr learned my addr 172.21.15.106:0/138021168 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:04.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc48b400640 1 --2- 172.21.15.106:0/138021168 >> v2:172.21.15.112:3300/0 conn(0x7fc48c162bf0 0x7fc48c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc482a00640 1 -- 172.21.15.106:0/138021168 >> v2:172.21.15.112:3300/0 conn(0x7fc48c162bf0 msgr2=0x7fc48c06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:04.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc482a00640 1 --2- 172.21.15.106:0/138021168 >> v2:172.21.15.112:3300/0 conn(0x7fc48c162bf0 0x7fc48c06d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc482a00640 1 -- 172.21.15.106:0/138021168 >> v1:172.21.15.106:6789/0 conn(0x7fc48c15e8c0 legacy=0x7fc48c15ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc482a00640 1 -- 172.21.15.106:0/138021168 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c06dee0 con 0x7fc48c0d1e50 2024-04-26T21:17:04.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.055+0000 7fc48aa00640 1 -- 172.21.15.106:0/138021168 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073632175 0 0) 0x7fc4840014a0 con 0x7fc48c15e8c0 2024-04-26T21:17:04.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc482a00640 1 --2- 172.21.15.106:0/138021168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c0d1e50 0x7fc48c162fd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc48c073310 tx=0x7fc47401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b545aef1117d44 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:04.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc48aa00640 1 -- 172.21.15.106:0/138021168 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4740ab650 con 0x7fc48c0d1e50 2024-04-26T21:17:04.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc48aa00640 1 -- 172.21.15.106:0/138021168 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4740b0070 con 0x7fc48c0d1e50 2024-04-26T21:17:04.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc48aa00640 1 -- 172.21.15.106:0/138021168 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4740aba10 con 0x7fc48c0d1e50 2024-04-26T21:17:04.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 -- 172.21.15.106:0/138021168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c0d1e50 msgr2=0x7fc48c162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 --2- 172.21.15.106:0/138021168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c0d1e50 0x7fc48c162fd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc48c073310 tx=0x7fc47401c450 comp rx=0 tx=0).stop 2024-04-26T21:17:04.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 -- 172.21.15.106:0/138021168 shutdown_connections 2024-04-26T21:17:04.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 --2- 172.21.15.106:0/138021168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c0d1e50 0x7fc48c162fd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 --2- 172.21.15.106:0/138021168 >> v2:172.21.15.112:3300/0 conn(0x7fc48c162bf0 0x7fc48c06d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 -- 172.21.15.106:0/138021168 >> 172.21.15.106:0/138021168 conn(0x7fc48c0d2c50 msgr2=0x7fc48c0d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:04.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 -- 172.21.15.106:0/138021168 shutdown_connections 2024-04-26T21:17:04.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 -- 172.21.15.106:0/138021168 wait complete. 2024-04-26T21:17:04.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 Processor -- start 2024-04-26T21:17:04.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.059+0000 7fc492200640 1 -- start start 2024-04-26T21:17:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc492200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc48c0d1e50 0x7fc48c162000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc492200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c15e8c0 0x7fc48c15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc492200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc48c162bf0 0x7fc48c0b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc492200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0d22c0 con 0x7fc48c15e8c0 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc492200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c15f3e0 con 0x7fc48c0d1e50 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc492200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc48c0cdd70 con 0x7fc48c162bf0 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc482a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c15e8c0 0x7fc48c15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc482a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c15e8c0 0x7fc48c15ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59036/0 (socket says 172.21.15.106:59036) 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc482a00640 1 -- 172.21.15.106:0/630298531 learned_addr learned my addr 172.21.15.106:0/630298531 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc48be00640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc48c162bf0 0x7fc48c0b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc482a00640 1 -- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc48c162bf0 msgr2=0x7fc48c0b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc48b400640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc48c0d1e50 0x7fc48c162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc482a00640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc48c162bf0 0x7fc48c0b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc482a00640 1 -- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc48c0d1e50 msgr2=0x7fc48c162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc482a00640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc48c0d1e50 0x7fc48c162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc482a00640 1 -- 172.21.15.106:0/630298531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c0b6db0 con 0x7fc48c15e8c0 2024-04-26T21:17:04.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc48b400640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc48c0d1e50 0x7fc48c162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:04.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc48be00640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc48c162bf0 0x7fc48c0b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:04.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc482a00640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c15e8c0 0x7fc48c15ada0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc4740ad040 tx=0x7fc47401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:04.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc483e00640 1 -- 172.21.15.106:0/630298531 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4740bf610 con 0x7fc48c15e8c0 2024-04-26T21:17:04.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc483e00640 1 -- 172.21.15.106:0/630298531 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4740bf7d0 con 0x7fc48c15e8c0 2024-04-26T21:17:04.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48c0b7090 con 0x7fc48c15e8c0 2024-04-26T21:17:04.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc483e00640 1 -- 172.21.15.106:0/630298531 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4740bfbc0 con 0x7fc48c15e8c0 2024-04-26T21:17:04.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48c0b7650 con 0x7fc48c15e8c0 2024-04-26T21:17:04.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48c069400 con 0x7fc48c15e8c0 2024-04-26T21:17:04.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.063+0000 7fc483e00640 1 -- 172.21.15.106:0/630298531 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4740bd020 con 0x7fc48c15e8c0 2024-04-26T21:17:04.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.067+0000 7fc483e00640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc468068380 0x7fc46806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.067+0000 7fc483e00640 1 -- 172.21.15.106:0/630298531 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc474121310 con 0x7fc48c15e8c0 2024-04-26T21:17:04.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.067+0000 7fc48b400640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc468068380 0x7fc46806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.067+0000 7fc48b400640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc468068380 0x7fc46806a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc48c16a490 tx=0x7fc47c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.071+0000 7fc483e00640 1 -- 172.21.15.106:0/630298531 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc4740c6070 con 0x7fc48c15e8c0 2024-04-26T21:17:04.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.227+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc48c0d26e0 con 0x7fc48c15e8c0 2024-04-26T21:17:04.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.227+0000 7fc483e00640 1 -- 172.21.15.106:0/630298531 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fc474016070 con 0x7fc48c15e8c0 2024-04-26T21:17:04.231 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:04.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc468068380 msgr2=0x7fc46806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc468068380 0x7fc46806a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc48c16a490 tx=0x7fc47c008040 comp rx=0 tx=0).stop 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c15e8c0 msgr2=0x7fc48c15ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c15e8c0 0x7fc48c15ada0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc4740ad040 tx=0x7fc47401ac90 comp rx=0 tx=0).stop 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 shutdown_connections 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc468068380 0x7fc46806a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc48c162bf0 0x7fc48c0b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc48c15e8c0 0x7fc48c15ada0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 --2- 172.21.15.106:0/630298531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc48c0d1e50 0x7fc48c162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 >> 172.21.15.106:0/630298531 conn(0x7fc48c0d2c50 msgr2=0x7fc48c0d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 shutdown_connections 2024-04-26T21:17:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.231+0000 7fc492200640 1 -- 172.21.15.106:0/630298531 wait complete. 2024-04-26T21:17:04.253 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:04.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a9a00640 1 Processor -- start 2024-04-26T21:17:04.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a9a00640 1 -- start start 2024-04-26T21:17:04.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a9a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9a40b2900 0x7fa9a4161af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a9a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9a406e4e0 con 0x7fa9a40b3aa0 2024-04-26T21:17:04.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a9a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa9a406e7c0 con 0x7fa9a40b2900 2024-04-26T21:17:04.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a9a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a40d0e00 con 0x7fa9a406df20 2024-04-26T21:17:04.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a9000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9a40b2900 0x7fa9a4161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a3400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a3e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa9a40b3aa0 0x7fa9a40d18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:48612/0 (socket says 172.21.15.106:48612) 2024-04-26T21:17:04.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a3e00640 1 -- 172.21.15.106:0/826711448 learned_addr learned my addr 172.21.15.106:0/826711448 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:04.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a3400640 1 -- 172.21.15.106:0/826711448 >> v2:172.21.15.112:3300/0 conn(0x7fa9a40b2900 msgr2=0x7fa9a4161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:04.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a3400640 1 --2- 172.21.15.106:0/826711448 >> v2:172.21.15.112:3300/0 conn(0x7fa9a40b2900 0x7fa9a4161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a3400640 1 -- 172.21.15.106:0/826711448 >> v1:172.21.15.112:6789/0 conn(0x7fa9a40b3aa0 legacy=0x7fa9a40d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.391+0000 7fa9a3400640 1 -- 172.21.15.106:0/826711448 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a40d10e0 con 0x7fa9a406df20 2024-04-26T21:17:04.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a3400640 1 --2- 172.21.15.106:0/826711448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b23c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa9900097c0 tx=0x7fa99001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7251c774e4b64454 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:04.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a2a00640 1 -- 172.21.15.106:0/826711448 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9900b0070 con 0x7fa9a406df20 2024-04-26T21:17:04.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a2a00640 1 -- 172.21.15.106:0/826711448 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9900ab600 con 0x7fa9a406df20 2024-04-26T21:17:04.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a2a00640 1 -- 172.21.15.106:0/826711448 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9900ab9d0 con 0x7fa9a406df20 2024-04-26T21:17:04.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a9a00640 1 -- 172.21.15.106:0/826711448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 msgr2=0x7fa9a40b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a9a00640 1 --2- 172.21.15.106:0/826711448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b23c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa9900097c0 tx=0x7fa99001c350 comp rx=0 tx=0).stop 2024-04-26T21:17:04.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a9a00640 1 -- 172.21.15.106:0/826711448 shutdown_connections 2024-04-26T21:17:04.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a9a00640 1 --2- 172.21.15.106:0/826711448 >> v2:172.21.15.112:3300/0 conn(0x7fa9a40b2900 0x7fa9a4161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a9a00640 1 --2- 172.21.15.106:0/826711448 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b23c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a9a00640 1 -- 172.21.15.106:0/826711448 >> 172.21.15.106:0/826711448 conn(0x7fa9a40d2a60 msgr2=0x7fa9a40d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:04.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a9a00640 1 -- 172.21.15.106:0/826711448 shutdown_connections 2024-04-26T21:17:04.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.395+0000 7fa9a9a00640 1 -- 172.21.15.106:0/826711448 wait complete. 2024-04-26T21:17:04.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 Processor -- start 2024-04-26T21:17:04.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 -- start start 2024-04-26T21:17:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a40b2900 0x7fa9a40c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a40b3aa0 0x7fa9a415de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a40b2e90 con 0x7fa9a40b2900 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a40b2d10 con 0x7fa9a40b3aa0 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a416bca0 con 0x7fa9a406df20 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a40b2900 0x7fa9a40c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a40b2900 0x7fa9a40c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59052/0 (socket says 172.21.15.106:59052) 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3400640 1 -- 172.21.15.106:0/3209909365 learned_addr learned my addr 172.21.15.106:0/3209909365 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3e00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9000640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a40b3aa0 0x7fa9a415de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3400640 1 -- 172.21.15.106:0/3209909365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 msgr2=0x7fa9a40b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3400640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3400640 1 -- 172.21.15.106:0/3209909365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a40b3aa0 msgr2=0x7fa9a415de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3400640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a40b3aa0 0x7fa9a415de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3400640 1 -- 172.21.15.106:0/3209909365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a415a4e0 con 0x7fa9a40b2900 2024-04-26T21:17:04.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3e00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:04.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a3400640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a40b2900 0x7fa9a40c9ff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa9900ae040 tx=0x7fa99001ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:04.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa99be00640 1 -- 172.21.15.106:0/3209909365 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9900b0050 con 0x7fa9a40b2900 2024-04-26T21:17:04.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa99be00640 1 -- 172.21.15.106:0/3209909365 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9900bc070 con 0x7fa9a40b2900 2024-04-26T21:17:04.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a40af970 con 0x7fa9a40b2900 2024-04-26T21:17:04.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa99be00640 1 -- 172.21.15.106:0/3209909365 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9900b5870 con 0x7fa9a40b2900 2024-04-26T21:17:04.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a40aff30 con 0x7fa9a40b2900 2024-04-26T21:17:04.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.399+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a40506d0 con 0x7fa9a40b2900 2024-04-26T21:17:04.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.403+0000 7fa99be00640 1 -- 172.21.15.106:0/3209909365 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa9900b5a10 con 0x7fa9a40b2900 2024-04-26T21:17:04.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.403+0000 7fa99be00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa984068380 0x7fa98406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.403+0000 7fa99be00640 1 -- 172.21.15.106:0/3209909365 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fa990121420 con 0x7fa9a40b2900 2024-04-26T21:17:04.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.403+0000 7fa9a3e00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa984068380 0x7fa98406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.403+0000 7fa9a3e00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa984068380 0x7fa98406a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa994000f70 tx=0x7fa994009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:04.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.407+0000 7fa99be00640 1 -- 172.21.15.106:0/3209909365 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa990016090 con 0x7fa9a40b2900 2024-04-26T21:17:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.567+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa9a40b2650 con 0x7fa9a40b2900 2024-04-26T21:17:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.567+0000 7fa99be00640 1 -- 172.21.15.106:0/3209909365 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fa9900f15d0 con 0x7fa9a40b2900 2024-04-26T21:17:04.573 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa984068380 msgr2=0x7fa98406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa984068380 0x7fa98406a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa994000f70 tx=0x7fa994009040 comp rx=0 tx=0).stop 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a40b2900 msgr2=0x7fa9a40c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a40b2900 0x7fa9a40c9ff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa9900ae040 tx=0x7fa99001ab90 comp rx=0 tx=0).stop 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 shutdown_connections 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9a40b3aa0 0x7fa9a415de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa984068380 0x7fa98406a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a40b2900 0x7fa9a40c9ff0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 --2- 172.21.15.106:0/3209909365 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa9a406df20 0x7fa9a40b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 >> 172.21.15.106:0/3209909365 conn(0x7fa9a40d2a60 msgr2=0x7fa9a40717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:04.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 shutdown_connections 2024-04-26T21:17:04.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.571+0000 7fa9a9a00640 1 -- 172.21.15.106:0/3209909365 wait complete. 2024-04-26T21:17:04.593 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:04.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.727+0000 7ff4aac00640 1 Processor -- start 2024-04-26T21:17:04.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.727+0000 7ff4aac00640 1 -- start start 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff4aac00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff4a415d080 0x7ff4a40b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff4aac00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415da80 0x7ff4a415df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff4aac00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a40b4f00 con 0x7ff4a415c4e0 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff4aac00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a415d5f0 con 0x7ff4a415d080 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff4aac00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a40b51e0 con 0x7ff4a415da80 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff49b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff4a415d080 0x7ff4a40b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff49b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff4a415d080 0x7ff4a40b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59060/0 (socket says 172.21.15.106:59060) 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff49b400640 1 -- 172.21.15.106:0/3520851262 learned_addr learned my addr 172.21.15.106:0/3520851262 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff4a8c00640 1 --2- 172.21.15.106:0/3520851262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415da80 0x7ff4a415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff49b400640 1 -- 172.21.15.106:0/3520851262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415da80 msgr2=0x7ff4a415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff49b400640 1 --2- 172.21.15.106:0/3520851262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415da80 0x7ff4a415df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff49b400640 1 -- 172.21.15.106:0/3520851262 >> v1:172.21.15.112:6789/0 conn(0x7ff4a415c4e0 legacy=0x7ff4a415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.731+0000 7ff49b400640 1 -- 172.21.15.106:0/3520851262 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a40b54c0 con 0x7ff4a415d080 2024-04-26T21:17:04.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff49b400640 1 --2- 172.21.15.106:0/3520851262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415d080 0x7ff4a40b4620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009870 tx=0x7ff48c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4211c36e328a7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4a3400640 1 -- 172.21.15.106:0/3520851262 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0aa650 con 0x7ff4a415d080 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4a3400640 1 -- 172.21.15.106:0/3520851262 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48c0af070 con 0x7ff4a415d080 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4a3400640 1 -- 172.21.15.106:0/3520851262 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0aaa10 con 0x7ff4a415d080 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 -- 172.21.15.106:0/3520851262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415d080 msgr2=0x7ff4a40b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 --2- 172.21.15.106:0/3520851262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415d080 0x7ff4a40b4620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009870 tx=0x7ff48c01c530 comp rx=0 tx=0).stop 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 -- 172.21.15.106:0/3520851262 shutdown_connections 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 --2- 172.21.15.106:0/3520851262 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415da80 0x7ff4a415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 --2- 172.21.15.106:0/3520851262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415d080 0x7ff4a40b4620 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 -- 172.21.15.106:0/3520851262 >> 172.21.15.106:0/3520851262 conn(0x7ff4a40b2910 msgr2=0x7ff4a40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 -- 172.21.15.106:0/3520851262 shutdown_connections 2024-04-26T21:17:04.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 -- 172.21.15.106:0/3520851262 wait complete. 2024-04-26T21:17:04.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 Processor -- start 2024-04-26T21:17:04.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 -- start start 2024-04-26T21:17:04.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.735+0000 7ff4aac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4a415c4e0 0x7ff4a415b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4aac00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415d080 0x7ff4a41440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4aac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415da80 0x7ff4a40c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4aac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a4168f40 con 0x7ff4a415da80 2024-04-26T21:17:04.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4aac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a4168dc0 con 0x7ff4a415c4e0 2024-04-26T21:17:04.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4aac00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a41690c0 con 0x7ff4a415d080 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415da80 0x7ff4a40c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff49b400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415d080 0x7ff4a41440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415da80 0x7ff4a40c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59062/0 (socket says 172.21.15.106:59062) 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a8c00640 1 -- 172.21.15.106:0/4155514216 learned_addr learned my addr 172.21.15.106:0/4155514216 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a3e00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4a415c4e0 0x7ff4a415b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a8c00640 1 -- 172.21.15.106:0/4155514216 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415d080 msgr2=0x7ff4a41440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a8c00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415d080 0x7ff4a41440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a8c00640 1 -- 172.21.15.106:0/4155514216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4a415c4e0 msgr2=0x7ff4a415b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a8c00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4a415c4e0 0x7ff4a415b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a8c00640 1 -- 172.21.15.106:0/4155514216 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a4072500 con 0x7ff4a415da80 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a8c00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415da80 0x7ff4a40c9f90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff49c007e90 tx=0x7ff49c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a0c00640 1 -- 172.21.15.106:0/4155514216 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c014420 con 0x7ff4a415da80 2024-04-26T21:17:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a0c00640 1 -- 172.21.15.106:0/4155514216 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49c019070 con 0x7ff4a415da80 2024-04-26T21:17:04.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a40727e0 con 0x7ff4a415da80 2024-04-26T21:17:04.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a0c00640 1 -- 172.21.15.106:0/4155514216 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c014800 con 0x7ff4a415da80 2024-04-26T21:17:04.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a4072da0 con 0x7ff4a415da80 2024-04-26T21:17:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a4069400 con 0x7ff4a415da80 2024-04-26T21:17:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.739+0000 7ff4a0c00640 1 -- 172.21.15.106:0/4155514216 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff49c0149a0 con 0x7ff4a415da80 2024-04-26T21:17:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.743+0000 7ff4a0c00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff480068380 0x7ff48006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.743+0000 7ff4a0c00640 1 -- 172.21.15.106:0/4155514216 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7ff49c087470 con 0x7ff4a415da80 2024-04-26T21:17:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.743+0000 7ff4a3e00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff480068380 0x7ff48006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.743+0000 7ff4a3e00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff480068380 0x7ff48006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff494001810 tx=0x7ff494009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.747+0000 7ff4a0c00640 1 -- 172.21.15.106:0/4155514216 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff49c056fe0 con 0x7ff4a415da80 2024-04-26T21:17:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff4a406fb90 con 0x7ff4a415da80 2024-04-26T21:17:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4a0c00640 1 -- 172.21.15.106:0/4155514216 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7ff49c05b2e0 con 0x7ff4a415da80 2024-04-26T21:17:04.906 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff480068380 msgr2=0x7ff48006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff480068380 0x7ff48006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff494001810 tx=0x7ff494009040 comp rx=0 tx=0).stop 2024-04-26T21:17:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415da80 msgr2=0x7ff4a40c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415da80 0x7ff4a40c9f90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff49c007e90 tx=0x7ff49c00e4b0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 shutdown_connections 2024-04-26T21:17:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff480068380 0x7ff48006a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4a415da80 0x7ff4a40c9f90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff4a415d080 0x7ff4a41440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 --2- 172.21.15.106:0/4155514216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4a415c4e0 0x7ff4a415b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 >> 172.21.15.106:0/4155514216 conn(0x7ff4a40b2910 msgr2=0x7ff4a415c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.903+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 shutdown_connections 2024-04-26T21:17:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:04.907+0000 7ff4aac00640 1 -- 172.21.15.106:0/4155514216 wait complete. 2024-04-26T21:17:04.927 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f775ac00640 1 Processor -- start 2024-04-26T21:17:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f775ac00640 1 -- start start 2024-04-26T21:17:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f775ac00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f775415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f775ac00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f77540d0580 0x7f77540b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f775ac00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7754159600 con 0x7f775406e880 2024-04-26T21:17:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f775ac00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f77540b3d40 con 0x7f77540d0580 2024-04-26T21:17:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f775ac00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f77540b4020 con 0x7f7754159220 2024-04-26T21:17:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f7753e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f775415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f7753e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f775415bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:51118/0 (socket says 172.21.15.106:51118) 2024-04-26T21:17:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f7753e00640 1 -- 172.21.15.106:0/918641729 learned_addr learned my addr 172.21.15.106:0/918641729 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f774b400640 1 --2- 172.21.15.106:0/918641729 >> v2:172.21.15.112:3300/0 conn(0x7f77540d0580 0x7f77540b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f7753e00640 1 -- 172.21.15.106:0/918641729 >> v2:172.21.15.112:3300/0 conn(0x7f77540d0580 msgr2=0x7f77540b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f7753e00640 1 --2- 172.21.15.106:0/918641729 >> v2:172.21.15.112:3300/0 conn(0x7f77540d0580 0x7f77540b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f7753e00640 1 -- 172.21.15.106:0/918641729 >> v1:172.21.15.112:6789/0 conn(0x7f775406e880 legacy=0x7f775415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f7753e00640 1 -- 172.21.15.106:0/918641729 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77540b4300 con 0x7f7754159220 2024-04-26T21:17:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.063+0000 7f7753400640 1 -- 172.21.15.106:0/918641729 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400346406 0 0) 0x7f7754159600 con 0x7f775406e880 2024-04-26T21:17:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f7753e00640 1 --2- 172.21.15.106:0/918641729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f775415bb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7744009870 tx=0x7f775415dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d89b411b8f35531f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f7753400640 1 -- 172.21.15.106:0/918641729 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77440b0070 con 0x7f7754159220 2024-04-26T21:17:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f7753400640 1 -- 172.21.15.106:0/918641729 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77440ab600 con 0x7f7754159220 2024-04-26T21:17:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f7753400640 1 -- 172.21.15.106:0/918641729 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77440ab9d0 con 0x7f7754159220 2024-04-26T21:17:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f775ac00640 1 -- 172.21.15.106:0/918641729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 msgr2=0x7f775415bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f775ac00640 1 --2- 172.21.15.106:0/918641729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f775415bb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7744009870 tx=0x7f775415dc90 comp rx=0 tx=0).stop 2024-04-26T21:17:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f775ac00640 1 -- 172.21.15.106:0/918641729 shutdown_connections 2024-04-26T21:17:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f775ac00640 1 --2- 172.21.15.106:0/918641729 >> v2:172.21.15.112:3300/0 conn(0x7f77540d0580 0x7f77540b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f775ac00640 1 --2- 172.21.15.106:0/918641729 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f775415bb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f775ac00640 1 -- 172.21.15.106:0/918641729 >> 172.21.15.106:0/918641729 conn(0x7f77540b2910 msgr2=0x7f77540b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f775ac00640 1 -- 172.21.15.106:0/918641729 shutdown_connections 2024-04-26T21:17:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.067+0000 7f775ac00640 1 -- 172.21.15.106:0/918641729 wait complete. 2024-04-26T21:17:05.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 Processor -- start 2024-04-26T21:17:05.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 -- start start 2024-04-26T21:17:05.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f775406e880 0x7f7754152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77540d0580 0x7f77540cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f77540cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f775406e170 con 0x7f775406e880 2024-04-26T21:17:05.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f775406dff0 con 0x7f77540d0580 2024-04-26T21:17:05.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f775406e2f0 con 0x7f7754159220 2024-04-26T21:17:05.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7753e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f775406e880 0x7f7754152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7753e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f775406e880 0x7f7754152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59070/0 (socket says 172.21.15.106:59070) 2024-04-26T21:17:05.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7753e00640 1 -- 172.21.15.106:0/3009693950 learned_addr learned my addr 172.21.15.106:0/3009693950 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:05.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f774b400640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77540d0580 0x7f77540cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7758c00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f77540cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7753e00640 1 -- 172.21.15.106:0/3009693950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 msgr2=0x7f77540cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7753e00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f77540cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7753e00640 1 -- 172.21.15.106:0/3009693950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77540d0580 msgr2=0x7f77540cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7753e00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77540d0580 0x7f77540cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7753e00640 1 -- 172.21.15.106:0/3009693950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775414b940 con 0x7f775406e880 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f774b400640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77540d0580 0x7f77540cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7753e00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f775406e880 0x7f7754152810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f774401a100 tx=0x7f774401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7750c00640 1 -- 172.21.15.106:0/3009693950 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77440ba020 con 0x7f775406e880 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7750c00640 1 -- 172.21.15.106:0/3009693950 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77440b6420 con 0x7f775406e880 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7754152d50 con 0x7f775406e880 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f7750c00640 1 -- 172.21.15.106:0/3009693950 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77440b0040 con 0x7f775406e880 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775414ab80 con 0x7f775406e880 2024-04-26T21:17:05.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.071+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7754069400 con 0x7f775406e880 2024-04-26T21:17:05.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.075+0000 7f7750c00640 1 -- 172.21.15.106:0/3009693950 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f77440bd020 con 0x7f775406e880 2024-04-26T21:17:05.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.075+0000 7f7750c00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7730068380 0x7f773006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.075+0000 7f7750c00640 1 -- 172.21.15.106:0/3009693950 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f7744120eb0 con 0x7f775406e880 2024-04-26T21:17:05.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.075+0000 7f774b400640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7730068380 0x7f773006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.075+0000 7f774b400640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7730068380 0x7f773006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7754151000 tx=0x7f773c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:05.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.079+0000 7f7750c00640 1 -- 172.21.15.106:0/3009693950 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f77440c4030 con 0x7f775406e880 2024-04-26T21:17:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.235+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f77540d0360 con 0x7f775406e880 2024-04-26T21:17:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.235+0000 7f7750c00640 1 -- 172.21.15.106:0/3009693950 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f7744016150 con 0x7f775406e880 2024-04-26T21:17:05.239 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.235+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7730068380 msgr2=0x7f773006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.235+0000 7f775ac00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7730068380 0x7f773006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7754151000 tx=0x7f773c008040 comp rx=0 tx=0).stop 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.235+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f775406e880 msgr2=0x7f7754152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.235+0000 7f775ac00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f775406e880 0x7f7754152810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f774401a100 tx=0x7f774401ad10 comp rx=0 tx=0).stop 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.235+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 shutdown_connections 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.235+0000 7f775ac00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77540d0580 0x7f77540cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.235+0000 7f775ac00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7730068380 0x7f773006a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.239+0000 7f775ac00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7754159220 0x7f77540cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.239+0000 7f775ac00640 1 --2- 172.21.15.106:0/3009693950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f775406e880 0x7f7754152810 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.239+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 >> 172.21.15.106:0/3009693950 conn(0x7f77540b2910 msgr2=0x7f7754072700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.239+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 shutdown_connections 2024-04-26T21:17:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.239+0000 7f775ac00640 1 -- 172.21.15.106:0/3009693950 wait complete. 2024-04-26T21:17:05.260 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e65600640 1 Processor -- start 2024-04-26T21:17:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e65600640 1 -- start start 2024-04-26T21:17:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e65600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8e6013ed60 0x7f8e6015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e65600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f140 0x7f8e600b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e65600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e600b3d10 con 0x7f8e6006eb70 2024-04-26T21:17:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e65600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f8e600b3ac0 con 0x7f8e6013ed60 2024-04-26T21:17:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e65600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8e600b4920 con 0x7f8e6013f140 2024-04-26T21:17:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e5ea00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8e6013ed60 0x7f8e6015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e5ea00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8e6013ed60 0x7f8e6015c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59080/0 (socket says 172.21.15.106:59080) 2024-04-26T21:17:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e5ea00640 1 -- 172.21.15.106:0/2048442475 learned_addr learned my addr 172.21.15.106:0/2048442475 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e5e000640 1 --2- 172.21.15.106:0/2048442475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f140 0x7f8e600b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e5ea00640 1 -- 172.21.15.106:0/2048442475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f140 msgr2=0x7f8e600b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e5ea00640 1 --2- 172.21.15.106:0/2048442475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f140 0x7f8e600b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e5ea00640 1 -- 172.21.15.106:0/2048442475 >> v1:172.21.15.112:6789/0 conn(0x7f8e6006eb70 legacy=0x7f8e600d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.395+0000 7f8e5ea00640 1 -- 172.21.15.106:0/2048442475 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e600b3ff0 con 0x7f8e6013ed60 2024-04-26T21:17:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e5ea00640 1 --2- 172.21.15.106:0/2048442475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 0x7f8e6015c3e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009870 tx=0x7f8e5001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121a24709c346e3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e5d600640 1 -- 172.21.15.106:0/2048442475 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500ab640 con 0x7f8e6013ed60 2024-04-26T21:17:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e5d600640 1 -- 172.21.15.106:0/2048442475 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e500b0070 con 0x7f8e6013ed60 2024-04-26T21:17:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e5d600640 1 -- 172.21.15.106:0/2048442475 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500aba00 con 0x7f8e6013ed60 2024-04-26T21:17:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e65600640 1 -- 172.21.15.106:0/2048442475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 msgr2=0x7f8e6015c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e65600640 1 --2- 172.21.15.106:0/2048442475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 0x7f8e6015c3e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009870 tx=0x7f8e5001c440 comp rx=0 tx=0).stop 2024-04-26T21:17:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e65600640 1 -- 172.21.15.106:0/2048442475 shutdown_connections 2024-04-26T21:17:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e65600640 1 --2- 172.21.15.106:0/2048442475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f140 0x7f8e600b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e65600640 1 --2- 172.21.15.106:0/2048442475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 0x7f8e6015c3e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e65600640 1 -- 172.21.15.106:0/2048442475 >> 172.21.15.106:0/2048442475 conn(0x7f8e60068340 msgr2=0x7f8e60068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e65600640 1 -- 172.21.15.106:0/2048442475 shutdown_connections 2024-04-26T21:17:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.399+0000 7f8e65600640 1 -- 172.21.15.106:0/2048442475 wait complete. 2024-04-26T21:17:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 Processor -- start 2024-04-26T21:17:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 -- start start 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 0x7f8e601433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6013d800 0x7f8e60145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f530 0x7f8e60164f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8e600d1680 con 0x7f8e6013ed60 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8e600d1500 con 0x7f8e6013d800 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8e60160420 con 0x7f8e6013f530 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 0x7f8e601433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 0x7f8e601433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59092/0 (socket says 172.21.15.106:59092) 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5ea00640 1 -- 172.21.15.106:0/1593200491 learned_addr learned my addr 172.21.15.106:0/1593200491 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5f400640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f530 0x7f8e60164f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5e000640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6013d800 0x7f8e60145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5ea00640 1 -- 172.21.15.106:0/1593200491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f530 msgr2=0x7f8e60164f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5ea00640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f530 0x7f8e60164f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5ea00640 1 -- 172.21.15.106:0/1593200491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6013d800 msgr2=0x7f8e60145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5ea00640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6013d800 0x7f8e60145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5ea00640 1 -- 172.21.15.106:0/1593200491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e60143a40 con 0x7f8e6013ed60 2024-04-26T21:17:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e5ea00640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 0x7f8e601433d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e5001a070 tx=0x7f8e5001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e56a00640 1 -- 172.21.15.106:0/1593200491 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500be3f0 con 0x7f8e6013ed60 2024-04-26T21:17:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e56a00640 1 -- 172.21.15.106:0/1593200491 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e500be5b0 con 0x7f8e6013ed60 2024-04-26T21:17:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e600ce1e0 con 0x7f8e6013ed60 2024-04-26T21:17:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e56a00640 1 -- 172.21.15.106:0/1593200491 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500be9a0 con 0x7f8e6013ed60 2024-04-26T21:17:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.403+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e600ce7a0 con 0x7f8e6013ed60 2024-04-26T21:17:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.407+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e60069400 con 0x7f8e6013ed60 2024-04-26T21:17:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.407+0000 7f8e56a00640 1 -- 172.21.15.106:0/1593200491 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e500c7430 con 0x7f8e6013ed60 2024-04-26T21:17:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.407+0000 7f8e56a00640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8e400683b0 0x7f8e4006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.407+0000 7f8e56a00640 1 -- 172.21.15.106:0/1593200491 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f8e50121590 con 0x7f8e6013ed60 2024-04-26T21:17:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.407+0000 7f8e5e000640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8e400683b0 0x7f8e4006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.407+0000 7f8e5e000640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8e400683b0 0x7f8e4006a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8e60165bd0 tx=0x7f8e4c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.411+0000 7f8e56a00640 1 -- 172.21.15.106:0/1593200491 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8e50016150 con 0x7f8e6013ed60 2024-04-26T21:17:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.567+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e600cd340 con 0x7f8e6013ed60 2024-04-26T21:17:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e56a00640 1 -- 172.21.15.106:0/1593200491 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7f8e500f1860 con 0x7f8e6013ed60 2024-04-26T21:17:05.573 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:05.573 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8e400683b0 msgr2=0x7f8e4006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8e400683b0 0x7f8e4006a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8e60165bd0 tx=0x7f8e4c008040 comp rx=0 tx=0).stop 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 msgr2=0x7f8e601433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 0x7f8e601433d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e5001a070 tx=0x7f8e5001ac80 comp rx=0 tx=0).stop 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 shutdown_connections 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6013d800 0x7f8e60145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8e400683b0 0x7f8e4006a870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8e6013f530 0x7f8e60164f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 --2- 172.21.15.106:0/1593200491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e6013ed60 0x7f8e601433d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 >> 172.21.15.106:0/1593200491 conn(0x7f8e60068340 msgr2=0x7f8e6015eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 shutdown_connections 2024-04-26T21:17:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.571+0000 7f8e65600640 1 -- 172.21.15.106:0/1593200491 wait complete. 2024-04-26T21:17:05.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:05.595 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:05.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9904000640 1 Processor -- start 2024-04-26T21:17:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9904000640 1 -- start start 2024-04-26T21:17:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9904000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc15d530 0x7f98fc0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9904000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc0b44a0 con 0x7f98fc15e020 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9904000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc0b4780 con 0x7f98fc0b5260 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9904000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc0b4a60 con 0x7f98fc15d530 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9902000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f98fc15e020 0x7f98fc166ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49310/0 (socket says 172.21.15.106:49310) 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9902000640 1 -- 172.21.15.106:0/2278152242 learned_addr learned my addr 172.21.15.106:0/2278152242 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9901600640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc15d530 0x7f98fc0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304363140 0 0) 0x7f98fc0b44a0 con 0x7f98fc15e020 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98e4003530 con 0x7f98fc15e020 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382876796 0 0) 0x7f98fc0b4780 con 0x7f98fc0b5260 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98fc0b44a0 con 0x7f98fc0b5260 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3873411711 0 0) 0x7f98e4003530 con 0x7f98fc15e020 2024-04-26T21:17:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc15d530 msgr2=0x7f98fc0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc15d530 0x7f98fc0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 >> v1:172.21.15.112:6789/0 conn(0x7f98fc0b5260 legacy=0x7f98fc15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc0b4d40 con 0x7f98fc15e020 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f98f4001a00 con 0x7f98fc15e020 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 >> v1:172.21.15.106:6789/0 conn(0x7f98fc15e020 legacy=0x7f98fc166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc15d530 0x7f98e4003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e40040e0 0x7f98e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e4004d50 0x7f98e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0b4a60 con 0x7f98e4004d50 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98e400bab0 con 0x7f98e40040e0 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f98e400bcb0 con 0x7f98fc15d530 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9902000640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e4004d50 0x7f98e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9901600640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc15d530 0x7f98e4003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9900c00640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e40040e0 0x7f98e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9902000640 1 -- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc15d530 msgr2=0x7f98e4003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9902000640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc15d530 0x7f98e4003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9902000640 1 -- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e40040e0 msgr2=0x7f98e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9902000640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e40040e0 0x7f98e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.731+0000 7f9902000640 1 -- 172.21.15.106:0/2278152242 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e4003530 con 0x7f98e4004d50 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f9902000640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e4004d50 0x7f98e40051d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f98f400a800 tx=0x7f98f401fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1fddb92daf276c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f400a450 con 0x7f98e4004d50 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f40aa670 con 0x7f98e4004d50 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f98fbe00640 1 -- 172.21.15.106:0/2278152242 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40aaae0 con 0x7f98e4004d50 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f9904000640 1 -- 172.21.15.106:0/2278152242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e4004d50 msgr2=0x7f98e40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f9904000640 1 --2- 172.21.15.106:0/2278152242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98e4004d50 0x7f98e40051d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f98f400a800 tx=0x7f98f401fa40 comp rx=0 tx=0).stop 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f9902000640 1 -- 172.21.15.106:0/2278152242 reap_dead start 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f9904000640 1 -- 172.21.15.106:0/2278152242 shutdown_connections 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f9904000640 1 -- 172.21.15.106:0/2278152242 >> 172.21.15.106:0/2278152242 conn(0x7f98fc0b2910 msgr2=0x7f98fc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f9904000640 1 -- 172.21.15.106:0/2278152242 shutdown_connections 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.735+0000 7f9904000640 1 -- 172.21.15.106:0/2278152242 wait complete. 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 Processor -- start 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 -- start start 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e4004d50 0x7f98fc13da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc144c80 0x7f98fc145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98fc15be20 0x7f98fc15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0cfe20 con 0x7f98fc15be20 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0b3680 con 0x7f98e4004d50 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc0cffa0 con 0x7f98fc144c80 2024-04-26T21:17:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9902000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98fc15be20 0x7f98fc15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9902000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98fc15be20 0x7f98fc15c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59108/0 (socket says 172.21.15.106:59108) 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9902000640 1 -- 172.21.15.106:0/2774796648 learned_addr learned my addr 172.21.15.106:0/2774796648 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9900c00640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc144c80 0x7f98fc145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9901600640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e4004d50 0x7f98fc13da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9902000640 1 -- 172.21.15.106:0/2774796648 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc144c80 msgr2=0x7f98fc145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9902000640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc144c80 0x7f98fc145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9902000640 1 -- 172.21.15.106:0/2774796648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e4004d50 msgr2=0x7f98fc13da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9902000640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e4004d50 0x7f98fc13da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9902000640 1 -- 172.21.15.106:0/2774796648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc13bc70 con 0x7f98fc15be20 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9901600640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e4004d50 0x7f98fc13da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9902000640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98fc15be20 0x7f98fc15c2d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f98f400a800 tx=0x7f98f401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f98f9600640 1 -- 172.21.15.106:0/2774796648 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40011d0 con 0x7f98fc15be20 2024-04-26T21:17:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f98f9600640 1 -- 172.21.15.106:0/2774796648 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f40aa820 con 0x7f98fc15be20 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc13bf50 con 0x7f98fc15be20 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f98f9600640 1 -- 172.21.15.106:0/2774796648 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4001f80 con 0x7f98fc15be20 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.739+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98fc13c510 con 0x7f98fc15be20 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.743+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98fc069400 con 0x7f98fc15be20 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.743+0000 7f98f9600640 1 -- 172.21.15.106:0/2774796648 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98f40ba020 con 0x7f98fc15be20 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.743+0000 7f98f9600640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98dc068380 0x7f98dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.743+0000 7f98f9600640 1 -- 172.21.15.106:0/2774796648 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f98f41245c0 con 0x7f98fc15be20 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.743+0000 7f9901600640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98dc068380 0x7f98dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.743+0000 7f9901600640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98dc068380 0x7f98dc06a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009ad0 tx=0x7f98f0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.747+0000 7f98f9600640 1 -- 172.21.15.106:0/2774796648 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f98f40af020 con 0x7f98fc15be20 2024-04-26T21:17:05.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.903+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98fc0cfbd0 con 0x7f98fc15be20 2024-04-26T21:17:05.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.903+0000 7f98f9600640 1 -- 172.21.15.106:0/2774796648 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f98f4019750 con 0x7f98fc15be20 2024-04-26T21:17:05.907 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98dc068380 msgr2=0x7f98dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98dc068380 0x7f98dc06a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009ad0 tx=0x7f98f0008040 comp rx=0 tx=0).stop 2024-04-26T21:17:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98fc15be20 msgr2=0x7f98fc15c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98fc15be20 0x7f98fc15c2d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f98f400a800 tx=0x7f98f401c7e0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 shutdown_connections 2024-04-26T21:17:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98dc068380 0x7f98dc06a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98fc15be20 0x7f98fc15c2d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98fc144c80 0x7f98fc145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 --2- 172.21.15.106:0/2774796648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98e4004d50 0x7f98fc13da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 >> 172.21.15.106:0/2774796648 conn(0x7f98fc0b2910 msgr2=0x7f98fc0b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 shutdown_connections 2024-04-26T21:17:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:05.907+0000 7f9904000640 1 -- 172.21.15.106:0/2774796648 wait complete. 2024-04-26T21:17:05.928 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91c0600640 1 Processor -- start 2024-04-26T21:17:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91c0600640 1 -- start start 2024-04-26T21:17:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91c0600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815c4e0 0x7f91b815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91c0600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f91b815d080 0x7f91b80b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91c0600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b815ce00 con 0x7f91b815fa20 2024-04-26T21:17:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91c0600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f91b815d5f0 con 0x7f91b815d080 2024-04-26T21:17:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91c0600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f91b80b4f00 con 0x7f91b815c4e0 2024-04-26T21:17:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91bd200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f91b815d080 0x7f91b80b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91bd200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f91b815d080 0x7f91b80b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59124/0 (socket says 172.21.15.106:59124) 2024-04-26T21:17:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91bd200640 1 -- 172.21.15.106:0/309252074 learned_addr learned my addr 172.21.15.106:0/309252074 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91bdc00640 1 --2- 172.21.15.106:0/309252074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815c4e0 0x7f91b815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91bd200640 1 -- 172.21.15.106:0/309252074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815c4e0 msgr2=0x7f91b815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91bd200640 1 --2- 172.21.15.106:0/309252074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815c4e0 0x7f91b815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91bd200640 1 -- 172.21.15.106:0/309252074 >> v1:172.21.15.112:6789/0 conn(0x7f91b815fa20 legacy=0x7f91b815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.063+0000 7f91bd200640 1 -- 172.21.15.106:0/309252074 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b80b51e0 con 0x7f91b815d080 2024-04-26T21:17:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91bd200640 1 --2- 172.21.15.106:0/309252074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 0x7f91b80b4620 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f91a400bb10 tx=0x7f91a401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628e6679db9b78f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91b7e00640 1 -- 172.21.15.106:0/309252074 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40b4070 con 0x7f91b815d080 2024-04-26T21:17:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91b7e00640 1 -- 172.21.15.106:0/309252074 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a40a7bd0 con 0x7f91b815d080 2024-04-26T21:17:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91b7e00640 1 -- 172.21.15.106:0/309252074 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40af440 con 0x7f91b815d080 2024-04-26T21:17:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91c0600640 1 -- 172.21.15.106:0/309252074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 msgr2=0x7f91b80b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91c0600640 1 --2- 172.21.15.106:0/309252074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 0x7f91b80b4620 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f91a400bb10 tx=0x7f91a401ec00 comp rx=0 tx=0).stop 2024-04-26T21:17:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91c0600640 1 -- 172.21.15.106:0/309252074 shutdown_connections 2024-04-26T21:17:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91c0600640 1 --2- 172.21.15.106:0/309252074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 0x7f91b80b4620 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91c0600640 1 --2- 172.21.15.106:0/309252074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815c4e0 0x7f91b815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91c0600640 1 -- 172.21.15.106:0/309252074 >> 172.21.15.106:0/309252074 conn(0x7f91b80b2910 msgr2=0x7f91b80b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91c0600640 1 -- 172.21.15.106:0/309252074 shutdown_connections 2024-04-26T21:17:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.067+0000 7f91c0600640 1 -- 172.21.15.106:0/309252074 wait complete. 2024-04-26T21:17:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 Processor -- start 2024-04-26T21:17:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 -- start start 2024-04-26T21:17:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b815c4e0 0x7f91b8135d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 0x7f91b81f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815fa20 0x7f91b81f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f91b80b4ce0 con 0x7f91b815d080 2024-04-26T21:17:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f91b80b4b60 con 0x7f91b815c4e0 2024-04-26T21:17:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f91b806f090 con 0x7f91b815fa20 2024-04-26T21:17:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bd200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 0x7f91b81f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bd200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 0x7f91b81f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59130/0 (socket says 172.21.15.106:59130) 2024-04-26T21:17:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bd200640 1 -- 172.21.15.106:0/2654774376 learned_addr learned my addr 172.21.15.106:0/2654774376 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bdc00640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b815c4e0 0x7f91b8135d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91be600640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815fa20 0x7f91b81f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bd200640 1 -- 172.21.15.106:0/2654774376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815fa20 msgr2=0x7f91b81f80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bd200640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815fa20 0x7f91b81f80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bd200640 1 -- 172.21.15.106:0/2654774376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b815c4e0 msgr2=0x7f91b8135d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bd200640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b815c4e0 0x7f91b8135d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bd200640 1 -- 172.21.15.106:0/2654774376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b80ceeb0 con 0x7f91b815d080 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91bd200640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 0x7f91b81f7b70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f91a400b2c0 tx=0x7f91a401b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91b5600640 1 -- 172.21.15.106:0/2654774376 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40b4030 con 0x7f91b815d080 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91b5600640 1 -- 172.21.15.106:0/2654774376 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a40b6070 con 0x7f91b815d080 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b80cebd0 con 0x7f91b815d080 2024-04-26T21:17:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91b5600640 1 -- 172.21.15.106:0/2654774376 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40ad550 con 0x7f91b815d080 2024-04-26T21:17:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.071+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b80d12b0 con 0x7f91b815d080 2024-04-26T21:17:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.075+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b8069400 con 0x7f91b815d080 2024-04-26T21:17:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.075+0000 7f91b5600640 1 -- 172.21.15.106:0/2654774376 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91a40c1060 con 0x7f91b815d080 2024-04-26T21:17:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.075+0000 7f91b5600640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f91980683b0 0x7f919806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.075+0000 7f91b5600640 1 -- 172.21.15.106:0/2654774376 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f91a4121280 con 0x7f91b815d080 2024-04-26T21:17:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.075+0000 7f91bdc00640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f91980683b0 0x7f919806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.075+0000 7f91bdc00640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f91980683b0 0x7f919806a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0074a0 tx=0x7f91ac00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.079+0000 7f91b5600640 1 -- 172.21.15.106:0/2654774376 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f91a4018820 con 0x7f91b815d080 2024-04-26T21:17:06.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.235+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f91b806e2a0 con 0x7f91b815d080 2024-04-26T21:17:06.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91b5600640 1 -- 172.21.15.106:0/2654774376 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f91a40c02c0 con 0x7f91b815d080 2024-04-26T21:17:06.241 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f91980683b0 msgr2=0x7f919806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f91980683b0 0x7f919806a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0074a0 tx=0x7f91ac00b040 comp rx=0 tx=0).stop 2024-04-26T21:17:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 msgr2=0x7f91b81f7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 0x7f91b81f7b70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f91a400b2c0 tx=0x7f91a401b9a0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 shutdown_connections 2024-04-26T21:17:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f91980683b0 0x7f919806a870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91b815fa20 0x7f91b81f80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91b815d080 0x7f91b81f7b70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 --2- 172.21.15.106:0/2654774376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b815c4e0 0x7f91b8135d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 >> 172.21.15.106:0/2654774376 conn(0x7f91b80b2910 msgr2=0x7f91b8071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 shutdown_connections 2024-04-26T21:17:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.239+0000 7f91c0600640 1 -- 172.21.15.106:0/2654774376 wait complete. 2024-04-26T21:17:06.263 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:06.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efec1c00640 1 Processor -- start 2024-04-26T21:17:06.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efec1c00640 1 -- start start 2024-04-26T21:17:06.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efec1c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15c4e0 0x7efebc15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efec1c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efebc15d080 0x7efebc0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efec1c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efebc15fa20 0x7efebc15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efec1c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7efebc15d5f0 con 0x7efebc15fa20 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efec1c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efebc15ce00 con 0x7efebc15d080 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efec1c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efebc0b4f00 con 0x7efebc15c4e0 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efebb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efebc15fa20 0x7efebc15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efebb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efebc15fa20 0x7efebc15feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59142/0 (socket says 172.21.15.106:59142) 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efebb400640 1 -- 172.21.15.106:0/1617718257 learned_addr learned my addr 172.21.15.106:0/1617718257 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efeba000640 1 --2- 172.21.15.106:0/1617718257 >> v2:172.21.15.112:3300/0 conn(0x7efebc15d080 0x7efebc0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efebaa00640 1 --2- 172.21.15.106:0/1617718257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15c4e0 0x7efebc15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efebb400640 1 -- 172.21.15.106:0/1617718257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15c4e0 msgr2=0x7efebc15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efebb400640 1 --2- 172.21.15.106:0/1617718257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15c4e0 0x7efebc15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efebb400640 1 -- 172.21.15.106:0/1617718257 >> v2:172.21.15.112:3300/0 conn(0x7efebc15d080 msgr2=0x7efebc0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:06.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efebb400640 1 --2- 172.21.15.106:0/1617718257 >> v2:172.21.15.112:3300/0 conn(0x7efebc15d080 0x7efebc0b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.399+0000 7efebb400640 1 -- 172.21.15.106:0/1617718257 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efebc0b51e0 con 0x7efebc15fa20 2024-04-26T21:17:06.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efebb400640 1 --2- 172.21.15.106:0/1617718257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15fa20 0x7efebc15feb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efebc0b39d0 tx=0x7efeb401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c381b111e1288a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:06.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efeb9600640 1 -- 172.21.15.106:0/1617718257 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb40a5840 con 0x7efebc15fa20 2024-04-26T21:17:06.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efeb9600640 1 -- 172.21.15.106:0/1617718257 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb40a59e0 con 0x7efebc15fa20 2024-04-26T21:17:06.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efeb9600640 1 -- 172.21.15.106:0/1617718257 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb40a5db0 con 0x7efebc15fa20 2024-04-26T21:17:06.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 -- 172.21.15.106:0/1617718257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15fa20 msgr2=0x7efebc15feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 --2- 172.21.15.106:0/1617718257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15fa20 0x7efebc15feb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efebc0b39d0 tx=0x7efeb401c9c0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 -- 172.21.15.106:0/1617718257 shutdown_connections 2024-04-26T21:17:06.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 --2- 172.21.15.106:0/1617718257 >> v2:172.21.15.112:3300/0 conn(0x7efebc15d080 0x7efebc0b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 --2- 172.21.15.106:0/1617718257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15fa20 0x7efebc15feb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 --2- 172.21.15.106:0/1617718257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15c4e0 0x7efebc15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 -- 172.21.15.106:0/1617718257 >> 172.21.15.106:0/1617718257 conn(0x7efebc0b2910 msgr2=0x7efebc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:06.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 -- 172.21.15.106:0/1617718257 shutdown_connections 2024-04-26T21:17:06.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 -- 172.21.15.106:0/1617718257 wait complete. 2024-04-26T21:17:06.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 Processor -- start 2024-04-26T21:17:06.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.403+0000 7efec1c00640 1 -- start start 2024-04-26T21:17:06.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efec1c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15c4e0 0x7efebc1664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efec1c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15d080 0x7efebc13b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efec1c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efebc15fa20 0x7efebc140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efec1c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efebc0b4b60 con 0x7efebc15c4e0 2024-04-26T21:17:06.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efec1c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efebc145ba0 con 0x7efebc15fa20 2024-04-26T21:17:06.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efec1c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efebc0b4ce0 con 0x7efebc15d080 2024-04-26T21:17:06.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebaa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15c4e0 0x7efebc1664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebaa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15c4e0 0x7efebc1664e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59150/0 (socket says 172.21.15.106:59150) 2024-04-26T21:17:06.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebaa00640 1 -- 172.21.15.106:0/1003288762 learned_addr learned my addr 172.21.15.106:0/1003288762 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efeba000640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15d080 0x7efebc13b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebb400640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efebc15fa20 0x7efebc140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebaa00640 1 -- 172.21.15.106:0/1003288762 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15d080 msgr2=0x7efebc13b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebaa00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15d080 0x7efebc13b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebaa00640 1 -- 172.21.15.106:0/1003288762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efebc15fa20 msgr2=0x7efebc140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebaa00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efebc15fa20 0x7efebc140790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebaa00640 1 -- 172.21.15.106:0/1003288762 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efebc13bb80 con 0x7efebc15c4e0 2024-04-26T21:17:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebb400640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efebc15fa20 0x7efebc140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efebaa00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15c4e0 0x7efebc1664e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efeac00e870 tx=0x7efeac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:06.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efeb2a00640 1 -- 172.21.15.106:0/1003288762 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac017070 con 0x7efebc15c4e0 2024-04-26T21:17:06.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efeb2a00640 1 -- 172.21.15.106:0/1003288762 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeac00ee60 con 0x7efebc15c4e0 2024-04-26T21:17:06.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efebc0d10b0 con 0x7efebc15c4e0 2024-04-26T21:17:06.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efeb2a00640 1 -- 172.21.15.106:0/1003288762 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac00cb80 con 0x7efebc15c4e0 2024-04-26T21:17:06.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efebc0ce490 con 0x7efebc15c4e0 2024-04-26T21:17:06.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.407+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efebc0ce9b0 con 0x7efebc15c4e0 2024-04-26T21:17:06.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.411+0000 7efeb2a00640 1 -- 172.21.15.106:0/1003288762 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efeac01a070 con 0x7efebc15c4e0 2024-04-26T21:17:06.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.411+0000 7efeb2a00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efe9c068380 0x7efe9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.411+0000 7efeb2a00640 1 -- 172.21.15.106:0/1003288762 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7efeac086b80 con 0x7efebc15c4e0 2024-04-26T21:17:06.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.411+0000 7efeba000640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efe9c068380 0x7efe9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.411+0000 7efeba000640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efe9c068380 0x7efe9c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efebc0b2870 tx=0x7efea8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:06.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.415+0000 7efeb2a00640 1 -- 172.21.15.106:0/1003288762 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efeac0566e0 con 0x7efebc15c4e0 2024-04-26T21:17:06.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efebc069400 con 0x7efebc15c4e0 2024-04-26T21:17:06.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efeb2a00640 1 -- 172.21.15.106:0/1003288762 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7efeac05a9e0 con 0x7efebc15c4e0 2024-04-26T21:17:06.574 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:06.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efe9c068380 msgr2=0x7efe9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efe9c068380 0x7efe9c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efebc0b2870 tx=0x7efea8009190 comp rx=0 tx=0).stop 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15c4e0 msgr2=0x7efebc1664e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15c4e0 0x7efebc1664e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efeac00e870 tx=0x7efeac00ed30 comp rx=0 tx=0).stop 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 shutdown_connections 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efebc15fa20 0x7efebc140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efe9c068380 0x7efe9c06a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efebc15d080 0x7efebc13b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 --2- 172.21.15.106:0/1003288762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efebc15c4e0 0x7efebc1664e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.571+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 >> 172.21.15.106:0/1003288762 conn(0x7efebc0b2910 msgr2=0x7efebc0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.575+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 shutdown_connections 2024-04-26T21:17:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.575+0000 7efec1c00640 1 -- 172.21.15.106:0/1003288762 wait complete. 2024-04-26T21:17:06.595 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:06.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5f400640 1 Processor -- start 2024-04-26T21:17:06.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5f400640 1 -- start start 2024-04-26T21:17:06.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c580d1e50 0x7f1c58162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c5815e8c0 0x7f1c5815ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5f400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c58163510 con 0x7f1c58162bf0 2024-04-26T21:17:06.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5f400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1c5806eaf0 con 0x7f1c580d1e50 2024-04-26T21:17:06.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5f400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5806dee0 con 0x7f1c5815e8c0 2024-04-26T21:17:06.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5ca00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1c58162bf0 0x7f1c5806d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49320/0 (socket says 172.21.15.106:49320) 2024-04-26T21:17:06.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5ca00640 1 -- 172.21.15.106:0/513441780 learned_addr learned my addr 172.21.15.106:0/513441780 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c5d400640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c5815e8c0 0x7f1c5815ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c4fe00640 1 --2- 172.21.15.106:0/513441780 >> v2:172.21.15.112:3300/0 conn(0x7f1c580d1e50 0x7f1c58162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135399674 0 0) 0x7f1c58163510 con 0x7f1c58162bf0 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c3c003530 con 0x7f1c58162bf0 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2094032221 0 0) 0x7f1c3c003530 con 0x7f1c58162bf0 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c5815e8c0 msgr2=0x7f1c5815ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c5815e8c0 0x7f1c5815ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 >> v2:172.21.15.112:3300/0 conn(0x7f1c580d1e50 msgr2=0x7f1c58162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 --2- 172.21.15.106:0/513441780 >> v2:172.21.15.112:3300/0 conn(0x7f1c580d1e50 0x7f1c58162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5806e1c0 con 0x7f1c58162bf0 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f1c48001680 con 0x7f1c58162bf0 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 >> v1:172.21.15.106:6789/0 conn(0x7f1c58162bf0 legacy=0x7f1c5806d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c3c0039c0 0x7f1c3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.731+0000 7f1c57e00640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3c004810 0x7f1c3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c57e00640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c5815e8c0 0x7f1c3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5806eaf0 con 0x7f1c3c0039c0 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5806dee0 con 0x7f1c3c004810 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3c00b9d0 con 0x7f1c5815e8c0 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c5ca00640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c3c0039c0 0x7f1c3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c5d400640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c5815e8c0 0x7f1c3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c5ca00640 1 -- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c5815e8c0 msgr2=0x7f1c3c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c5ca00640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c5815e8c0 0x7f1c3c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c5ca00640 1 -- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3c004810 msgr2=0x7f1c3c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c5ca00640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3c004810 0x7f1c3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c5ca00640 1 -- 172.21.15.106:0/513441780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c003530 con 0x7f1c3c0039c0 2024-04-26T21:17:06.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c5ca00640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c3c0039c0 0x7f1c3c003de0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800c240 tx=0x7f1c4801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3baa5f3b71f3ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:06.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48007d60 con 0x7f1c3c0039c0 2024-04-26T21:17:06.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c480a9020 con 0x7f1c3c0039c0 2024-04-26T21:17:06.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.735+0000 7f1c57e00640 1 -- 172.21.15.106:0/513441780 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48005ae0 con 0x7f1c3c0039c0 2024-04-26T21:17:06.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 -- 172.21.15.106:0/513441780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c3c0039c0 msgr2=0x7f1c3c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 --2- 172.21.15.106:0/513441780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c3c0039c0 0x7f1c3c003de0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800c240 tx=0x7f1c4801cc90 comp rx=0 tx=0).stop 2024-04-26T21:17:06.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 -- 172.21.15.106:0/513441780 reap_dead start 2024-04-26T21:17:06.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 -- 172.21.15.106:0/513441780 shutdown_connections 2024-04-26T21:17:06.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 -- 172.21.15.106:0/513441780 >> 172.21.15.106:0/513441780 conn(0x7f1c580d2c50 msgr2=0x7f1c580d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:06.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 -- 172.21.15.106:0/513441780 shutdown_connections 2024-04-26T21:17:06.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 -- 172.21.15.106:0/513441780 wait complete. 2024-04-26T21:17:06.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 Processor -- start 2024-04-26T21:17:06.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 -- start start 2024-04-26T21:17:06.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3c0039c0 0x7f1c581f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c581f8ce0 0x7f1c58153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c58161730 0x7f1c5815f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1c580cd6e0 con 0x7f1c58161730 2024-04-26T21:17:06.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c580cd560 con 0x7f1c3c0039c0 2024-04-26T21:17:06.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5f400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1c580cd860 con 0x7f1c581f8ce0 2024-04-26T21:17:06.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c58161730 0x7f1c5815f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c58161730 0x7f1c5815f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59154/0 (socket says 172.21.15.106:59154) 2024-04-26T21:17:06.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 -- 172.21.15.106:0/2253221773 learned_addr learned my addr 172.21.15.106:0/2253221773 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:06.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5ca00640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3c0039c0 0x7f1c581f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c4fe00640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c581f8ce0 0x7f1c58153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 -- 172.21.15.106:0/2253221773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c581f8ce0 msgr2=0x7f1c58153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c581f8ce0 0x7f1c58153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 -- 172.21.15.106:0/2253221773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3c0039c0 msgr2=0x7f1c581f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3c0039c0 0x7f1c581f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 -- 172.21.15.106:0/2253221773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c58162080 con 0x7f1c58161730 2024-04-26T21:17:06.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5ca00640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3c0039c0 0x7f1c581f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:06.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.739+0000 7f1c5d400640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c58161730 0x7f1c5815f690 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1c58073400 tx=0x7f1c5000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:06.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c55600640 1 -- 172.21.15.106:0/2253221773 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5001c070 con 0x7f1c58161730 2024-04-26T21:17:06.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c55600640 1 -- 172.21.15.106:0/2253221773 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c50017400 con 0x7f1c58161730 2024-04-26T21:17:06.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c55600640 1 -- 172.21.15.106:0/2253221773 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c500177f0 con 0x7f1c58161730 2024-04-26T21:17:06.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c58162360 con 0x7f1c58161730 2024-04-26T21:17:06.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c58154410 con 0x7f1c58161730 2024-04-26T21:17:06.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c58069400 con 0x7f1c58161730 2024-04-26T21:17:06.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c55600640 1 -- 172.21.15.106:0/2253221773 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c5001f070 con 0x7f1c58161730 2024-04-26T21:17:06.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c55600640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1c34068380 0x7f1c3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:06.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c55600640 1 -- 172.21.15.106:0/2253221773 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f1c50086e10 con 0x7f1c58161730 2024-04-26T21:17:06.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c5ca00640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1c34068380 0x7f1c3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:06.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.743+0000 7f1c5ca00640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1c34068380 0x7f1c3406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c480aa000 tx=0x7f1c480b0040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:06.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.747+0000 7f1c55600640 1 -- 172.21.15.106:0/2253221773 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1c50012070 con 0x7f1c58161730 2024-04-26T21:17:06.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.903+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1c580b27b0 con 0x7f1c58161730 2024-04-26T21:17:06.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.903+0000 7f1c55600640 1 -- 172.21.15.106:0/2253221773 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f1c50056a10 con 0x7f1c58161730 2024-04-26T21:17:06.908 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1c34068380 msgr2=0x7f1c3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1c34068380 0x7f1c3406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c480aa000 tx=0x7f1c480b0040 comp rx=0 tx=0).stop 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c58161730 msgr2=0x7f1c5815f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c58161730 0x7f1c5815f690 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1c58073400 tx=0x7f1c5000f4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 shutdown_connections 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1c34068380 0x7f1c3406a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c58161730 0x7f1c5815f690 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1c581f8ce0 0x7f1c58153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 --2- 172.21.15.106:0/2253221773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c3c0039c0 0x7f1c581f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:06.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 >> 172.21.15.106:0/2253221773 conn(0x7f1c580d2c50 msgr2=0x7f1c5806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:06.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 shutdown_connections 2024-04-26T21:17:06.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:06.907+0000 7f1c5f400640 1 -- 172.21.15.106:0/2253221773 wait complete. 2024-04-26T21:17:06.935 INFO:tasks.cephfs_test_runner:Starting test: test_replay_create (tasks.cephfs.test_cap_flush.TestCapFlush) MDS starts to handle client caps when it enters clientreplay stage. 2024-04-26T21:17:06.935 INFO:tasks.cephfs_test_runner:test_replay_create (tasks.cephfs.test_cap_flush.TestCapFlush) 2024-04-26T21:17:06.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:07.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.067+0000 7f9591e00640 1 Processor -- start 2024-04-26T21:17:07.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.067+0000 7f9591e00640 1 -- start start 2024-04-26T21:17:07.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.067+0000 7f9591e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f958c146490 0x7f958c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.067+0000 7f9591e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958c0b3da0 con 0x7f958c160ac0 2024-04-26T21:17:07.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.067+0000 7f9591e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958c160fa0 con 0x7f958c146870 2024-04-26T21:17:07.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.067+0000 7f9591e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f958c161280 con 0x7f958c146490 2024-04-26T21:17:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.067+0000 7f958aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f958c146490 0x7f958c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.067+0000 7f9582000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f958c160ac0 0x7f958c0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40298/0 (socket says 172.21.15.106:40298) 2024-04-26T21:17:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.067+0000 7f9582000640 1 -- 172.21.15.106:0/2434970032 learned_addr learned my addr 172.21.15.106:0/2434970032 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f958aa00640 1 -- 172.21.15.106:0/2434970032 >> v1:172.21.15.112:6789/0 conn(0x7f958c146870 legacy=0x7f958c0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f958aa00640 1 -- 172.21.15.106:0/2434970032 >> v1:172.21.15.106:6789/0 conn(0x7f958c160ac0 legacy=0x7f958c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f958aa00640 1 -- 172.21.15.106:0/2434970032 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c161560 con 0x7f958c146490 2024-04-26T21:17:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f958a000640 1 -- 172.21.15.106:0/2434970032 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783150375 0 0) 0x7f958c0b3da0 con 0x7f958c160ac0 2024-04-26T21:17:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f958aa00640 1 --2- 172.21.15.106:0/2434970032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 0x7f958c15df50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097c0 tx=0x7f957c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dfc6a8e15a5b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f958a000640 1 -- 172.21.15.106:0/2434970032 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0b1070 con 0x7f958c146490 2024-04-26T21:17:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f958a000640 1 -- 172.21.15.106:0/2434970032 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c0ac5f0 con 0x7f958c146490 2024-04-26T21:17:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f958a000640 1 -- 172.21.15.106:0/2434970032 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0ac9c0 con 0x7f958c146490 2024-04-26T21:17:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f9591e00640 1 -- 172.21.15.106:0/2434970032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 msgr2=0x7f958c15df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.071+0000 7f9591e00640 1 --2- 172.21.15.106:0/2434970032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 0x7f958c15df50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097c0 tx=0x7f957c01c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 -- 172.21.15.106:0/2434970032 shutdown_connections 2024-04-26T21:17:07.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 --2- 172.21.15.106:0/2434970032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 0x7f958c15df50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 -- 172.21.15.106:0/2434970032 >> 172.21.15.106:0/2434970032 conn(0x7f958c068340 msgr2=0x7f958c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:07.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 -- 172.21.15.106:0/2434970032 shutdown_connections 2024-04-26T21:17:07.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 -- 172.21.15.106:0/2434970032 wait complete. 2024-04-26T21:17:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 Processor -- start 2024-04-26T21:17:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 -- start start 2024-04-26T21:17:07.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 0x7f958c13f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f958c146870 0x7f958c13eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f958c160ac0 0x7f958c142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f958c0b4dc0 con 0x7f958c146490 2024-04-26T21:17:07.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f958c0d16c0 con 0x7f958c146870 2024-04-26T21:17:07.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f958c0b4f40 con 0x7f958c160ac0 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 0x7f958c13f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 0x7f958c13f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55150/0 (socket says 172.21.15.106:55150) 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958aa00640 1 -- 172.21.15.106:0/4265194280 learned_addr learned my addr 172.21.15.106:0/4265194280 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958b400640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f958c160ac0 0x7f958c142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958aa00640 1 -- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f958c160ac0 msgr2=0x7f958c142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9582000640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f958c146870 0x7f958c13eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958aa00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f958c160ac0 0x7f958c142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958aa00640 1 -- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f958c146870 msgr2=0x7f958c13eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958aa00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f958c146870 0x7f958c13eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958aa00640 1 -- 172.21.15.106:0/4265194280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c0aa4c0 con 0x7f958c146490 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958b400640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f958c160ac0 0x7f958c142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9582000640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f958c146870 0x7f958c13eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f958aa00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 0x7f958c13f020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f957c0af040 tx=0x7f957c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9583e00640 1 -- 172.21.15.106:0/4265194280 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0b1050 con 0x7f958c146490 2024-04-26T21:17:07.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9583e00640 1 -- 172.21.15.106:0/4265194280 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c0bd070 con 0x7f958c146490 2024-04-26T21:17:07.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9583e00640 1 -- 172.21.15.106:0/4265194280 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0b6a50 con 0x7f958c146490 2024-04-26T21:17:07.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.075+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c0aa780 con 0x7f958c146490 2024-04-26T21:17:07.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.079+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c141510 con 0x7f958c146490 2024-04-26T21:17:07.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.079+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958c069400 con 0x7f958c146490 2024-04-26T21:17:07.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.079+0000 7f9583e00640 1 -- 172.21.15.106:0/4265194280 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f957c0ac490 con 0x7f958c146490 2024-04-26T21:17:07.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.079+0000 7f9583e00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9568068380 0x7f956806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.079+0000 7f9583e00640 1 -- 172.21.15.106:0/4265194280 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f957c1216e0 con 0x7f958c146490 2024-04-26T21:17:07.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.079+0000 7f9582000640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9568068380 0x7f956806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.079+0000 7f9582000640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9568068380 0x7f956806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f958c143ea0 tx=0x7f9574009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:07.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.083+0000 7f9583e00640 1 -- 172.21.15.106:0/4265194280 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f957c0a9070 con 0x7f958c146490 2024-04-26T21:17:07.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.243+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f958c15d990 con 0x7f958c146490 2024-04-26T21:17:07.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.243+0000 7f9583e00640 1 -- 172.21.15.106:0/4265194280 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7f957c016090 con 0x7f958c146490 2024-04-26T21:17:07.248 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:07.248 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:07.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9568068380 msgr2=0x7f956806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9568068380 0x7f956806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f958c143ea0 tx=0x7f9574009040 comp rx=0 tx=0).stop 2024-04-26T21:17:07.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 msgr2=0x7f958c13f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 0x7f958c13f020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f957c0af040 tx=0x7f957c01ace0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 shutdown_connections 2024-04-26T21:17:07.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f958c146870 0x7f958c13eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9568068380 0x7f956806a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f958c160ac0 0x7f958c142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 --2- 172.21.15.106:0/4265194280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f958c146490 0x7f958c13f020 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 >> 172.21.15.106:0/4265194280 conn(0x7f958c068340 msgr2=0x7f958c0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:07.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 shutdown_connections 2024-04-26T21:17:07.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.247+0000 7f9591e00640 1 -- 172.21.15.106:0/4265194280 wait complete. 2024-04-26T21:17:07.269 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:07.270 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:07.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b7a000640 1 Processor -- start 2024-04-26T21:17:07.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b7a000640 1 -- start start 2024-04-26T21:17:07.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b7a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b740d1e50 0x7f0b74162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b7a000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0b7415e8c0 0x7f0b7415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b7a000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b74163510 con 0x7f0b74162bf0 2024-04-26T21:17:07.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b7a000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0b7406eaf0 con 0x7f0b7415e8c0 2024-04-26T21:17:07.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b7a000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7406dee0 con 0x7f0b740d1e50 2024-04-26T21:17:07.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b73400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0b74162bf0 0x7f0b7406d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40302/0 (socket says 172.21.15.106:40302) 2024-04-26T21:17:07.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b73400640 1 -- 172.21.15.106:0/3603641471 learned_addr learned my addr 172.21.15.106:0/3603641471 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:07.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b73e00640 1 --2- 172.21.15.106:0/3603641471 >> v2:172.21.15.112:3300/0 conn(0x7f0b7415e8c0 0x7f0b7415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b72a00640 1 --2- 172.21.15.106:0/3603641471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b740d1e50 0x7f0b74162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b72000640 1 -- 172.21.15.106:0/3603641471 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645929443 0 0) 0x7f0b74163510 con 0x7f0b74162bf0 2024-04-26T21:17:07.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b72000640 1 -- 172.21.15.106:0/3603641471 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b58003530 con 0x7f0b74162bf0 2024-04-26T21:17:07.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b73e00640 1 -- 172.21.15.106:0/3603641471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b740d1e50 msgr2=0x7f0b74162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:07.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b73e00640 1 --2- 172.21.15.106:0/3603641471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b740d1e50 0x7f0b74162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b73e00640 1 -- 172.21.15.106:0/3603641471 >> v1:172.21.15.106:6789/0 conn(0x7f0b74162bf0 legacy=0x7f0b7406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.407+0000 7f0b73e00640 1 -- 172.21.15.106:0/3603641471 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7406e1c0 con 0x7f0b7415e8c0 2024-04-26T21:17:07.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b73e00640 1 --2- 172.21.15.106:0/3603641471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b7415e8c0 0x7f0b7415ed10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009d90 tx=0x7f0b6c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff43e4f507cda771 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:07.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b72000640 1 -- 172.21.15.106:0/3603641471 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0b2070 con 0x7f0b7415e8c0 2024-04-26T21:17:07.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b72000640 1 -- 172.21.15.106:0/3603641471 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6c0a5a00 con 0x7f0b7415e8c0 2024-04-26T21:17:07.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b72000640 1 -- 172.21.15.106:0/3603641471 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0a5db0 con 0x7f0b7415e8c0 2024-04-26T21:17:07.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b7a000640 1 -- 172.21.15.106:0/3603641471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b7415e8c0 msgr2=0x7f0b7415ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b7a000640 1 --2- 172.21.15.106:0/3603641471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b7415e8c0 0x7f0b7415ed10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009d90 tx=0x7f0b6c01c940 comp rx=0 tx=0).stop 2024-04-26T21:17:07.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b7a000640 1 -- 172.21.15.106:0/3603641471 shutdown_connections 2024-04-26T21:17:07.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b7a000640 1 --2- 172.21.15.106:0/3603641471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b7415e8c0 0x7f0b7415ed10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b7a000640 1 --2- 172.21.15.106:0/3603641471 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b740d1e50 0x7f0b74162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b7a000640 1 -- 172.21.15.106:0/3603641471 >> 172.21.15.106:0/3603641471 conn(0x7f0b740d2c50 msgr2=0x7f0b740d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:07.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.411+0000 7f0b7a000640 1 -- 172.21.15.106:0/3603641471 shutdown_connections 2024-04-26T21:17:07.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 -- 172.21.15.106:0/3603641471 wait complete. 2024-04-26T21:17:07.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 Processor -- start 2024-04-26T21:17:07.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 -- start start 2024-04-26T21:17:07.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b740d1e50 0x7f0b741fac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b7415e8c0 0x7f0b740afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b74162bf0 0x7f0b740b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740cdef0 con 0x7f0b740d1e50 2024-04-26T21:17:07.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740cdd70 con 0x7f0b7415e8c0 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0b740ce070 con 0x7f0b74162bf0 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b740d1e50 0x7f0b741fac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b740d1e50 0x7f0b741fac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55156/0 (socket says 172.21.15.106:55156) 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73400640 1 -- 172.21.15.106:0/1461691908 learned_addr learned my addr 172.21.15.106:0/1461691908 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73e00640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b74162bf0 0x7f0b740b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b72a00640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b7415e8c0 0x7f0b740afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73400640 1 -- 172.21.15.106:0/1461691908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b74162bf0 msgr2=0x7f0b740b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73400640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b74162bf0 0x7f0b740b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73400640 1 -- 172.21.15.106:0/1461691908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b7415e8c0 msgr2=0x7f0b740afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73400640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b7415e8c0 0x7f0b740afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73400640 1 -- 172.21.15.106:0/1461691908 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b741fb170 con 0x7f0b740d1e50 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b73400640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b740d1e50 0x7f0b741fac30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c3f0 tx=0x7f0b6400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b6b400640 1 -- 172.21.15.106:0/1461691908 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b64017070 con 0x7f0b740d1e50 2024-04-26T21:17:07.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b6b400640 1 -- 172.21.15.106:0/1461691908 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b64005cf0 con 0x7f0b740d1e50 2024-04-26T21:17:07.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b6b400640 1 -- 172.21.15.106:0/1461691908 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b640072f0 con 0x7f0b740d1e50 2024-04-26T21:17:07.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.415+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b74157510 con 0x7f0b740d1e50 2024-04-26T21:17:07.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.419+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b740b2b50 con 0x7f0b740d1e50 2024-04-26T21:17:07.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.419+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b74069400 con 0x7f0b740d1e50 2024-04-26T21:17:07.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.419+0000 7f0b6b400640 1 -- 172.21.15.106:0/1461691908 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b6401a070 con 0x7f0b740d1e50 2024-04-26T21:17:07.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.419+0000 7f0b6b400640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0b54068380 0x7f0b5406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.419+0000 7f0b6b400640 1 -- 172.21.15.106:0/1461691908 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f0b64086210 con 0x7f0b740d1e50 2024-04-26T21:17:07.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.419+0000 7f0b72a00640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0b54068380 0x7f0b5406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.419+0000 7f0b72a00640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0b54068380 0x7f0b5406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b740b4640 tx=0x7f0b60009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:07.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.423+0000 7f0b6b400640 1 -- 172.21.15.106:0/1461691908 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0b64055ce0 con 0x7f0b740d1e50 2024-04-26T21:17:07.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.579+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0b740d32d0 con 0x7f0b740d1e50 2024-04-26T21:17:07.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b6b400640 1 -- 172.21.15.106:0/1461691908 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f0b64059fe0 con 0x7f0b740d1e50 2024-04-26T21:17:07.585 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:07.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0b54068380 msgr2=0x7f0b5406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0b54068380 0x7f0b5406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b740b4640 tx=0x7f0b60009190 comp rx=0 tx=0).stop 2024-04-26T21:17:07.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b740d1e50 msgr2=0x7f0b741fac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b740d1e50 0x7f0b741fac30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c3f0 tx=0x7f0b6400c8b0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 shutdown_connections 2024-04-26T21:17:07.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b7415e8c0 0x7f0b740afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0b54068380 0x7f0b5406a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0b74162bf0 0x7f0b740b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 --2- 172.21.15.106:0/1461691908 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b740d1e50 0x7f0b741fac30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 >> 172.21.15.106:0/1461691908 conn(0x7f0b740d2c50 msgr2=0x7f0b740716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:07.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 shutdown_connections 2024-04-26T21:17:07.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.583+0000 7f0b7a000640 1 -- 172.21.15.106:0/1461691908 wait complete. 2024-04-26T21:17:07.606 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:07.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb7200640 1 Processor -- start 2024-04-26T21:17:07.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb7200640 1 -- start start 2024-04-26T21:17:07.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb7200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efcb015ea90 0x7efcb0166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb7200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb00b4f00 con 0x7efcb015c4e0 2024-04-26T21:17:07.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb7200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb00b51e0 con 0x7efcb015d080 2024-04-26T21:17:07.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb7200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7efcb015d5f0 con 0x7efcb015ea90 2024-04-26T21:17:07.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcafe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efcb015c4e0 0x7efcb015c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40314/0 (socket says 172.21.15.106:40314) 2024-04-26T21:17:07.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcafe00640 1 -- 172.21.15.106:0/1496008699 learned_addr learned my addr 172.21.15.106:0/1496008699 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:07.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb5200640 1 --2- 172.21.15.106:0/1496008699 >> v2:172.21.15.106:3300/0 conn(0x7efcb015ea90 0x7efcb0166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcaea00640 1 -- 172.21.15.106:0/1496008699 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703713578 0 0) 0x7efcb00b4f00 con 0x7efcb015c4e0 2024-04-26T21:17:07.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcaea00640 1 -- 172.21.15.106:0/1496008699 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc94003530 con 0x7efcb015c4e0 2024-04-26T21:17:07.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcaea00640 1 -- 172.21.15.106:0/1496008699 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683156454 0 0) 0x7efcb00b51e0 con 0x7efcb015d080 2024-04-26T21:17:07.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcaea00640 1 -- 172.21.15.106:0/1496008699 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb00b4f00 con 0x7efcb015d080 2024-04-26T21:17:07.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb5200640 1 -- 172.21.15.106:0/1496008699 >> v1:172.21.15.112:6789/0 conn(0x7efcb015d080 legacy=0x7efcb00b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb5200640 1 -- 172.21.15.106:0/1496008699 >> v1:172.21.15.106:6789/0 conn(0x7efcb015c4e0 legacy=0x7efcb015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.743+0000 7efcb5200640 1 -- 172.21.15.106:0/1496008699 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb00b54c0 con 0x7efcb015ea90 2024-04-26T21:17:07.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcb5200640 1 --2- 172.21.15.106:0/1496008699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015ea90 0x7efcb0166db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efca8009d90 tx=0x7efca801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0dbd2d61c748bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:07.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcaea00640 1 -- 172.21.15.106:0/1496008699 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca80b2070 con 0x7efcb015ea90 2024-04-26T21:17:07.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcaea00640 1 -- 172.21.15.106:0/1496008699 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca80a58e0 con 0x7efcb015ea90 2024-04-26T21:17:07.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcaea00640 1 -- 172.21.15.106:0/1496008699 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca80a5c90 con 0x7efcb015ea90 2024-04-26T21:17:07.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcb7200640 1 -- 172.21.15.106:0/1496008699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015ea90 msgr2=0x7efcb0166db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcb7200640 1 --2- 172.21.15.106:0/1496008699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015ea90 0x7efcb0166db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efca8009d90 tx=0x7efca801c970 comp rx=0 tx=0).stop 2024-04-26T21:17:07.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcb7200640 1 -- 172.21.15.106:0/1496008699 shutdown_connections 2024-04-26T21:17:07.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcb7200640 1 --2- 172.21.15.106:0/1496008699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015ea90 0x7efcb0166db0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcb7200640 1 -- 172.21.15.106:0/1496008699 >> 172.21.15.106:0/1496008699 conn(0x7efcb00b2910 msgr2=0x7efcb00b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:07.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcb7200640 1 -- 172.21.15.106:0/1496008699 shutdown_connections 2024-04-26T21:17:07.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.747+0000 7efcb7200640 1 -- 172.21.15.106:0/1496008699 wait complete. 2024-04-26T21:17:07.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 Processor -- start 2024-04-26T21:17:07.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 -- start start 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcb015c4e0 0x7efcb014c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015d080 0x7efcb01371f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb015ea90 0x7efcb0137730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efcb0169ea0 con 0x7efcb015d080 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efcb0169d20 con 0x7efcb015ea90 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efcb016a020 con 0x7efcb015c4e0 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcaf400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015d080 0x7efcb01371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcaf400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015d080 0x7efcb01371f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55164/0 (socket says 172.21.15.106:55164) 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcaf400640 1 -- 172.21.15.106:0/984437139 learned_addr learned my addr 172.21.15.106:0/984437139 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcafe00640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcb015c4e0 0x7efcb014c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb5200640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb015ea90 0x7efcb0137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcaf400640 1 -- 172.21.15.106:0/984437139 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcb015c4e0 msgr2=0x7efcb014c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcaf400640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcb015c4e0 0x7efcb014c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcaf400640 1 -- 172.21.15.106:0/984437139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb015ea90 msgr2=0x7efcb0137730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcaf400640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb015ea90 0x7efcb0137730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcaf400640 1 -- 172.21.15.106:0/984437139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb015b8d0 con 0x7efcb015d080 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcaf400640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015d080 0x7efcb01371f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c410 tx=0x7efc9c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efca7e00640 1 -- 172.21.15.106:0/984437139 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c017070 con 0x7efcb015d080 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efca7e00640 1 -- 172.21.15.106:0/984437139 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c0052f0 con 0x7efcb015d080 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb0135f50 con 0x7efcb015d080 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efca7e00640 1 -- 172.21.15.106:0/984437139 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c003840 con 0x7efcb015d080 2024-04-26T21:17:07.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb0136510 con 0x7efcb015d080 2024-04-26T21:17:07.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.751+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb0069400 con 0x7efcb015d080 2024-04-26T21:17:07.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.755+0000 7efca7e00640 1 -- 172.21.15.106:0/984437139 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc9c01a070 con 0x7efcb015d080 2024-04-26T21:17:07.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.755+0000 7efca7e00640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efc90068380 0x7efc9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:07.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.755+0000 7efca7e00640 1 -- 172.21.15.106:0/984437139 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7efc9c086270 con 0x7efcb015d080 2024-04-26T21:17:07.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.755+0000 7efcafe00640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efc90068380 0x7efc9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:07.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.755+0000 7efcafe00640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efc90068380 0x7efc9006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efca00011f0 tx=0x7efca0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:07.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.759+0000 7efca7e00640 1 -- 172.21.15.106:0/984437139 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efc9c056390 con 0x7efcb015d080 2024-04-26T21:17:07.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.915+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efcb013a900 con 0x7efcb015d080 2024-04-26T21:17:07.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.915+0000 7efca7e00640 1 -- 172.21.15.106:0/984437139 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7efc9c055c90 con 0x7efcb015d080 2024-04-26T21:17:07.919 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:07.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efc90068380 msgr2=0x7efc9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efc90068380 0x7efc9006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efca00011f0 tx=0x7efca0009040 comp rx=0 tx=0).stop 2024-04-26T21:17:07.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015d080 msgr2=0x7efcb01371f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:07.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015d080 0x7efcb01371f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c410 tx=0x7efc9c00c8d0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 shutdown_connections 2024-04-26T21:17:07.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb015ea90 0x7efcb0137730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efc90068380 0x7efc9006a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb015d080 0x7efcb01371f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 --2- 172.21.15.106:0/984437139 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efcb015c4e0 0x7efcb014c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:07.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 >> 172.21.15.106:0/984437139 conn(0x7efcb00b2910 msgr2=0x7efcb013b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:07.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 shutdown_connections 2024-04-26T21:17:07.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:07.919+0000 7efcb7200640 1 -- 172.21.15.106:0/984437139 wait complete. 2024-04-26T21:17:07.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:08.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce6d800640 1 Processor -- start 2024-04-26T21:17:08.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce6d800640 1 -- start start 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce6d800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce6815ddf0 0x7fce68070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce6d800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce680ce460 con 0x7fce6806e7b0 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce6d800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce680cdea0 con 0x7fce6815aad0 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce6d800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fce6815eca0 con 0x7fce6815ddf0 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce67400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fce6806e7b0 0x7fce6806ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40320/0 (socket says 172.21.15.106:40320) 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce67400640 1 -- 172.21.15.106:0/3724093607 learned_addr learned my addr 172.21.15.106:0/3724093607 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce5e000640 1 --2- 172.21.15.106:0/3724093607 >> v2:172.21.15.112:3300/0 conn(0x7fce6815ddf0 0x7fce68070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586040439 0 0) 0x7fce680ce460 con 0x7fce6806e7b0 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce4c003530 con 0x7fce6806e7b0 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551293883 0 0) 0x7fce680cdea0 con 0x7fce6815aad0 2024-04-26T21:17:08.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce680ce460 con 0x7fce6815aad0 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3085048558 0 0) 0x7fce4c003530 con 0x7fce6806e7b0 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 >> v2:172.21.15.112:3300/0 conn(0x7fce6815ddf0 msgr2=0x7fce68070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 --2- 172.21.15.106:0/3724093607 >> v2:172.21.15.112:3300/0 conn(0x7fce6815ddf0 0x7fce68070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 >> v1:172.21.15.112:6789/0 conn(0x7fce6815aad0 legacy=0x7fce6815e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce680ce180 con 0x7fce6806e7b0 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7fce60001a00 con 0x7fce6806e7b0 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce5e000640 1 --2- 172.21.15.106:0/3724093607 >> v2:172.21.15.112:3300/0 conn(0x7fce6815ddf0 0x7fce68070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 >> v1:172.21.15.106:6789/0 conn(0x7fce6806e7b0 legacy=0x7fce6806ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce4c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce4c004810 0x7fce4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce4c0051d0 0x7fce4c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fce6815eca0 con 0x7fce4c003b50 2024-04-26T21:17:08.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c00c100 con 0x7fce4c0051d0 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fce4c00c300 con 0x7fce4c004810 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66a00640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce4c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce67400640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce4c0051d0 0x7fce4c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce5e000640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce4c004810 0x7fce4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66a00640 1 -- 172.21.15.106:0/3724093607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce4c004810 msgr2=0x7fce4c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66a00640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce4c004810 0x7fce4c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66a00640 1 -- 172.21.15.106:0/3724093607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce4c0051d0 msgr2=0x7fce4c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66a00640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce4c0051d0 0x7fce4c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce66a00640 1 -- 172.21.15.106:0/3724093607 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c003530 con 0x7fce4c003b50 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce67400640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce4c0051d0 0x7fce4c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:08.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.075+0000 7fce67400640 1 -- 172.21.15.106:0/3724093607 reap_dead start 2024-04-26T21:17:08.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce66a00640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce4c003f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fce580018d0 tx=0x7fce5801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d1dc65ba750558 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58001520 con 0x7fce4c003b50 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce580052f0 con 0x7fce4c003b50 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce66000640 1 -- 172.21.15.106:0/3724093607 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58003840 con 0x7fce4c003b50 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce6d800640 1 -- 172.21.15.106:0/3724093607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 msgr2=0x7fce4c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce6d800640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce4c003f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fce580018d0 tx=0x7fce5801c560 comp rx=0 tx=0).stop 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce6d800640 1 -- 172.21.15.106:0/3724093607 shutdown_connections 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce6d800640 1 --2- 172.21.15.106:0/3724093607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce4c003f50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce6d800640 1 -- 172.21.15.106:0/3724093607 >> 172.21.15.106:0/3724093607 conn(0x7fce6806c400 msgr2=0x7fce6806c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce6d800640 1 -- 172.21.15.106:0/3724093607 shutdown_connections 2024-04-26T21:17:08.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.079+0000 7fce6d800640 1 -- 172.21.15.106:0/3724093607 wait complete. 2024-04-26T21:17:08.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 Processor -- start 2024-04-26T21:17:08.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 -- start start 2024-04-26T21:17:08.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce681e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce68146a20 0x7fce680b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce68146ea0 0x7fce680b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fce68075ee0 con 0x7fce4c003b50 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce68075d60 con 0x7fce68146ea0 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fce68073540 con 0x7fce68146a20 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce66a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce681e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce66a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce681e92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55184/0 (socket says 172.21.15.106:55184) 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce66a00640 1 -- 172.21.15.106:0/4024818285 learned_addr learned my addr 172.21.15.106:0/4024818285 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce66a00640 1 -- 172.21.15.106:0/4024818285 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce68146a20 msgr2=0x7fce680b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce66a00640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce68146a20 0x7fce680b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce66a00640 1 -- 172.21.15.106:0/4024818285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce68146ea0 msgr2=0x7fce680b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce66a00640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce68146ea0 0x7fce680b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce66a00640 1 -- 172.21.15.106:0/4024818285 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce681e97e0 con 0x7fce4c003b50 2024-04-26T21:17:08.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce66a00640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce681e92a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fce580ad040 tx=0x7fce4c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:08.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce5f400640 1 -- 172.21.15.106:0/4024818285 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce580bc070 con 0x7fce4c003b50 2024-04-26T21:17:08.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce5f400640 1 -- 172.21.15.106:0/4024818285 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce580054a0 con 0x7fce4c003b50 2024-04-26T21:17:08.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce5f400640 1 -- 172.21.15.106:0/4024818285 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58003d80 con 0x7fce4c003b50 2024-04-26T21:17:08.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce681475e0 con 0x7fce4c003b50 2024-04-26T21:17:08.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.083+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce68147ba0 con 0x7fce4c003b50 2024-04-26T21:17:08.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.087+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce68069400 con 0x7fce4c003b50 2024-04-26T21:17:08.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.087+0000 7fce5f400640 1 -- 172.21.15.106:0/4024818285 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce580bf070 con 0x7fce4c003b50 2024-04-26T21:17:08.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.087+0000 7fce5f400640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce44068380 0x7fce4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.087+0000 7fce5f400640 1 -- 172.21.15.106:0/4024818285 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fce58120120 con 0x7fce4c003b50 2024-04-26T21:17:08.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.087+0000 7fce5e000640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce44068380 0x7fce4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.087+0000 7fce5e000640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce44068380 0x7fce4406a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce681fbda0 tx=0x7fce50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:08.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.091+0000 7fce5f400640 1 -- 172.21.15.106:0/4024818285 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fce58016270 con 0x7fce4c003b50 2024-04-26T21:17:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.247+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fce6815cf10 con 0x7fce4c003b50 2024-04-26T21:17:08.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.247+0000 7fce5f400640 1 -- 172.21.15.106:0/4024818285 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fce580efb60 con 0x7fce4c003b50 2024-04-26T21:17:08.251 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:08.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce44068380 msgr2=0x7fce4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce44068380 0x7fce4406a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce681fbda0 tx=0x7fce50008040 comp rx=0 tx=0).stop 2024-04-26T21:17:08.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 msgr2=0x7fce681e92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce681e92a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fce580ad040 tx=0x7fce4c005840 comp rx=0 tx=0).stop 2024-04-26T21:17:08.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 shutdown_connections 2024-04-26T21:17:08.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce68146ea0 0x7fce680b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce44068380 0x7fce4406a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce68146a20 0x7fce680b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 --2- 172.21.15.106:0/4024818285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4c003b50 0x7fce681e92a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 >> 172.21.15.106:0/4024818285 conn(0x7fce6806c400 msgr2=0x7fce6815ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:08.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 shutdown_connections 2024-04-26T21:17:08.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.251+0000 7fce6d800640 1 -- 172.21.15.106:0/4024818285 wait complete. 2024-04-26T21:17:08.272 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:08.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.407+0000 7f9a2b000640 1 Processor -- start 2024-04-26T21:17:08.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.407+0000 7f9a2b000640 1 -- start start 2024-04-26T21:17:08.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a2b000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a240d1e50 0x7f9a24162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a2b000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2415e8c0 0x7f9a2415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a2b000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a24163510 con 0x7f9a24162bf0 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a2b000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9a2406eaf0 con 0x7f9a240d1e50 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a2b000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9a2406dee0 con 0x7f9a2415e8c0 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a23e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9a24162bf0 0x7f9a2406d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40332/0 (socket says 172.21.15.106:40332) 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a23e00640 1 -- 172.21.15.106:0/973022627 learned_addr learned my addr 172.21.15.106:0/973022627 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a23400640 1 --2- 172.21.15.106:0/973022627 >> v2:172.21.15.112:3300/0 conn(0x7f9a240d1e50 0x7f9a24162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a29000640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2415e8c0 0x7f9a2415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993886740 0 0) 0x7f9a24163510 con 0x7f9a24162bf0 2024-04-26T21:17:08.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a08003530 con 0x7f9a24162bf0 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1523480591 0 0) 0x7f9a08003530 con 0x7f9a24162bf0 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2415e8c0 msgr2=0x7f9a2415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2415e8c0 0x7f9a2415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 >> v2:172.21.15.112:3300/0 conn(0x7f9a240d1e50 msgr2=0x7f9a24162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 --2- 172.21.15.106:0/973022627 >> v2:172.21.15.112:3300/0 conn(0x7f9a240d1e50 0x7f9a24162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2406e1c0 con 0x7f9a24162bf0 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f9a14001680 con 0x7f9a24162bf0 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 >> v1:172.21.15.106:6789/0 conn(0x7f9a24162bf0 legacy=0x7f9a2406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2415e8c0 0x7f9a080039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a08003f40 0x7f9a08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a08004d50 0x7f9a080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2406eaf0 con 0x7f9a08004d50 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2406dee0 con 0x7f9a08003f40 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0800b9d0 con 0x7f9a2415e8c0 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a23e00640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2415e8c0 0x7f9a080039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a23400640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a08003f40 0x7f9a08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a29000640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a08004d50 0x7f9a080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a29000640 1 -- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2415e8c0 msgr2=0x7f9a080039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a29000640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2415e8c0 0x7f9a080039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a29000640 1 -- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a08003f40 msgr2=0x7f9a08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a29000640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a08003f40 0x7f9a08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.411+0000 7f9a29000640 1 -- 172.21.15.106:0/973022627 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a08003530 con 0x7f9a08004d50 2024-04-26T21:17:08.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a29000640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a08004d50 0x7f9a080051d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009fc0 tx=0x7f9a1c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545fcd0f69a19220 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0b2070 con 0x7f9a08004d50 2024-04-26T21:17:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1c0a5c90 con 0x7f9a08004d50 2024-04-26T21:17:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a22a00640 1 -- 172.21.15.106:0/973022627 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c009c10 con 0x7f9a08004d50 2024-04-26T21:17:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a2b000640 1 -- 172.21.15.106:0/973022627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a08004d50 msgr2=0x7f9a080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a2b000640 1 --2- 172.21.15.106:0/973022627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a08004d50 0x7f9a080051d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009fc0 tx=0x7f9a1c01cc20 comp rx=0 tx=0).stop 2024-04-26T21:17:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a29000640 1 -- 172.21.15.106:0/973022627 reap_dead start 2024-04-26T21:17:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a2b000640 1 -- 172.21.15.106:0/973022627 shutdown_connections 2024-04-26T21:17:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a2b000640 1 -- 172.21.15.106:0/973022627 >> 172.21.15.106:0/973022627 conn(0x7f9a240d2c50 msgr2=0x7f9a240d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a2b000640 1 -- 172.21.15.106:0/973022627 shutdown_connections 2024-04-26T21:17:08.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.415+0000 7f9a2b000640 1 -- 172.21.15.106:0/973022627 wait complete. 2024-04-26T21:17:08.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 Processor -- start 2024-04-26T21:17:08.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 -- start start 2024-04-26T21:17:08.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08004d50 0x7f9a2414cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a2414d480 0x7f9a240c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2414ca00 0x7f9a240c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9a240d22c0 con 0x7f9a2414d480 2024-04-26T21:17:08.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2406e780 con 0x7f9a2414ca00 2024-04-26T21:17:08.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9a2415ed10 con 0x7f9a08004d50 2024-04-26T21:17:08.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a2414d480 0x7f9a240c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a2414d480 0x7f9a240c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55198/0 (socket says 172.21.15.106:55198) 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23400640 1 -- 172.21.15.106:0/2241459058 learned_addr learned my addr 172.21.15.106:0/2241459058 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23e00640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08004d50 0x7f9a2414cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a29000640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2414ca00 0x7f9a240c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23400640 1 -- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08004d50 msgr2=0x7f9a2414cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23400640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08004d50 0x7f9a2414cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23400640 1 -- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2414ca00 msgr2=0x7f9a240c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23400640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2414ca00 0x7f9a240c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23400640 1 -- 172.21.15.106:0/2241459058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a240b6a90 con 0x7f9a2414d480 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a29000640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2414ca00 0x7f9a240c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23e00640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08004d50 0x7f9a2414cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a23400640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a2414d480 0x7f9a240c9000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a100119d0 tx=0x7f9a10011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a1be00640 1 -- 172.21.15.106:0/2241459058 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000fb50 con 0x7f9a2414d480 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a1be00640 1 -- 172.21.15.106:0/2241459058 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1000fcf0 con 0x7f9a2414d480 2024-04-26T21:17:08.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a240b6d70 con 0x7f9a2414d480 2024-04-26T21:17:08.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a1be00640 1 -- 172.21.15.106:0/2241459058 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000fea0 con 0x7f9a2414d480 2024-04-26T21:17:08.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a240b7330 con 0x7f9a2414d480 2024-04-26T21:17:08.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.419+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a24069400 con 0x7f9a2414d480 2024-04-26T21:17:08.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.423+0000 7f9a1be00640 1 -- 172.21.15.106:0/2241459058 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9a10012040 con 0x7f9a2414d480 2024-04-26T21:17:08.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.423+0000 7f9a1be00640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9a040683b0 0x7f9a0406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.423+0000 7f9a1be00640 1 -- 172.21.15.106:0/2241459058 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f9a100874a0 con 0x7f9a2414d480 2024-04-26T21:17:08.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.423+0000 7f9a23e00640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9a040683b0 0x7f9a0406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.423+0000 7f9a23e00640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9a040683b0 0x7f9a0406a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a14000fc0 tx=0x7f9a14009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:08.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.427+0000 7f9a1be00640 1 -- 172.21.15.106:0/2241459058 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9a10019030 con 0x7f9a2414d480 2024-04-26T21:17:08.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.583+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9a241e8e10 con 0x7f9a2414d480 2024-04-26T21:17:08.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a1be00640 1 -- 172.21.15.106:0/2241459058 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f9a10057790 con 0x7f9a2414d480 2024-04-26T21:17:08.588 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9a040683b0 msgr2=0x7f9a0406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9a040683b0 0x7f9a0406a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a14000fc0 tx=0x7f9a14009040 comp rx=0 tx=0).stop 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a2414d480 msgr2=0x7f9a240c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a2414d480 0x7f9a240c9000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a100119d0 tx=0x7f9a10011e90 comp rx=0 tx=0).stop 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 shutdown_connections 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a2414ca00 0x7f9a240c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9a040683b0 0x7f9a0406a870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a2414d480 0x7f9a240c9000 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 --2- 172.21.15.106:0/2241459058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a08004d50 0x7f9a2414cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 >> 172.21.15.106:0/2241459058 conn(0x7f9a240d2c50 msgr2=0x7f9a240700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 shutdown_connections 2024-04-26T21:17:08.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.587+0000 7f9a2b000640 1 -- 172.21.15.106:0/2241459058 wait complete. 2024-04-26T21:17:08.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create' 2024-04-26T21:17:08.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.743+0000 7fe5ef600640 1 Processor -- start 2024-04-26T21:17:08.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.743+0000 7fe5ef600640 1 -- start start 2024-04-26T21:17:08.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.743+0000 7fe5ef600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe5e8146490 0x7fe5e815df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.743+0000 7fe5ef600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e80b3da0 con 0x7fe5e8146870 2024-04-26T21:17:08.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.743+0000 7fe5ef600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e8160fa0 con 0x7fe5e8160ac0 2024-04-26T21:17:08.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.743+0000 7fe5ef600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e8161280 con 0x7fe5e8146490 2024-04-26T21:17:08.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.743+0000 7fe5ecc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe5e8146490 0x7fe5e815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.743+0000 7fe5ed600640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe5e8146870 0x7fe5e80d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40334/0 (socket says 172.21.15.106:40334) 2024-04-26T21:17:08.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.743+0000 7fe5ed600640 1 -- 172.21.15.106:0/3483207396 learned_addr learned my addr 172.21.15.106:0/3483207396 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:08.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ecc00640 1 -- 172.21.15.106:0/3483207396 >> v1:172.21.15.112:6789/0 conn(0x7fe5e8160ac0 legacy=0x7fe5e80cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ecc00640 1 -- 172.21.15.106:0/3483207396 >> v1:172.21.15.106:6789/0 conn(0x7fe5e8146870 legacy=0x7fe5e80d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ecc00640 1 -- 172.21.15.106:0/3483207396 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e8161560 con 0x7fe5e8146490 2024-04-26T21:17:08.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ecc00640 1 --2- 172.21.15.106:0/3483207396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 0x7fe5e815df50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80097c0 tx=0x7fe5d801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b30b4b0c88b2bb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:08.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5e7e00640 1 -- 172.21.15.106:0/3483207396 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d80b1070 con 0x7fe5e8146490 2024-04-26T21:17:08.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5e7e00640 1 -- 172.21.15.106:0/3483207396 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d80ac5f0 con 0x7fe5e8146490 2024-04-26T21:17:08.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5e7e00640 1 -- 172.21.15.106:0/3483207396 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d80ac9c0 con 0x7fe5e8146490 2024-04-26T21:17:08.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ef600640 1 -- 172.21.15.106:0/3483207396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 msgr2=0x7fe5e815df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ef600640 1 --2- 172.21.15.106:0/3483207396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 0x7fe5e815df50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80097c0 tx=0x7fe5d801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ef600640 1 -- 172.21.15.106:0/3483207396 shutdown_connections 2024-04-26T21:17:08.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ef600640 1 --2- 172.21.15.106:0/3483207396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 0x7fe5e815df50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ef600640 1 -- 172.21.15.106:0/3483207396 >> 172.21.15.106:0/3483207396 conn(0x7fe5e8068340 msgr2=0x7fe5e8068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:08.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ef600640 1 -- 172.21.15.106:0/3483207396 shutdown_connections 2024-04-26T21:17:08.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.747+0000 7fe5ef600640 1 -- 172.21.15.106:0/3483207396 wait complete. 2024-04-26T21:17:08.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ef600640 1 Processor -- start 2024-04-26T21:17:08.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ef600640 1 -- start start 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ef600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 0x7fe5e8155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ef600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5e8146870 0x7fe5e806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ef600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5e8160ac0 0x7fe5e813ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ef600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e80b4dc0 con 0x7fe5e8146490 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ef600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e80d16c0 con 0x7fe5e8146870 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ef600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e80b4f40 con 0x7fe5e8160ac0 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ecc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 0x7fe5e8155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ecc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 0x7fe5e8155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55220/0 (socket says 172.21.15.106:55220) 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ecc00640 1 -- 172.21.15.106:0/3086933528 learned_addr learned my addr 172.21.15.106:0/3086933528 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5dfe00640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5e8146870 0x7fe5e806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ed600640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5e8160ac0 0x7fe5e813ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ecc00640 1 -- 172.21.15.106:0/3086933528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5e8160ac0 msgr2=0x7fe5e813ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ecc00640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5e8160ac0 0x7fe5e813ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ecc00640 1 -- 172.21.15.106:0/3086933528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5e8146870 msgr2=0x7fe5e806e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:08.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ecc00640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5e8146870 0x7fe5e806e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:08.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ecc00640 1 -- 172.21.15.106:0/3086933528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e813faf0 con 0x7fe5e8146490 2024-04-26T21:17:08.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5ecc00640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 0x7fe5e8155310 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80af040 tx=0x7fe5d801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:08.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5e5600640 1 -- 172.21.15.106:0/3086933528 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d80b1050 con 0x7fe5e8146490 2024-04-26T21:17:08.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5e5600640 1 -- 172.21.15.106:0/3086933528 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d80bd070 con 0x7fe5e8146490 2024-04-26T21:17:08.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.751+0000 7fe5e5600640 1 -- 172.21.15.106:0/3086933528 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d80b6a50 con 0x7fe5e8146490 2024-04-26T21:17:08.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.755+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e8155850 con 0x7fe5e8146490 2024-04-26T21:17:08.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.755+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e813de10 con 0x7fe5e8146490 2024-04-26T21:17:08.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.755+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e8069400 con 0x7fe5e8146490 2024-04-26T21:17:08.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.755+0000 7fe5e5600640 1 -- 172.21.15.106:0/3086933528 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe5d80ac490 con 0x7fe5e8146490 2024-04-26T21:17:08.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.755+0000 7fe5e5600640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe5c4068380 0x7fe5c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:08.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.755+0000 7fe5e5600640 1 -- 172.21.15.106:0/3086933528 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe5d81214f0 con 0x7fe5e8146490 2024-04-26T21:17:08.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.755+0000 7fe5dfe00640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe5c4068380 0x7fe5c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:08.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.755+0000 7fe5dfe00640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe5c4068380 0x7fe5c406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5e806f4b0 tx=0x7fe5d0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:08.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.759+0000 7fe5e5600640 1 -- 172.21.15.106:0/3086933528 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe5e813faf0 con 0x7fe5e8146490 2024-04-26T21:17:08.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:08.971+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]} v 0) -- 0x7fe5e8073d70 con 0x7fe5e8146490 2024-04-26T21:17:09.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.631+0000 7fe5e5600640 1 -- 172.21.15.106:0/3086933528 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]}]=0 v70) ==== 141+0+0 (secure 0 0 0) 0x7fe5d80a9070 con 0x7fe5e8146490 2024-04-26T21:17:09.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe5c4068380 msgr2=0x7fe5c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe5c4068380 0x7fe5c406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5e806f4b0 tx=0x7fe5d0009040 comp rx=0 tx=0).stop 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 msgr2=0x7fe5e8155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 0x7fe5e8155310 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80af040 tx=0x7fe5d801ace0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 shutdown_connections 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5e8146870 0x7fe5e806e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe5c4068380 0x7fe5c406a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5e8160ac0 0x7fe5e813ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 --2- 172.21.15.106:0/3086933528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5e8146490 0x7fe5e8155310 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 >> 172.21.15.106:0/3086933528 conn(0x7fe5e8068340 msgr2=0x7fe5e8144910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 shutdown_connections 2024-04-26T21:17:09.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.635+0000 7fe5ef600640 1 -- 172.21.15.106:0/3086933528 wait complete. 2024-04-26T21:17:09.660 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T21:17:09.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f3200640 1 Processor -- start 2024-04-26T21:17:09.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f3200640 1 -- start start 2024-04-26T21:17:09.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f3200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f62ec163610 0x7f62ec0b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:09.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f3200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec070790 0x7f62ec06edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:09.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f3200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ec070c20 con 0x7f62ec06c400 2024-04-26T21:17:09.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f3200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f62ec1628e0 con 0x7f62ec163610 2024-04-26T21:17:09.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f3200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec163180 con 0x7f62ec070790 2024-04-26T21:17:09.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f1400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f62ec163610 0x7f62ec0b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:09.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f1e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f62ec06c400 0x7f62ec06c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40340/0 (socket says 172.21.15.106:40340) 2024-04-26T21:17:09.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f1e00640 1 -- 172.21.15.106:0/3708822969 learned_addr learned my addr 172.21.15.106:0/3708822969 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:09.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f2800640 1 --2- 172.21.15.106:0/3708822969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec070790 0x7f62ec06edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:09.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f1400640 1 -- 172.21.15.106:0/3708822969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec070790 msgr2=0x7f62ec06edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:09.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f1400640 1 --2- 172.21.15.106:0/3708822969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec070790 0x7f62ec06edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f1400640 1 -- 172.21.15.106:0/3708822969 >> v1:172.21.15.106:6789/0 conn(0x7f62ec06c400 legacy=0x7f62ec06c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:09.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f1400640 1 -- 172.21.15.106:0/3708822969 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec0b6de0 con 0x7f62ec163610 2024-04-26T21:17:09.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f0a00640 1 -- 172.21.15.106:0/3708822969 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686641446 0 0) 0x7f62ec070c20 con 0x7f62ec06c400 2024-04-26T21:17:09.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.799+0000 7f62f2800640 1 --2- 172.21.15.106:0/3708822969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec070790 0x7f62ec06edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f1400640 1 --2- 172.21.15.106:0/3708822969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec163610 0x7f62ec0b6800 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097c0 tx=0x7f62dc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35be4f6a6ba72eb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f0a00640 1 -- 172.21.15.106:0/3708822969 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0b0070 con 0x7f62ec163610 2024-04-26T21:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f0a00640 1 -- 172.21.15.106:0/3708822969 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc0ab600 con 0x7f62ec163610 2024-04-26T21:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f0a00640 1 -- 172.21.15.106:0/3708822969 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0ab9d0 con 0x7f62ec163610 2024-04-26T21:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f3200640 1 -- 172.21.15.106:0/3708822969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec163610 msgr2=0x7f62ec0b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f3200640 1 --2- 172.21.15.106:0/3708822969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec163610 0x7f62ec0b6800 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097c0 tx=0x7f62dc01c470 comp rx=0 tx=0).stop 2024-04-26T21:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f3200640 1 -- 172.21.15.106:0/3708822969 shutdown_connections 2024-04-26T21:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f3200640 1 --2- 172.21.15.106:0/3708822969 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec070790 0x7f62ec06edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f3200640 1 --2- 172.21.15.106:0/3708822969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec163610 0x7f62ec0b6800 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f3200640 1 -- 172.21.15.106:0/3708822969 >> 172.21.15.106:0/3708822969 conn(0x7f62ec0b3740 msgr2=0x7f62ec0b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:09.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f3200640 1 -- 172.21.15.106:0/3708822969 shutdown_connections 2024-04-26T21:17:09.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.803+0000 7f62f3200640 1 -- 172.21.15.106:0/3708822969 wait complete. 2024-04-26T21:17:09.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 Processor -- start 2024-04-26T21:17:09.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 -- start start 2024-04-26T21:17:09.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62ec06c400 0x7f62ec13f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:09.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec070790 0x7f62ec15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:09.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec163610 0x7f62ec0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:09.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec0b1470 con 0x7f62ec070790 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec0b12f0 con 0x7f62ec06c400 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec16bc80 con 0x7f62ec163610 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec070790 0x7f62ec15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec070790 0x7f62ec15d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55240/0 (socket says 172.21.15.106:55240) 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1400640 1 -- 172.21.15.106:0/2981396363 learned_addr learned my addr 172.21.15.106:0/2981396363 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1e00640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62ec06c400 0x7f62ec13f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f2800640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec163610 0x7f62ec0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1400640 1 -- 172.21.15.106:0/2981396363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec163610 msgr2=0x7f62ec0af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1400640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec163610 0x7f62ec0af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1400640 1 -- 172.21.15.106:0/2981396363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62ec06c400 msgr2=0x7f62ec13f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1400640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62ec06c400 0x7f62ec13f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1400640 1 -- 172.21.15.106:0/2981396363 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec15dac0 con 0x7f62ec070790 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f1400640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec070790 0x7f62ec15d000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f62dc01a0a0 tx=0x7f62dc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:09.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62e6000640 1 -- 172.21.15.106:0/2981396363 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0b0050 con 0x7f62ec070790 2024-04-26T21:17:09.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62e6000640 1 -- 172.21.15.106:0/2981396363 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc0bc070 con 0x7f62ec070790 2024-04-26T21:17:09.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ec15dda0 con 0x7f62ec070790 2024-04-26T21:17:09.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62e6000640 1 -- 172.21.15.106:0/2981396363 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0b5a30 con 0x7f62ec070790 2024-04-26T21:17:09.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.807+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ec142330 con 0x7f62ec070790 2024-04-26T21:17:09.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.811+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62ec0506d0 con 0x7f62ec070790 2024-04-26T21:17:09.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.811+0000 7f62e6000640 1 -- 172.21.15.106:0/2981396363 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f62dc0ab4c0 con 0x7f62ec070790 2024-04-26T21:17:09.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.811+0000 7f62e6000640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f62d0068380 0x7f62d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:09.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.811+0000 7f62e6000640 1 -- 172.21.15.106:0/2981396363 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f62dc121670 con 0x7f62ec070790 2024-04-26T21:17:09.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.811+0000 7f62f1e00640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f62d0068380 0x7f62d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:09.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.811+0000 7f62f1e00640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f62d0068380 0x7f62d006a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62e0007fd0 tx=0x7f62e0007d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:09.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.815+0000 7f62e6000640 1 -- 172.21.15.106:0/2981396363 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f62dc016090 con 0x7f62ec070790 2024-04-26T21:17:09.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.975+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f62ec0ce210 con 0x7f62ec070790 2024-04-26T21:17:09.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.975+0000 7f62e6000640 1 -- 172.21.15.106:0/2981396363 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f62dc0f1820 con 0x7f62ec070790 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f62d0068380 msgr2=0x7f62d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f62d0068380 0x7f62d006a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62e0007fd0 tx=0x7f62e0007d60 comp rx=0 tx=0).stop 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec070790 msgr2=0x7f62ec15d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec070790 0x7f62ec15d000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f62dc01a0a0 tx=0x7f62dc01acb0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 shutdown_connections 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f62d0068380 0x7f62d006a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62ec163610 0x7f62ec0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ec070790 0x7f62ec15d000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 --2- 172.21.15.106:0/2981396363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62ec06c400 0x7f62ec13f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 >> 172.21.15.106:0/2981396363 conn(0x7f62ec0b3740 msgr2=0x7f62ec0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:09.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 shutdown_connections 2024-04-26T21:17:09.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:09.979+0000 7f62f3200640 1 -- 172.21.15.106:0/2981396363 wait complete. 2024-04-26T21:17:10.002 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T21:17:10.003 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T21:17:10.079 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T21:17:10.169 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T21:17:10.169 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:17:10.169 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:10.178 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:17:10.178 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:10.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:10.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ec2200640 1 Processor -- start 2024-04-26T21:17:10.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ec2200640 1 -- start start 2024-04-26T21:17:10.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ec2200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ec2200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ebc0cfb70 0x7f2ebc0cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ec2200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ebc0b2250 con 0x7f2ebc0d0830 2024-04-26T21:17:10.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ec2200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2ebc0b25a0 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ec2200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc0ce660 con 0x7f2ebc15d060 2024-04-26T21:17:10.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ebbe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2ebc0d0830 0x7f2ebc0d0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40344/0 (socket says 172.21.15.106:40344) 2024-04-26T21:17:10.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ebbe00640 1 -- 172.21.15.106:0/3914213433 learned_addr learned my addr 172.21.15.106:0/3914213433 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:10.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ebb400640 1 --2- 172.21.15.106:0/3914213433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2eb2a00640 1 --2- 172.21.15.106:0/3914213433 >> v2:172.21.15.112:3300/0 conn(0x7f2ebc0cfb70 0x7f2ebc0cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ebaa00640 1 -- 172.21.15.106:0/3914213433 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252664099 0 0) 0x7f2ebc0b2250 con 0x7f2ebc0d0830 2024-04-26T21:17:10.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ebaa00640 1 -- 172.21.15.106:0/3914213433 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ea0003530 con 0x7f2ebc0d0830 2024-04-26T21:17:10.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.403+0000 7f2ebb400640 1 -- 172.21.15.106:0/3914213433 >> v2:172.21.15.112:3300/0 conn(0x7f2ebc0cfb70 msgr2=0x7f2ebc0cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:10.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ebb400640 1 --2- 172.21.15.106:0/3914213433 >> v2:172.21.15.112:3300/0 conn(0x7f2ebc0cfb70 0x7f2ebc0cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ebb400640 1 -- 172.21.15.106:0/3914213433 >> v1:172.21.15.106:6789/0 conn(0x7f2ebc0d0830 legacy=0x7f2ebc0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ebb400640 1 -- 172.21.15.106:0/3914213433 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc0ce940 con 0x7f2ebc15d060 2024-04-26T21:17:10.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2eb2a00640 1 --2- 172.21.15.106:0/3914213433 >> v2:172.21.15.112:3300/0 conn(0x7f2ebc0cfb70 0x7f2ebc0cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:10.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ebb400640 1 --2- 172.21.15.106:0/3914213433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc0cf630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0097c0 tx=0x7f2eac01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a99cd69a492991af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:10.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ebaa00640 1 -- 172.21.15.106:0/3914213433 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0b1070 con 0x7f2ebc15d060 2024-04-26T21:17:10.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ebaa00640 1 -- 172.21.15.106:0/3914213433 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ac410 con 0x7f2ebc15d060 2024-04-26T21:17:10.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ebaa00640 1 -- 172.21.15.106:0/3914213433 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ac7c0 con 0x7f2ebc15d060 2024-04-26T21:17:10.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ec2200640 1 -- 172.21.15.106:0/3914213433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 msgr2=0x7f2ebc0cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ec2200640 1 --2- 172.21.15.106:0/3914213433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc0cf630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0097c0 tx=0x7f2eac01c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ec2200640 1 -- 172.21.15.106:0/3914213433 shutdown_connections 2024-04-26T21:17:10.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ec2200640 1 --2- 172.21.15.106:0/3914213433 >> v2:172.21.15.112:3300/0 conn(0x7f2ebc0cfb70 0x7f2ebc0cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ec2200640 1 --2- 172.21.15.106:0/3914213433 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc0cf630 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ec2200640 1 -- 172.21.15.106:0/3914213433 >> 172.21.15.106:0/3914213433 conn(0x7f2ebc0d2c60 msgr2=0x7f2ebc0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:10.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ec2200640 1 -- 172.21.15.106:0/3914213433 shutdown_connections 2024-04-26T21:17:10.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.407+0000 7f2ec2200640 1 -- 172.21.15.106:0/3914213433 wait complete. 2024-04-26T21:17:10.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ec2200640 1 Processor -- start 2024-04-26T21:17:10.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ec2200640 1 -- start start 2024-04-26T21:17:10.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ec2200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ebc0cfb70 0x7f2ebc0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ec2200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ebc0d0830 0x7f2ebc15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ec2200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ec2200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc0ce400 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ec2200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc0ce280 con 0x7f2ebc0d0830 2024-04-26T21:17:10.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ec2200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc16a410 con 0x7f2ebc15d060 2024-04-26T21:17:10.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ebc0cfb70 0x7f2ebc0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ebc0cfb70 0x7f2ebc0cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55246/0 (socket says 172.21.15.106:55246) 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebb400640 1 -- 172.21.15.106:0/1869241841 learned_addr learned my addr 172.21.15.106:0/1869241841 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2eb2a00640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ebc0d0830 0x7f2ebc15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebbe00640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebb400640 1 -- 172.21.15.106:0/1869241841 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 msgr2=0x7f2ebc158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebb400640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebb400640 1 -- 172.21.15.106:0/1869241841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ebc0d0830 msgr2=0x7f2ebc15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebb400640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ebc0d0830 0x7f2ebc15b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebb400640 1 -- 172.21.15.106:0/1869241841 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc0ca8e0 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebbe00640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ebb400640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ebc0cfb70 0x7f2ebc0cb660 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c10 tx=0x7f2eac019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:10.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2eb3e00640 1 -- 172.21.15.106:0/1869241841 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0b1040 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2eb3e00640 1 -- 172.21.15.106:0/1869241841 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ba070 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2eb3e00640 1 -- 172.21.15.106:0/1869241841 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac003960 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.411+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ebc0cab80 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.415+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ebc0cb140 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.415+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ebc069400 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.415+0000 7f2eb3e00640 1 -- 172.21.15.106:0/1869241841 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2eac003b00 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.415+0000 7f2eb3e00640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2e98068380 0x7f2e9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.415+0000 7f2eb3e00640 1 -- 172.21.15.106:0/1869241841 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f2eac120820 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.415+0000 7f2eb2a00640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2e98068380 0x7f2e9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.419+0000 7f2eb2a00640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2e98068380 0x7f2e9806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009580 tx=0x7f2ea4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:10.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.419+0000 7f2eb3e00640 1 -- 172.21.15.106:0/1869241841 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2eac016090 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.579+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ebc1598e0 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.579+0000 7f2eb3e00640 1 -- 172.21.15.106:0/1869241841 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7f2eac0f0940 con 0x7f2ebc0cfb70 2024-04-26T21:17:10.583 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:10.583 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:10.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2e98068380 msgr2=0x7f2e9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2e98068380 0x7f2e9806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009580 tx=0x7f2ea4009190 comp rx=0 tx=0).stop 2024-04-26T21:17:10.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ebc0cfb70 msgr2=0x7f2ebc0cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ebc0cfb70 0x7f2ebc0cb660 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c10 tx=0x7f2eac019240 comp rx=0 tx=0).stop 2024-04-26T21:17:10.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 shutdown_connections 2024-04-26T21:17:10.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ebc0d0830 0x7f2ebc15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2e98068380 0x7f2e9806a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ebc15d060 0x7f2ebc158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 --2- 172.21.15.106:0/1869241841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ebc0cfb70 0x7f2ebc0cb660 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 >> 172.21.15.106:0/1869241841 conn(0x7f2ebc0d2c60 msgr2=0x7f2ebc0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:10.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 shutdown_connections 2024-04-26T21:17:10.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.583+0000 7f2ec2200640 1 -- 172.21.15.106:0/1869241841 wait complete. 2024-04-26T21:17:10.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:10.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:10.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904be00640 1 Processor -- start 2024-04-26T21:17:10.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904be00640 1 -- start start 2024-04-26T21:17:10.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f904c15a640 0x7f904c06dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f904c15dc50 0x7f904c0af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 0x7f904c1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904be00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f904c0b0140 con 0x7f904c15a640 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904be00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f904c0b3870 con 0x7f904c15dc50 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f904c06e210 con 0x7f904c0afcf0 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f904c15a640 0x7f904c06dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f904c15a640 0x7f904c06dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55260/0 (socket says 172.21.15.106:55260) 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904aa00640 1 -- 172.21.15.106:0/389505745 learned_addr learned my addr 172.21.15.106:0/389505745 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f9042000640 1 --2- 172.21.15.106:0/389505745 >> v2:172.21.15.112:3300/0 conn(0x7f904c15dc50 0x7f904c0af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904b400640 1 --2- 172.21.15.106:0/389505745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 0x7f904c1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904aa00640 1 -- 172.21.15.106:0/389505745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 msgr2=0x7f904c1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904aa00640 1 --2- 172.21.15.106:0/389505745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 0x7f904c1607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904aa00640 1 -- 172.21.15.106:0/389505745 >> v2:172.21.15.112:3300/0 conn(0x7f904c15dc50 msgr2=0x7f904c0af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.739+0000 7f904aa00640 1 --2- 172.21.15.106:0/389505745 >> v2:172.21.15.112:3300/0 conn(0x7f904c15dc50 0x7f904c0af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904aa00640 1 -- 172.21.15.106:0/389505745 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c06e4f0 con 0x7f904c15a640 2024-04-26T21:17:10.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904aa00640 1 --2- 172.21.15.106:0/389505745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 0x7f904c06dc30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f904c073ed0 tx=0x7f903c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d93a437b9cad2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:10.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904a000640 1 -- 172.21.15.106:0/389505745 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0b0070 con 0x7f904c15a640 2024-04-26T21:17:10.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904a000640 1 -- 172.21.15.106:0/389505745 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c0ab600 con 0x7f904c15a640 2024-04-26T21:17:10.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904a000640 1 -- 172.21.15.106:0/389505745 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0ab9d0 con 0x7f904c15a640 2024-04-26T21:17:10.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904be00640 1 -- 172.21.15.106:0/389505745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 msgr2=0x7f904c06dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904be00640 1 --2- 172.21.15.106:0/389505745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 0x7f904c06dc30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f904c073ed0 tx=0x7f903c01c230 comp rx=0 tx=0).stop 2024-04-26T21:17:10.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904be00640 1 -- 172.21.15.106:0/389505745 shutdown_connections 2024-04-26T21:17:10.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904be00640 1 --2- 172.21.15.106:0/389505745 >> v2:172.21.15.112:3300/0 conn(0x7f904c15dc50 0x7f904c0af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904be00640 1 --2- 172.21.15.106:0/389505745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 0x7f904c1607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904be00640 1 --2- 172.21.15.106:0/389505745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 0x7f904c06dc30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904be00640 1 -- 172.21.15.106:0/389505745 >> 172.21.15.106:0/389505745 conn(0x7f904c068140 msgr2=0x7f904c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:10.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904be00640 1 -- 172.21.15.106:0/389505745 shutdown_connections 2024-04-26T21:17:10.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.743+0000 7f904be00640 1 -- 172.21.15.106:0/389505745 wait complete. 2024-04-26T21:17:10.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 Processor -- start 2024-04-26T21:17:10.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 -- start start 2024-04-26T21:17:10.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 0x7f904c071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 0x7f904c14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f904c15dc50 0x7f904c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f904c15e510 con 0x7f904c15a640 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f904c15e390 con 0x7f904c15dc50 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f904c15aa20 con 0x7f904c0afcf0 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9042000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 0x7f904c14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9042000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 0x7f904c14db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55270/0 (socket says 172.21.15.106:55270) 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9042000640 1 -- 172.21.15.106:0/888863933 learned_addr learned my addr 172.21.15.106:0/888863933 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904aa00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 0x7f904c071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904b400640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f904c15dc50 0x7f904c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9042000640 1 -- 172.21.15.106:0/888863933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 msgr2=0x7f904c071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9042000640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 0x7f904c071c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9042000640 1 -- 172.21.15.106:0/888863933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f904c15dc50 msgr2=0x7f904c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9042000640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f904c15dc50 0x7f904c0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9042000640 1 -- 172.21.15.106:0/888863933 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c0cf930 con 0x7f904c15a640 2024-04-26T21:17:10.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904aa00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 0x7f904c071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9042000640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 0x7f904c14db30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f903400d5f0 tx=0x7f903400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9043400640 1 -- 172.21.15.106:0/888863933 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90340125f0 con 0x7f904c15a640 2024-04-26T21:17:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9043400640 1 -- 172.21.15.106:0/888863933 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9034019070 con 0x7f904c15a640 2024-04-26T21:17:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c0727c0 con 0x7f904c15a640 2024-04-26T21:17:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f9043400640 1 -- 172.21.15.106:0/888863933 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90340129b0 con 0x7f904c15a640 2024-04-26T21:17:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.747+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c0cfeb0 con 0x7f904c15a640 2024-04-26T21:17:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.751+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c0506d0 con 0x7f904c15a640 2024-04-26T21:17:10.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.751+0000 7f9043400640 1 -- 172.21.15.106:0/888863933 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9034012b50 con 0x7f904c15a640 2024-04-26T21:17:10.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.751+0000 7f9043400640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9028068380 0x7f902806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:10.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.751+0000 7f9043400640 1 -- 172.21.15.106:0/888863933 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f9034086fe0 con 0x7f904c15a640 2024-04-26T21:17:10.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.751+0000 7f904aa00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9028068380 0x7f902806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:10.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.751+0000 7f904aa00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9028068380 0x7f902806a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f903c0ad000 tx=0x7f903c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:10.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.755+0000 7f9043400640 1 -- 172.21.15.106:0/888863933 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9034056b60 con 0x7f904c15a640 2024-04-26T21:17:10.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.911+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f904c0b5d40 con 0x7f904c15a640 2024-04-26T21:17:10.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f9043400640 1 -- 172.21.15.106:0/888863933 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f903405ae60 con 0x7f904c15a640 2024-04-26T21:17:10.917 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:10.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9028068380 msgr2=0x7f902806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9028068380 0x7f902806a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f903c0ad000 tx=0x7f903c008040 comp rx=0 tx=0).stop 2024-04-26T21:17:10.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 msgr2=0x7f904c14db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:10.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 0x7f904c14db30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f903400d5f0 tx=0x7f903400dab0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 shutdown_connections 2024-04-26T21:17:10.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f904c15dc50 0x7f904c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9028068380 0x7f902806a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f904c15a640 0x7f904c14db30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 --2- 172.21.15.106:0/888863933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f904c0afcf0 0x7f904c071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:10.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 >> 172.21.15.106:0/888863933 conn(0x7f904c068140 msgr2=0x7f904c15ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:10.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 shutdown_connections 2024-04-26T21:17:10.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:10.915+0000 7f904be00640 1 -- 172.21.15.106:0/888863933 wait complete. 2024-04-26T21:17:10.938 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:11.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6ca800640 1 Processor -- start 2024-04-26T21:17:11.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6ca800640 1 -- start start 2024-04-26T21:17:11.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6ca800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415c4e0 0x7fe6c415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6ca800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6c415da80 0x7fe6c415df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6ca800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c415ce00 con 0x7fe6c415d080 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6ca800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c415d5f0 con 0x7fe6c415da80 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6ca800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c40b4f00 con 0x7fe6c415c4e0 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6c3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6c415da80 0x7fe6c415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6c3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6c415da80 0x7fe6c415df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55280/0 (socket says 172.21.15.106:55280) 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6c3e00640 1 -- 172.21.15.106:0/4255292644 learned_addr learned my addr 172.21.15.106:0/4255292644 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6c2a00640 1 --1- 172.21.15.106:0/4255292644 >> v1:172.21.15.106:6789/0 conn(0x7fe6c415d080 0x7fe6c40b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40346/0 (socket says 172.21.15.106:40346) 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6c3400640 1 --2- 172.21.15.106:0/4255292644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415c4e0 0x7fe6c415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6c3e00640 1 -- 172.21.15.106:0/4255292644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415c4e0 msgr2=0x7fe6c415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6c3e00640 1 --2- 172.21.15.106:0/4255292644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415c4e0 0x7fe6c415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6c3e00640 1 -- 172.21.15.106:0/4255292644 >> v1:172.21.15.106:6789/0 conn(0x7fe6c415d080 legacy=0x7fe6c40b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.075+0000 7fe6c3e00640 1 -- 172.21.15.106:0/4255292644 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c40b51e0 con 0x7fe6c415da80 2024-04-26T21:17:11.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6c3e00640 1 --2- 172.21.15.106:0/4255292644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415da80 0x7fe6c415df10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009e50 tx=0x7fe6bc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784cad4502d62896 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:11.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6c2000640 1 -- 172.21.15.106:0/4255292644 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc0a57f0 con 0x7fe6c415da80 2024-04-26T21:17:11.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6c2000640 1 -- 172.21.15.106:0/4255292644 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6bc0a5990 con 0x7fe6c415da80 2024-04-26T21:17:11.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6c2000640 1 -- 172.21.15.106:0/4255292644 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc0a5d60 con 0x7fe6c415da80 2024-04-26T21:17:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 -- 172.21.15.106:0/4255292644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415da80 msgr2=0x7fe6c415df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 --2- 172.21.15.106:0/4255292644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415da80 0x7fe6c415df10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009e50 tx=0x7fe6bc01ca30 comp rx=0 tx=0).stop 2024-04-26T21:17:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 -- 172.21.15.106:0/4255292644 shutdown_connections 2024-04-26T21:17:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 --2- 172.21.15.106:0/4255292644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415da80 0x7fe6c415df10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 --2- 172.21.15.106:0/4255292644 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415c4e0 0x7fe6c415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 -- 172.21.15.106:0/4255292644 >> 172.21.15.106:0/4255292644 conn(0x7fe6c40b2910 msgr2=0x7fe6c40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 -- 172.21.15.106:0/4255292644 shutdown_connections 2024-04-26T21:17:11.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 -- 172.21.15.106:0/4255292644 wait complete. 2024-04-26T21:17:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 Processor -- start 2024-04-26T21:17:11.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.079+0000 7fe6ca800640 1 -- start start 2024-04-26T21:17:11.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6ca800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415c4e0 0x7fe6c4144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6ca800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415d080 0x7fe6c4140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6ca800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c415da80 0x7fe6c40cf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6ca800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c406ea00 con 0x7fe6c415c4e0 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6ca800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c406e880 con 0x7fe6c415da80 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6ca800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c406eb80 con 0x7fe6c415d080 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415c4e0 0x7fe6c4144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415c4e0 0x7fe6c4144830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55286/0 (socket says 172.21.15.106:55286) 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3400640 1 -- 172.21.15.106:0/507903421 learned_addr learned my addr 172.21.15.106:0/507903421 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c2a00640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415d080 0x7fe6c4140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3e00640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c415da80 0x7fe6c40cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3400640 1 -- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415d080 msgr2=0x7fe6c4140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3400640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415d080 0x7fe6c4140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3400640 1 -- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c415da80 msgr2=0x7fe6c40cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3400640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c415da80 0x7fe6c40cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3400640 1 -- 172.21.15.106:0/507903421 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c4140a80 con 0x7fe6c415c4e0 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c2a00640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415d080 0x7fe6c4140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3e00640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c415da80 0x7fe6c40cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6c3400640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415c4e0 0x7fe6c4144830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400d800 tx=0x7fe6b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6bb400640 1 -- 172.21.15.106:0/507903421 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400b6c0 con 0x7fe6c415c4e0 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6bb400640 1 -- 172.21.15.106:0/507903421 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b4019070 con 0x7fe6c415c4e0 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c4140d60 con 0x7fe6c415c4e0 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6bb400640 1 -- 172.21.15.106:0/507903421 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400ba60 con 0x7fe6c415c4e0 2024-04-26T21:17:11.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c4141600 con 0x7fe6c415c4e0 2024-04-26T21:17:11.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.083+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c4140f30 con 0x7fe6c415c4e0 2024-04-26T21:17:11.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.087+0000 7fe6bb400640 1 -- 172.21.15.106:0/507903421 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe6b400bc00 con 0x7fe6c415c4e0 2024-04-26T21:17:11.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.087+0000 7fe6bb400640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe6a4068380 0x7fe6a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.087+0000 7fe6bb400640 1 -- 172.21.15.106:0/507903421 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe6b4087350 con 0x7fe6c415c4e0 2024-04-26T21:17:11.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.087+0000 7fe6c2a00640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe6a4068380 0x7fe6a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.087+0000 7fe6c2a00640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe6a4068380 0x7fe6a406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40cd8f0 tx=0x7fe6b0007d70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:11.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.091+0000 7fe6bb400640 1 -- 172.21.15.106:0/507903421 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe6b4057470 con 0x7fe6c415c4e0 2024-04-26T21:17:11.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe6c4069400 con 0x7fe6c415c4e0 2024-04-26T21:17:11.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6bb400640 1 -- 172.21.15.106:0/507903421 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fe6b4056d70 con 0x7fe6c415c4e0 2024-04-26T21:17:11.249 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:11.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe6a4068380 msgr2=0x7fe6a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe6a4068380 0x7fe6a406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40cd8f0 tx=0x7fe6b0007d70 comp rx=0 tx=0).stop 2024-04-26T21:17:11.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415c4e0 msgr2=0x7fe6c4144830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415c4e0 0x7fe6c4144830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400d800 tx=0x7fe6b400dcc0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 shutdown_connections 2024-04-26T21:17:11.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c415da80 0x7fe6c40cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe6a4068380 0x7fe6a406a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe6c415d080 0x7fe6c4140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 --2- 172.21.15.106:0/507903421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6c415c4e0 0x7fe6c4144830 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 >> 172.21.15.106:0/507903421 conn(0x7fe6c40b2910 msgr2=0x7fe6c406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:11.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 shutdown_connections 2024-04-26T21:17:11.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.247+0000 7fe6ca800640 1 -- 172.21.15.106:0/507903421 wait complete. 2024-04-26T21:17:11.271 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:11.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298f000640 1 Processor -- start 2024-04-26T21:17:11.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298f000640 1 -- start start 2024-04-26T21:17:11.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298f000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f298815d080 0x7f29880b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298f000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 0x7f298815df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298f000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29880b4f00 con 0x7f298815c4e0 2024-04-26T21:17:11.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298f000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f298815d5f0 con 0x7f298815d080 2024-04-26T21:17:11.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298f000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f29880b51e0 con 0x7f298815da80 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f297f400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f298815d080 0x7f29880b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f2987e00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f298815c4e0 0x7f298815c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:42252/0 (socket says 172.21.15.106:42252) 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298d000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 0x7f298815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f2987e00640 1 -- 172.21.15.106:0/955810535 learned_addr learned my addr 172.21.15.106:0/955810535 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f2987400640 1 -- 172.21.15.106:0/955810535 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790945135 0 0) 0x7f29880b4f00 con 0x7f298815c4e0 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f2987400640 1 -- 172.21.15.106:0/955810535 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f296c005740 con 0x7f298815c4e0 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298d000640 1 -- 172.21.15.106:0/955810535 >> v2:172.21.15.112:3300/0 conn(0x7f298815d080 msgr2=0x7f29880b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298d000640 1 --2- 172.21.15.106:0/955810535 >> v2:172.21.15.112:3300/0 conn(0x7f298815d080 0x7f29880b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298d000640 1 -- 172.21.15.106:0/955810535 >> v1:172.21.15.112:6789/0 conn(0x7f298815c4e0 legacy=0x7f298815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f298d000640 1 -- 172.21.15.106:0/955810535 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29880b54c0 con 0x7f298815da80 2024-04-26T21:17:11.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.407+0000 7f297f400640 1 --2- 172.21.15.106:0/955810535 >> v2:172.21.15.112:3300/0 conn(0x7f298815d080 0x7f29880b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:11.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f298d000640 1 --2- 172.21.15.106:0/955810535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 0x7f298815df10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29800097c0 tx=0x7f298001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=720c810edda9b891 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:11.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f2987400640 1 -- 172.21.15.106:0/955810535 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29800ab430 con 0x7f298815da80 2024-04-26T21:17:11.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f2987400640 1 -- 172.21.15.106:0/955810535 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29800b0070 con 0x7f298815da80 2024-04-26T21:17:11.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f2987400640 1 -- 172.21.15.106:0/955810535 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29800ab7f0 con 0x7f298815da80 2024-04-26T21:17:11.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f298f000640 1 -- 172.21.15.106:0/955810535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 msgr2=0x7f298815df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f298f000640 1 --2- 172.21.15.106:0/955810535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 0x7f298815df10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29800097c0 tx=0x7f298001c470 comp rx=0 tx=0).stop 2024-04-26T21:17:11.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f298f000640 1 -- 172.21.15.106:0/955810535 shutdown_connections 2024-04-26T21:17:11.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f298f000640 1 --2- 172.21.15.106:0/955810535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 0x7f298815df10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f298f000640 1 --2- 172.21.15.106:0/955810535 >> v2:172.21.15.112:3300/0 conn(0x7f298815d080 0x7f29880b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f298f000640 1 -- 172.21.15.106:0/955810535 >> 172.21.15.106:0/955810535 conn(0x7f29880b2910 msgr2=0x7f29880b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:11.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f298f000640 1 -- 172.21.15.106:0/955810535 shutdown_connections 2024-04-26T21:17:11.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.411+0000 7f298f000640 1 -- 172.21.15.106:0/955810535 wait complete. 2024-04-26T21:17:11.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 Processor -- start 2024-04-26T21:17:11.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 -- start start 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298815c4e0 0x7f29880c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f298815d080 0x7f29880c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 0x7f29881f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f298806ea00 con 0x7f298815d080 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f298806e880 con 0x7f298815c4e0 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f298806eb80 con 0x7f298815da80 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f297f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f298815d080 0x7f29880c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f297f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f298815d080 0x7f29880c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55296/0 (socket says 172.21.15.106:55296) 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f297f400640 1 -- 172.21.15.106:0/1074765670 learned_addr learned my addr 172.21.15.106:0/1074765670 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f2987e00640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298815c4e0 0x7f29880c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298d000640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 0x7f29881f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f297f400640 1 -- 172.21.15.106:0/1074765670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 msgr2=0x7f29881f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f297f400640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 0x7f29881f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f297f400640 1 -- 172.21.15.106:0/1074765670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298815c4e0 msgr2=0x7f29880c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f297f400640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298815c4e0 0x7f29880c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f297f400640 1 -- 172.21.15.106:0/1074765670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29880c8920 con 0x7f298815d080 2024-04-26T21:17:11.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f297f400640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f298815d080 0x7f29880c6990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f297000e9d0 tx=0x7f297000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:11.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f2984c00640 1 -- 172.21.15.106:0/1074765670 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970017070 con 0x7f298815d080 2024-04-26T21:17:11.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f2984c00640 1 -- 172.21.15.106:0/1074765670 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297000ca60 con 0x7f298815d080 2024-04-26T21:17:11.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f2984c00640 1 -- 172.21.15.106:0/1074765670 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297000ce50 con 0x7f298815d080 2024-04-26T21:17:11.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29880c6fc0 con 0x7f298815d080 2024-04-26T21:17:11.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.415+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29880c7580 con 0x7f298815d080 2024-04-26T21:17:11.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.419+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2988069400 con 0x7f298815d080 2024-04-26T21:17:11.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.419+0000 7f2984c00640 1 -- 172.21.15.106:0/1074765670 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f297001a070 con 0x7f298815d080 2024-04-26T21:17:11.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.419+0000 7f2984c00640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2964068520 0x7f296406a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.419+0000 7f2984c00640 1 -- 172.21.15.106:0/1074765670 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f29700868d0 con 0x7f298815d080 2024-04-26T21:17:11.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.419+0000 7f2987e00640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2964068520 0x7f296406a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.419+0000 7f2987e00640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2964068520 0x7f296406a9e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2978001570 tx=0x7f2978001aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:11.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.423+0000 7f2984c00640 1 -- 172.21.15.106:0/1074765670 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2970056430 con 0x7f298815d080 2024-04-26T21:17:11.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f298806e2a0 con 0x7f298815d080 2024-04-26T21:17:11.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f2984c00640 1 -- 172.21.15.106:0/1074765670 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f297005a730 con 0x7f298815d080 2024-04-26T21:17:11.583 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:11.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2964068520 msgr2=0x7f296406a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2964068520 0x7f296406a9e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2978001570 tx=0x7f2978001aa0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f298815d080 msgr2=0x7f29880c6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f298815d080 0x7f29880c6990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f297000e9d0 tx=0x7f297000ee90 comp rx=0 tx=0).stop 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 shutdown_connections 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2964068520 0x7f296406a9e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298815da80 0x7f29881f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f298815d080 0x7f29880c6990 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 --2- 172.21.15.106:0/1074765670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298815c4e0 0x7f29880c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 >> 172.21.15.106:0/1074765670 conn(0x7f29880b2910 msgr2=0x7f298813a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.579+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 shutdown_connections 2024-04-26T21:17:11.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.583+0000 7f298f000640 1 -- 172.21.15.106:0/1074765670 wait complete. 2024-04-26T21:17:11.603 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:11.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d9fa00640 1 Processor -- start 2024-04-26T21:17:11.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d9fa00640 1 -- start start 2024-04-26T21:17:11.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d9fa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8d9815d080 0x7f8d980b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d9fa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d980b4f00 con 0x7f8d9815c4e0 2024-04-26T21:17:11.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d9fa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d980b51e0 con 0x7f8d9815da80 2024-04-26T21:17:11.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d9fa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f8d9815d5f0 con 0x7f8d9815d080 2024-04-26T21:17:11.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d9d000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8d9815c4e0 0x7f8d9815c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40348/0 (socket says 172.21.15.106:40348) 2024-04-26T21:17:11.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d9d000640 1 -- 172.21.15.106:0/221052303 learned_addr learned my addr 172.21.15.106:0/221052303 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:11.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d97e00640 1 --2- 172.21.15.106:0/221052303 >> v2:172.21.15.106:3300/0 conn(0x7f8d9815d080 0x7f8d980b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d97e00640 1 -- 172.21.15.106:0/221052303 >> v1:172.21.15.112:6789/0 conn(0x7f8d9815da80 legacy=0x7f8d9815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:11.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d97e00640 1 -- 172.21.15.106:0/221052303 >> v1:172.21.15.106:6789/0 conn(0x7f8d9815c4e0 legacy=0x7f8d9815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d97400640 1 -- 172.21.15.106:0/221052303 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121051115 0 0) 0x7f8d980b4f00 con 0x7f8d9815c4e0 2024-04-26T21:17:11.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.739+0000 7f8d97e00640 1 -- 172.21.15.106:0/221052303 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d980b54c0 con 0x7f8d9815d080 2024-04-26T21:17:11.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d97e00640 1 --2- 172.21.15.106:0/221052303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815d080 0x7f8d980b4620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8d840097c0 tx=0x7f8d8401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7224e7a86137ed89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:11.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d97400640 1 -- 172.21.15.106:0/221052303 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d840ab5f0 con 0x7f8d9815d080 2024-04-26T21:17:11.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d97400640 1 -- 172.21.15.106:0/221052303 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d840b0070 con 0x7f8d9815d080 2024-04-26T21:17:11.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d97400640 1 -- 172.21.15.106:0/221052303 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d840ab9b0 con 0x7f8d9815d080 2024-04-26T21:17:11.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d9fa00640 1 -- 172.21.15.106:0/221052303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815d080 msgr2=0x7f8d980b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d9fa00640 1 --2- 172.21.15.106:0/221052303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815d080 0x7f8d980b4620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8d840097c0 tx=0x7f8d8401c430 comp rx=0 tx=0).stop 2024-04-26T21:17:11.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d9fa00640 1 -- 172.21.15.106:0/221052303 shutdown_connections 2024-04-26T21:17:11.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d9fa00640 1 --2- 172.21.15.106:0/221052303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815d080 0x7f8d980b4620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d9fa00640 1 -- 172.21.15.106:0/221052303 >> 172.21.15.106:0/221052303 conn(0x7f8d980b2910 msgr2=0x7f8d980b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:11.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d9fa00640 1 -- 172.21.15.106:0/221052303 shutdown_connections 2024-04-26T21:17:11.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.743+0000 7f8d9fa00640 1 -- 172.21.15.106:0/221052303 wait complete. 2024-04-26T21:17:11.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 Processor -- start 2024-04-26T21:17:11.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 -- start start 2024-04-26T21:17:11.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815c4e0 0x7f8d98153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d9815d080 0x7f8d98155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d9815da80 0x7f8d980d0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98169f50 con 0x7f8d9815c4e0 2024-04-26T21:17:11.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d98169dd0 con 0x7f8d9815d080 2024-04-26T21:17:11.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9816a0d0 con 0x7f8d9815da80 2024-04-26T21:17:11.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815c4e0 0x7f8d98153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815c4e0 0x7f8d98153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55318/0 (socket says 172.21.15.106:55318) 2024-04-26T21:17:11.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9d000640 1 -- 172.21.15.106:0/1878326188 learned_addr learned my addr 172.21.15.106:0/1878326188 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:11.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d97e00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d9815d080 0x7f8d98155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9d000640 1 -- 172.21.15.106:0/1878326188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d9815da80 msgr2=0x7f8d980d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9d000640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d9815da80 0x7f8d980d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9d000640 1 -- 172.21.15.106:0/1878326188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d9815d080 msgr2=0x7f8d98155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9d000640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d9815d080 0x7f8d98155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9d000640 1 -- 172.21.15.106:0/1878326188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d981f8630 con 0x7f8d9815c4e0 2024-04-26T21:17:11.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9d000640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815c4e0 0x7f8d98153a70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8d88001570 tx=0x7f8d8800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:11.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d94c00640 1 -- 172.21.15.106:0/1878326188 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88018070 con 0x7f8d9815c4e0 2024-04-26T21:17:11.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d94c00640 1 -- 172.21.15.106:0/1878326188 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8800a640 con 0x7f8d9815c4e0 2024-04-26T21:17:11.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d981f8910 con 0x7f8d9815c4e0 2024-04-26T21:17:11.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d94c00640 1 -- 172.21.15.106:0/1878326188 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800aa30 con 0x7f8d9815c4e0 2024-04-26T21:17:11.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d981f8ed0 con 0x7f8d9815c4e0 2024-04-26T21:17:11.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.747+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d98069400 con 0x7f8d9815c4e0 2024-04-26T21:17:11.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.751+0000 7f8d94c00640 1 -- 172.21.15.106:0/1878326188 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d8801b070 con 0x7f8d9815c4e0 2024-04-26T21:17:11.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.751+0000 7f8d94c00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8d78068380 0x7f8d7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:11.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.751+0000 7f8d94c00640 1 -- 172.21.15.106:0/1878326188 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f8d88086550 con 0x7f8d9815c4e0 2024-04-26T21:17:11.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.751+0000 7f8d97e00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8d78068380 0x7f8d7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:11.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.751+0000 7f8d97e00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8d78068380 0x7f8d7806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d840af000 tx=0x7f8d84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:11.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.755+0000 7f8d94c00640 1 -- 172.21.15.106:0/1878326188 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8d88056670 con 0x7f8d9815c4e0 2024-04-26T21:17:11.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8d98153fb0 con 0x7f8d9815c4e0 2024-04-26T21:17:11.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d94c00640 1 -- 172.21.15.106:0/1878326188 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f8d88055f70 con 0x7f8d9815c4e0 2024-04-26T21:17:11.913 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:11.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8d78068380 msgr2=0x7f8d7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8d78068380 0x7f8d7806a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d840af000 tx=0x7f8d84008040 comp rx=0 tx=0).stop 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815c4e0 msgr2=0x7f8d98153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815c4e0 0x7f8d98153a70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8d88001570 tx=0x7f8d8800cd20 comp rx=0 tx=0).stop 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 shutdown_connections 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d9815d080 0x7f8d98155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8d78068380 0x7f8d7806a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d9815da80 0x7f8d980d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 --2- 172.21.15.106:0/1878326188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d9815c4e0 0x7f8d98153a70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 >> 172.21.15.106:0/1878326188 conn(0x7f8d980b2910 msgr2=0x7f8d98144d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 shutdown_connections 2024-04-26T21:17:11.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:11.911+0000 7f8d9fa00640 1 -- 172.21.15.106:0/1878326188 wait complete. 2024-04-26T21:17:11.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:17:12.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.067+0000 7fad21a00640 1 Processor -- start 2024-04-26T21:17:12.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.067+0000 7fad21a00640 1 -- start start 2024-04-26T21:17:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad21a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c146490 0x7fad1c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad21a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad1c146870 0x7fad1c0d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad21a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1c0b3da0 con 0x7fad1c160ac0 2024-04-26T21:17:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad21a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c160fa0 con 0x7fad1c146870 2024-04-26T21:17:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad21a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c161280 con 0x7fad1c146490 2024-04-26T21:17:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad1b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad1c146870 0x7fad1c0d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad1a000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fad1c160ac0 0x7fad1c0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40362/0 (socket says 172.21.15.106:40362) 2024-04-26T21:17:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad1a000640 1 -- 172.21.15.106:0/3593844404 learned_addr learned my addr 172.21.15.106:0/3593844404 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad1aa00640 1 --2- 172.21.15.106:0/3593844404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c146490 0x7fad1c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad1b400640 1 -- 172.21.15.106:0/3593844404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c146490 msgr2=0x7fad1c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:12.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad1b400640 1 --2- 172.21.15.106:0/3593844404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c146490 0x7fad1c15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad1b400640 1 -- 172.21.15.106:0/3593844404 >> v1:172.21.15.106:6789/0 conn(0x7fad1c160ac0 legacy=0x7fad1c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad1b400640 1 -- 172.21.15.106:0/3593844404 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c161560 con 0x7fad1c146870 2024-04-26T21:17:12.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad1b400640 1 --2- 172.21.15.106:0/3593844404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146870 0x7fad1c0d0da0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fad140097c0 tx=0x7fad1401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359cb1f22e5b41e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:12.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.071+0000 7fad19600640 1 -- 172.21.15.106:0/3593844404 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140b0070 con 0x7fad1c146870 2024-04-26T21:17:12.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad19600640 1 -- 172.21.15.106:0/3593844404 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad140ab600 con 0x7fad1c146870 2024-04-26T21:17:12.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad19600640 1 -- 172.21.15.106:0/3593844404 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140ab9d0 con 0x7fad1c146870 2024-04-26T21:17:12.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 -- 172.21.15.106:0/3593844404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146870 msgr2=0x7fad1c0d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 --2- 172.21.15.106:0/3593844404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146870 0x7fad1c0d0da0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fad140097c0 tx=0x7fad1401c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 -- 172.21.15.106:0/3593844404 shutdown_connections 2024-04-26T21:17:12.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 --2- 172.21.15.106:0/3593844404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146870 0x7fad1c0d0da0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 --2- 172.21.15.106:0/3593844404 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c146490 0x7fad1c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 -- 172.21.15.106:0/3593844404 >> 172.21.15.106:0/3593844404 conn(0x7fad1c068340 msgr2=0x7fad1c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:12.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 -- 172.21.15.106:0/3593844404 shutdown_connections 2024-04-26T21:17:12.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 -- 172.21.15.106:0/3593844404 wait complete. 2024-04-26T21:17:12.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 Processor -- start 2024-04-26T21:17:12.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 -- start start 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146490 0x7fad1c153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad1c146870 0x7fad1c0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c160ac0 0x7fad1c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0b5150 con 0x7fad1c146490 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0b4fd0 con 0x7fad1c146870 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad21a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c169e60 con 0x7fad1c160ac0 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146490 0x7fad1c153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146490 0x7fad1c153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55322/0 (socket says 172.21.15.106:55322) 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1aa00640 1 -- 172.21.15.106:0/482674123 learned_addr learned my addr 172.21.15.106:0/482674123 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1b400640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c160ac0 0x7fad1c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1a000640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad1c146870 0x7fad1c0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1aa00640 1 -- 172.21.15.106:0/482674123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c160ac0 msgr2=0x7fad1c06ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1aa00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c160ac0 0x7fad1c06ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1aa00640 1 -- 172.21.15.106:0/482674123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad1c146870 msgr2=0x7fad1c0afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1aa00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad1c146870 0x7fad1c0afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1aa00640 1 -- 172.21.15.106:0/482674123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c072ff0 con 0x7fad1c146490 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.075+0000 7fad1a000640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad1c146870 0x7fad1c0afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad1aa00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146490 0x7fad1c153680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007e40 tx=0x7fad0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad12a00640 1 -- 172.21.15.106:0/482674123 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c014620 con 0x7fad1c146490 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad12a00640 1 -- 172.21.15.106:0/482674123 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c019070 con 0x7fad1c146490 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad12a00640 1 -- 172.21.15.106:0/482674123 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c014a00 con 0x7fad1c146490 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c153bc0 con 0x7fad1c146490 2024-04-26T21:17:12.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c15f780 con 0x7fad1c146490 2024-04-26T21:17:12.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c069400 con 0x7fad1c146490 2024-04-26T21:17:12.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad12a00640 1 -- 172.21.15.106:0/482674123 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fad0c014ba0 con 0x7fad1c146490 2024-04-26T21:17:12.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad12a00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7facfc068380 0x7facfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad12a00640 1 -- 172.21.15.106:0/482674123 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fad0c087640 con 0x7fad1c146490 2024-04-26T21:17:12.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.079+0000 7fad1a000640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7facfc068380 0x7facfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.083+0000 7fad1a000640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7facfc068380 0x7facfc06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0d0af0 tx=0x7fad08009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:12.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.083+0000 7fad12a00640 1 -- 172.21.15.106:0/482674123 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fad0c057760 con 0x7fad1c146490 2024-04-26T21:17:12.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.251+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fad1c13fe00 con 0x7fad1c146490 2024-04-26T21:17:12.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.251+0000 7fad12a00640 1 -- 172.21.15.106:0/482674123 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fad0c057060 con 0x7fad1c146490 2024-04-26T21:17:12.255 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7facfc068380 msgr2=0x7facfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7facfc068380 0x7facfc06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0d0af0 tx=0x7fad08009040 comp rx=0 tx=0).stop 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146490 msgr2=0x7fad1c153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146490 0x7fad1c153680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007e40 tx=0x7fad0c00e4b0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 shutdown_connections 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad1c146870 0x7fad1c0afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7facfc068380 0x7facfc06a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad1c160ac0 0x7fad1c06ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 --2- 172.21.15.106:0/482674123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad1c146490 0x7fad1c153680 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 >> 172.21.15.106:0/482674123 conn(0x7fad1c068340 msgr2=0x7fad1c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 shutdown_connections 2024-04-26T21:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.255+0000 7fad21a00640 1 -- 172.21.15.106:0/482674123 wait complete. 2024-04-26T21:17:12.277 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:17:12.277 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:12.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:12.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1f200640 1 Processor -- start 2024-04-26T21:17:12.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1f200640 1 -- start start 2024-04-26T21:17:12.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1f200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc200d1760 0x7fcc200cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1f200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcc200d3560 0x7fcc200cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1f200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc200c67d0 con 0x7fcc2015cfa0 2024-04-26T21:17:12.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1f200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fcc200c6ab0 con 0x7fcc200d3560 2024-04-26T21:17:12.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1f200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcc200c6d90 con 0x7fcc200d1760 2024-04-26T21:17:12.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcc200d3560 0x7fcc200cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcc200d3560 0x7fcc200cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55334/0 (socket says 172.21.15.106:55334) 2024-04-26T21:17:12.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1e800640 1 -- 172.21.15.106:0/681479426 learned_addr learned my addr 172.21.15.106:0/681479426 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:12.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1d400640 1 --2- 172.21.15.106:0/681479426 >> v2:172.21.15.112:3300/0 conn(0x7fcc200d1760 0x7fcc200cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1e800640 1 -- 172.21.15.106:0/681479426 >> v2:172.21.15.112:3300/0 conn(0x7fcc200d1760 msgr2=0x7fcc200cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:12.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1e800640 1 --2- 172.21.15.106:0/681479426 >> v2:172.21.15.112:3300/0 conn(0x7fcc200d1760 0x7fcc200cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1e800640 1 -- 172.21.15.106:0/681479426 >> v1:172.21.15.112:6789/0 conn(0x7fcc2015cfa0 legacy=0x7fcc200d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1ca00640 1 -- 172.21.15.106:0/681479426 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687289329 0 0) 0x7fcc200c67d0 con 0x7fcc2015cfa0 2024-04-26T21:17:12.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.463+0000 7fcc1e800640 1 -- 172.21.15.106:0/681479426 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc200c7070 con 0x7fcc200d3560 2024-04-26T21:17:12.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1e800640 1 --2- 172.21.15.106:0/681479426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d3560 0x7fcc200cf670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcc200b5600 tx=0x7fcc1801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd180027312011d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:12.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1ca00640 1 -- 172.21.15.106:0/681479426 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc180a56c0 con 0x7fcc200d3560 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1ca00640 1 -- 172.21.15.106:0/681479426 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc180a5860 con 0x7fcc200d3560 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1ca00640 1 -- 172.21.15.106:0/681479426 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc180a5c30 con 0x7fcc200d3560 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1f200640 1 -- 172.21.15.106:0/681479426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d3560 msgr2=0x7fcc200cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1f200640 1 --2- 172.21.15.106:0/681479426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d3560 0x7fcc200cf670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcc200b5600 tx=0x7fcc1801c9f0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1f200640 1 -- 172.21.15.106:0/681479426 shutdown_connections 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1f200640 1 --2- 172.21.15.106:0/681479426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d3560 0x7fcc200cf670 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1f200640 1 --2- 172.21.15.106:0/681479426 >> v2:172.21.15.112:3300/0 conn(0x7fcc200d1760 0x7fcc200cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1f200640 1 -- 172.21.15.106:0/681479426 >> 172.21.15.106:0/681479426 conn(0x7fcc200d2a70 msgr2=0x7fcc200d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1f200640 1 -- 172.21.15.106:0/681479426 shutdown_connections 2024-04-26T21:17:12.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.467+0000 7fcc1f200640 1 -- 172.21.15.106:0/681479426 wait complete. 2024-04-26T21:17:12.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 Processor -- start 2024-04-26T21:17:12.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 -- start start 2024-04-26T21:17:12.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d1760 0x7fcc200b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc200d3560 0x7fcc20159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc2015cfa0 0x7fcc2015e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcc200c8130 con 0x7fcc200d1760 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcc200c7fb0 con 0x7fcc2015cfa0 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcc200c82b0 con 0x7fcc200d3560 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d1760 0x7fcc200b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d1760 0x7fcc200b8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55350/0 (socket says 172.21.15.106:55350) 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1de00640 1 -- 172.21.15.106:0/3738351694 learned_addr learned my addr 172.21.15.106:0/3738351694 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1d400640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc200d3560 0x7fcc20159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1e800640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc2015cfa0 0x7fcc2015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1de00640 1 -- 172.21.15.106:0/3738351694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc200d3560 msgr2=0x7fcc20159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1de00640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc200d3560 0x7fcc20159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1de00640 1 -- 172.21.15.106:0/3738351694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc2015cfa0 msgr2=0x7fcc2015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1de00640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc2015cfa0 0x7fcc2015e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1de00640 1 -- 172.21.15.106:0/3738351694 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2015a2e0 con 0x7fcc200d1760 2024-04-26T21:17:12.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1de00640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d1760 0x7fcc200b8150 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc10001ec0 tx=0x7fcc1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:12.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc16000640 1 -- 172.21.15.106:0/3738351694 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10017070 con 0x7fcc200d1760 2024-04-26T21:17:12.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc16000640 1 -- 172.21.15.106:0/3738351694 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc10003600 con 0x7fcc200d1760 2024-04-26T21:17:12.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc16000640 1 -- 172.21.15.106:0/3738351694 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc100039f0 con 0x7fcc200d1760 2024-04-26T21:17:12.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2015a5c0 con 0x7fcc200d1760 2024-04-26T21:17:12.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.471+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2015ab80 con 0x7fcc200d1760 2024-04-26T21:17:12.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.475+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc20069400 con 0x7fcc200d1760 2024-04-26T21:17:12.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.475+0000 7fcc16000640 1 -- 172.21.15.106:0/3738351694 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc1001a070 con 0x7fcc200d1760 2024-04-26T21:17:12.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.475+0000 7fcc16000640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc00068380 0x7fcc0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.475+0000 7fcc16000640 1 -- 172.21.15.106:0/3738351694 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fcc10086180 con 0x7fcc200d1760 2024-04-26T21:17:12.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.475+0000 7fcc1d400640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc00068380 0x7fcc0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.475+0000 7fcc1d400640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc00068380 0x7fcc0006a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcc20074120 tx=0x7fcc0c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:12.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.479+0000 7fcc16000640 1 -- 172.21.15.106:0/3738351694 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcc10055c40 con 0x7fcc200d1760 2024-04-26T21:17:12.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.639+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc200d0e30 con 0x7fcc200d1760 2024-04-26T21:17:12.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.639+0000 7fcc16000640 1 -- 172.21.15.106:0/3738351694 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7fcc10059f40 con 0x7fcc200d1760 2024-04-26T21:17:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:12.644 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc00068380 msgr2=0x7fcc0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc00068380 0x7fcc0006a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcc20074120 tx=0x7fcc0c009190 comp rx=0 tx=0).stop 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d1760 msgr2=0x7fcc200b8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d1760 0x7fcc200b8150 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc10001ec0 tx=0x7fcc1000c8e0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 shutdown_connections 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc2015cfa0 0x7fcc2015e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc00068380 0x7fcc0006a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc200d3560 0x7fcc20159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 --2- 172.21.15.106:0/3738351694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200d1760 0x7fcc200b8150 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 >> 172.21.15.106:0/3738351694 conn(0x7fcc200d2a70 msgr2=0x7fcc200d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 shutdown_connections 2024-04-26T21:17:12.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.643+0000 7fcc1f200640 1 -- 172.21.15.106:0/3738351694 wait complete. 2024-04-26T21:17:12.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:12.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:12.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.799+0000 7f690f000640 1 Processor -- start 2024-04-26T21:17:12.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.799+0000 7f690f000640 1 -- start start 2024-04-26T21:17:12.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690f000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f690815d080 0x7f69080b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690f000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f690815da80 0x7f690815df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690f000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69080b4f00 con 0x7f690815c4e0 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690f000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f690815d5f0 con 0x7f690815da80 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690f000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f69080b51e0 con 0x7f690815d080 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f690815da80 0x7f690815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f690815da80 0x7f690815df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55352/0 (socket says 172.21.15.106:55352) 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690d000640 1 -- 172.21.15.106:0/3628112011 learned_addr learned my addr 172.21.15.106:0/3628112011 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f68ff400640 1 --2- 172.21.15.106:0/3628112011 >> v2:172.21.15.112:3300/0 conn(0x7f690815d080 0x7f69080b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690d000640 1 -- 172.21.15.106:0/3628112011 >> v2:172.21.15.112:3300/0 conn(0x7f690815d080 msgr2=0x7f69080b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690d000640 1 --2- 172.21.15.106:0/3628112011 >> v2:172.21.15.112:3300/0 conn(0x7f690815d080 0x7f69080b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690d000640 1 -- 172.21.15.106:0/3628112011 >> v1:172.21.15.112:6789/0 conn(0x7f690815c4e0 legacy=0x7f690815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:12.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690d000640 1 -- 172.21.15.106:0/3628112011 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69080b54c0 con 0x7f690815da80 2024-04-26T21:17:12.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.803+0000 7f690d000640 1 --2- 172.21.15.106:0/3628112011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815da80 0x7f690815df10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6908074860 tx=0x7f690001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfd1358ec0fec34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:12.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f6907400640 1 -- 172.21.15.106:0/3628112011 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000a5800 con 0x7f690815da80 2024-04-26T21:17:12.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f6907400640 1 -- 172.21.15.106:0/3628112011 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69000a59a0 con 0x7f690815da80 2024-04-26T21:17:12.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f6907400640 1 -- 172.21.15.106:0/3628112011 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000a5d70 con 0x7f690815da80 2024-04-26T21:17:12.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 -- 172.21.15.106:0/3628112011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815da80 msgr2=0x7f690815df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 --2- 172.21.15.106:0/3628112011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815da80 0x7f690815df10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6908074860 tx=0x7f690001c980 comp rx=0 tx=0).stop 2024-04-26T21:17:12.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 -- 172.21.15.106:0/3628112011 shutdown_connections 2024-04-26T21:17:12.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 --2- 172.21.15.106:0/3628112011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815da80 0x7f690815df10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 --2- 172.21.15.106:0/3628112011 >> v2:172.21.15.112:3300/0 conn(0x7f690815d080 0x7f69080b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 -- 172.21.15.106:0/3628112011 >> 172.21.15.106:0/3628112011 conn(0x7f69080b2910 msgr2=0x7f69080b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:12.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 -- 172.21.15.106:0/3628112011 shutdown_connections 2024-04-26T21:17:12.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 -- 172.21.15.106:0/3628112011 wait complete. 2024-04-26T21:17:12.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 Processor -- start 2024-04-26T21:17:12.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 -- start start 2024-04-26T21:17:12.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815c4e0 0x7f690815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f690815d080 0x7f69081333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f690815da80 0x7f690806e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6908168f40 con 0x7f690815c4e0 2024-04-26T21:17:12.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6908168dc0 con 0x7f690815da80 2024-04-26T21:17:12.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f690f000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f69081690c0 con 0x7f690815d080 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.807+0000 7f6907e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815c4e0 0x7f690815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6907e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815c4e0 0x7f690815b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55354/0 (socket says 172.21.15.106:55354) 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6907e00640 1 -- 172.21.15.106:0/562512085 learned_addr learned my addr 172.21.15.106:0/562512085 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f68ff400640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f690815d080 0x7f69081333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f690d000640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f690815da80 0x7f690806e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6907e00640 1 -- 172.21.15.106:0/562512085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f690815d080 msgr2=0x7f69081333c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6907e00640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f690815d080 0x7f69081333c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6907e00640 1 -- 172.21.15.106:0/562512085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f690815da80 msgr2=0x7f690806e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6907e00640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f690815da80 0x7f690806e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6907e00640 1 -- 172.21.15.106:0/562512085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6908131d60 con 0x7f690815c4e0 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6907e00640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815c4e0 0x7f690815b890 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f68f800b410 tx=0x7f68f800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:12.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6904c00640 1 -- 172.21.15.106:0/562512085 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8015030 con 0x7f690815c4e0 2024-04-26T21:17:12.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6904c00640 1 -- 172.21.15.106:0/562512085 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f8004020 con 0x7f690815c4e0 2024-04-26T21:17:12.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6904c00640 1 -- 172.21.15.106:0/562512085 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8004450 con 0x7f690815c4e0 2024-04-26T21:17:12.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6908132040 con 0x7f690815c4e0 2024-04-26T21:17:12.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6908132600 con 0x7f690815c4e0 2024-04-26T21:17:12.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6908069400 con 0x7f690815c4e0 2024-04-26T21:17:12.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6904c00640 1 -- 172.21.15.106:0/562512085 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f68f8018070 con 0x7f690815c4e0 2024-04-26T21:17:12.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6904c00640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f68e4068380 0x7f68e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:12.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.811+0000 7f6904c00640 1 -- 172.21.15.106:0/562512085 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f68f80867a0 con 0x7f690815c4e0 2024-04-26T21:17:12.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.815+0000 7f68ff400640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f68e4068380 0x7f68e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:12.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.815+0000 7f68ff400640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f68e4068380 0x7f68e406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69081452a0 tx=0x7f68f0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:12.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.815+0000 7f6904c00640 1 -- 172.21.15.106:0/562512085 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f68f8056310 con 0x7f690815c4e0 2024-04-26T21:17:12.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.975+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f690806fb90 con 0x7f690815c4e0 2024-04-26T21:17:12.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.975+0000 7f6904c00640 1 -- 172.21.15.106:0/562512085 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f68f805a610 con 0x7f690815c4e0 2024-04-26T21:17:12.979 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:12.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f68e4068380 msgr2=0x7f68e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f68e4068380 0x7f68e406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69081452a0 tx=0x7f68f0008040 comp rx=0 tx=0).stop 2024-04-26T21:17:12.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815c4e0 msgr2=0x7f690815b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:12.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815c4e0 0x7f690815b890 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f68f800b410 tx=0x7f68f800b8d0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 shutdown_connections 2024-04-26T21:17:12.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f690815da80 0x7f690806e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f68e4068380 0x7f68e406a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f690815d080 0x7f69081333c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 --2- 172.21.15.106:0/562512085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f690815c4e0 0x7f690815b890 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:12.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 >> 172.21.15.106:0/562512085 conn(0x7f69080b2910 msgr2=0x7f690813acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:12.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 shutdown_connections 2024-04-26T21:17:12.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:12.979+0000 7f690f000640 1 -- 172.21.15.106:0/562512085 wait complete. 2024-04-26T21:17:13.000 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:13.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce68400640 1 Processor -- start 2024-04-26T21:17:13.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce68400640 1 -- start start 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce68400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce6015c4e0 0x7fce6015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce68400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce6015da80 0x7fce6015df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce68400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6015ce00 con 0x7fce6015d080 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce68400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fce6015d5f0 con 0x7fce6015da80 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce68400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fce600b4f00 con 0x7fce6015c4e0 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce66400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce6015da80 0x7fce6015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce66400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce6015da80 0x7fce6015df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55368/0 (socket says 172.21.15.106:55368) 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce66400640 1 -- 172.21.15.106:0/1308083602 learned_addr learned my addr 172.21.15.106:0/1308083602 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce65a00640 1 --2- 172.21.15.106:0/1308083602 >> v2:172.21.15.112:3300/0 conn(0x7fce6015c4e0 0x7fce6015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce66400640 1 -- 172.21.15.106:0/1308083602 >> v2:172.21.15.112:3300/0 conn(0x7fce6015c4e0 msgr2=0x7fce6015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce66400640 1 --2- 172.21.15.106:0/1308083602 >> v2:172.21.15.112:3300/0 conn(0x7fce6015c4e0 0x7fce6015c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce66400640 1 -- 172.21.15.106:0/1308083602 >> v1:172.21.15.112:6789/0 conn(0x7fce6015d080 legacy=0x7fce600b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce66400640 1 -- 172.21.15.106:0/1308083602 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce600b51e0 con 0x7fce6015da80 2024-04-26T21:17:13.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.135+0000 7fce65a00640 1 --2- 172.21.15.106:0/1308083602 >> v2:172.21.15.112:3300/0 conn(0x7fce6015c4e0 0x7fce6015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:13.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce66400640 1 --2- 172.21.15.106:0/1308083602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015da80 0x7fce6015df10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fce60070310 tx=0x7fce5801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1cc9ac87865045 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:13.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce5fe00640 1 -- 172.21.15.106:0/1308083602 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce580a57a0 con 0x7fce6015da80 2024-04-26T21:17:13.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce5fe00640 1 -- 172.21.15.106:0/1308083602 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce580a5940 con 0x7fce6015da80 2024-04-26T21:17:13.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce5fe00640 1 -- 172.21.15.106:0/1308083602 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce580a5d10 con 0x7fce6015da80 2024-04-26T21:17:13.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce68400640 1 -- 172.21.15.106:0/1308083602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015da80 msgr2=0x7fce6015df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce68400640 1 --2- 172.21.15.106:0/1308083602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015da80 0x7fce6015df10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fce60070310 tx=0x7fce5801c9f0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce68400640 1 -- 172.21.15.106:0/1308083602 shutdown_connections 2024-04-26T21:17:13.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce68400640 1 --2- 172.21.15.106:0/1308083602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015da80 0x7fce6015df10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce68400640 1 --2- 172.21.15.106:0/1308083602 >> v2:172.21.15.112:3300/0 conn(0x7fce6015c4e0 0x7fce6015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce68400640 1 -- 172.21.15.106:0/1308083602 >> 172.21.15.106:0/1308083602 conn(0x7fce600b2910 msgr2=0x7fce600b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce68400640 1 -- 172.21.15.106:0/1308083602 shutdown_connections 2024-04-26T21:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.139+0000 7fce68400640 1 -- 172.21.15.106:0/1308083602 wait complete. 2024-04-26T21:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 Processor -- start 2024-04-26T21:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 -- start start 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015c4e0 0x7fce60141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce6015d080 0x7fce600736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce6015da80 0x7fce601648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fce60166f30 con 0x7fce6015c4e0 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce60166db0 con 0x7fce6015da80 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fce601670b0 con 0x7fce6015d080 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015c4e0 0x7fce60141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015c4e0 0x7fce60141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55378/0 (socket says 172.21.15.106:55378) 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65a00640 1 -- 172.21.15.106:0/505927976 learned_addr learned my addr 172.21.15.106:0/505927976 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce66400640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce6015da80 0x7fce601648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65000640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce6015d080 0x7fce600736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65a00640 1 -- 172.21.15.106:0/505927976 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce6015d080 msgr2=0x7fce600736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65a00640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce6015d080 0x7fce600736b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65a00640 1 -- 172.21.15.106:0/505927976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce6015da80 msgr2=0x7fce601648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65a00640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce6015da80 0x7fce601648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65a00640 1 -- 172.21.15.106:0/505927976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6012dfe0 con 0x7fce6015c4e0 2024-04-26T21:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce65a00640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015c4e0 0x7fce60141fe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fce5400e810 tx=0x7fce5400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce5d600640 1 -- 172.21.15.106:0/505927976 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54017070 con 0x7fce6015c4e0 2024-04-26T21:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce5d600640 1 -- 172.21.15.106:0/505927976 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5400c8d0 con 0x7fce6015c4e0 2024-04-26T21:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce5d600640 1 -- 172.21.15.106:0/505927976 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5400f040 con 0x7fce6015c4e0 2024-04-26T21:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6012e2c0 con 0x7fce6015c4e0 2024-04-26T21:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6012e880 con 0x7fce6015c4e0 2024-04-26T21:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.143+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce60069400 con 0x7fce6015c4e0 2024-04-26T21:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.147+0000 7fce5d600640 1 -- 172.21.15.106:0/505927976 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce5401a070 con 0x7fce6015c4e0 2024-04-26T21:17:13.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.147+0000 7fce5d600640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce40068380 0x7fce4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.147+0000 7fce5d600640 1 -- 172.21.15.106:0/505927976 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fce54086a00 con 0x7fce6015c4e0 2024-04-26T21:17:13.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.147+0000 7fce65000640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce40068380 0x7fce4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.147+0000 7fce65000640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce40068380 0x7fce4006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce601417b0 tx=0x7fce4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:13.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.151+0000 7fce5d600640 1 -- 172.21.15.106:0/505927976 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fce540564d0 con 0x7fce6015c4e0 2024-04-26T21:17:13.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fce6006e2a0 con 0x7fce6015c4e0 2024-04-26T21:17:13.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce5d600640 1 -- 172.21.15.106:0/505927976 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fce5405a7d0 con 0x7fce6015c4e0 2024-04-26T21:17:13.309 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:13.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce40068380 msgr2=0x7fce4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce40068380 0x7fce4006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce601417b0 tx=0x7fce4c009040 comp rx=0 tx=0).stop 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015c4e0 msgr2=0x7fce60141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015c4e0 0x7fce60141fe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fce5400e810 tx=0x7fce5400ecd0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 shutdown_connections 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce6015da80 0x7fce601648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce40068380 0x7fce4006a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce6015d080 0x7fce600736b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 --2- 172.21.15.106:0/505927976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce6015c4e0 0x7fce60141fe0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 >> 172.21.15.106:0/505927976 conn(0x7fce600b2910 msgr2=0x7fce600ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 shutdown_connections 2024-04-26T21:17:13.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.307+0000 7fce68400640 1 -- 172.21.15.106:0/505927976 wait complete. 2024-04-26T21:17:13.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:13.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.463+0000 7f04cc800640 1 Processor -- start 2024-04-26T21:17:13.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.463+0000 7f04cc800640 1 -- start start 2024-04-26T21:17:13.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04cc800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f04c415d530 0x7f04c40cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04cc800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c40b5260 0x7f04c40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04cc800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04c40b44a0 con 0x7f04c415d910 2024-04-26T21:17:13.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04cc800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f04c40b4780 con 0x7f04c415d530 2024-04-26T21:17:13.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04cc800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f04c40b4a60 con 0x7f04c40b5260 2024-04-26T21:17:13.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04c9e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f04c415d530 0x7f04c40cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04c9e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f04c415d530 0x7f04c40cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55390/0 (socket says 172.21.15.106:55390) 2024-04-26T21:17:13.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04c9e00640 1 -- 172.21.15.106:0/3888044334 learned_addr learned my addr 172.21.15.106:0/3888044334 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:13.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04c9400640 1 --2- 172.21.15.106:0/3888044334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c40b5260 0x7f04c40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04c9e00640 1 -- 172.21.15.106:0/3888044334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c40b5260 msgr2=0x7f04c40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:13.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04c9e00640 1 --2- 172.21.15.106:0/3888044334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c40b5260 0x7f04c40d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04c9e00640 1 -- 172.21.15.106:0/3888044334 >> v1:172.21.15.112:6789/0 conn(0x7f04c415d910 legacy=0x7f04c415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.467+0000 7f04c9e00640 1 -- 172.21.15.106:0/3888044334 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c40b4d40 con 0x7f04c415d530 2024-04-26T21:17:13.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04c9e00640 1 --2- 172.21.15.106:0/3888044334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c415d530 0x7f04c40cfe20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009870 tx=0x7f04b801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5825352c852a86e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:13.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04c8a00640 1 -- 172.21.15.106:0/3888044334 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b80ab610 con 0x7f04c415d530 2024-04-26T21:17:13.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04c8a00640 1 -- 172.21.15.106:0/3888044334 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b80b0070 con 0x7f04c415d530 2024-04-26T21:17:13.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04c8a00640 1 -- 172.21.15.106:0/3888044334 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b80ab9d0 con 0x7f04c415d530 2024-04-26T21:17:13.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 -- 172.21.15.106:0/3888044334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c415d530 msgr2=0x7f04c40cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 --2- 172.21.15.106:0/3888044334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c415d530 0x7f04c40cfe20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009870 tx=0x7f04b801c560 comp rx=0 tx=0).stop 2024-04-26T21:17:13.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 -- 172.21.15.106:0/3888044334 shutdown_connections 2024-04-26T21:17:13.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 --2- 172.21.15.106:0/3888044334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c40b5260 0x7f04c40d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 --2- 172.21.15.106:0/3888044334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c415d530 0x7f04c40cfe20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 -- 172.21.15.106:0/3888044334 >> 172.21.15.106:0/3888044334 conn(0x7f04c40b2910 msgr2=0x7f04c40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:13.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 -- 172.21.15.106:0/3888044334 shutdown_connections 2024-04-26T21:17:13.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 -- 172.21.15.106:0/3888044334 wait complete. 2024-04-26T21:17:13.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 Processor -- start 2024-04-26T21:17:13.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.471+0000 7f04cc800640 1 -- start start 2024-04-26T21:17:13.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04cc800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c40b5260 0x7f04c4145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04cc800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c415d530 0x7f04c4156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04cc800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c415d910 0x7f04c412e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04cc800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f04c4169690 con 0x7f04c40b5260 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04cc800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f04c4169510 con 0x7f04c415d530 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04cc800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f04c4169810 con 0x7f04c415d910 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c40b5260 0x7f04c4145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c40b5260 0x7f04c4145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55392/0 (socket says 172.21.15.106:55392) 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9e00640 1 -- 172.21.15.106:0/3030971591 learned_addr learned my addr 172.21.15.106:0/3030971591 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9400640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c415d530 0x7f04c4156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04ca800640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c415d910 0x7f04c412e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9e00640 1 -- 172.21.15.106:0/3030971591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c415d910 msgr2=0x7f04c412e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9e00640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c415d910 0x7f04c412e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9e00640 1 -- 172.21.15.106:0/3030971591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c415d530 msgr2=0x7f04c4156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9e00640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c415d530 0x7f04c4156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9e00640 1 -- 172.21.15.106:0/3030971591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c4156ea0 con 0x7f04c40b5260 2024-04-26T21:17:13.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04c9e00640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c40b5260 0x7f04c4145790 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04b80ad040 tx=0x7f04b801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:13.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04be000640 1 -- 172.21.15.106:0/3030971591 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b80be5f0 con 0x7f04c40b5260 2024-04-26T21:17:13.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04be000640 1 -- 172.21.15.106:0/3030971591 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b80be790 con 0x7f04c40b5260 2024-04-26T21:17:13.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04be000640 1 -- 172.21.15.106:0/3030971591 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b80beb80 con 0x7f04c40b5260 2024-04-26T21:17:13.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c4157180 con 0x7f04c40b5260 2024-04-26T21:17:13.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c412af00 con 0x7f04c40b5260 2024-04-26T21:17:13.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c4069400 con 0x7f04c40b5260 2024-04-26T21:17:13.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.475+0000 7f04be000640 1 -- 172.21.15.106:0/3030971591 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04b80b43f0 con 0x7f04c40b5260 2024-04-26T21:17:13.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.479+0000 7f04be000640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f04a8068380 0x7f04a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.479+0000 7f04be000640 1 -- 172.21.15.106:0/3030971591 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f04b8121740 con 0x7f04c40b5260 2024-04-26T21:17:13.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.479+0000 7f04c9400640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f04a8068380 0x7f04a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.479+0000 7f04c9400640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f04a8068380 0x7f04a806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f04c415ad20 tx=0x7f04b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:13.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.483+0000 7f04be000640 1 -- 172.21.15.106:0/3030971591 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f04b80a8050 con 0x7f04c40b5260 2024-04-26T21:17:13.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f04c412acd0 con 0x7f04c40b5260 2024-04-26T21:17:13.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04be000640 1 -- 172.21.15.106:0/3030971591 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f04b8016150 con 0x7f04c40b5260 2024-04-26T21:17:13.645 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:13.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f04a8068380 msgr2=0x7f04a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f04a8068380 0x7f04a806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f04c415ad20 tx=0x7f04b4008040 comp rx=0 tx=0).stop 2024-04-26T21:17:13.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c40b5260 msgr2=0x7f04c4145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c40b5260 0x7f04c4145790 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04b80ad040 tx=0x7f04b801ada0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 shutdown_connections 2024-04-26T21:17:13.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04c415d530 0x7f04c4156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f04a8068380 0x7f04a806a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04c415d910 0x7f04c412e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 --2- 172.21.15.106:0/3030971591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c40b5260 0x7f04c4145790 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 >> 172.21.15.106:0/3030971591 conn(0x7f04c40b2910 msgr2=0x7f04c415fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:13.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 shutdown_connections 2024-04-26T21:17:13.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.643+0000 7f04cc800640 1 -- 172.21.15.106:0/3030971591 wait complete. 2024-04-26T21:17:13.667 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:13.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.799+0000 7f149f400640 1 Processor -- start 2024-04-26T21:17:13.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.799+0000 7f149f400640 1 -- start start 2024-04-26T21:17:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f149f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 0x7f149806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f149f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f149815f950 0x7f14980d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f149f400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14980b4e50 con 0x7f14980d1840 2024-04-26T21:17:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f149f400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f14980cdee0 con 0x7f149815f950 2024-04-26T21:17:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f149f400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f14980704b0 con 0x7f149815b570 2024-04-26T21:17:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f1497e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f149815f950 0x7f14980d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f1497e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f149815f950 0x7f14980d1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55398/0 (socket says 172.21.15.106:55398) 2024-04-26T21:17:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f1497e00640 1 -- 172.21.15.106:0/2376120220 learned_addr learned my addr 172.21.15.106:0/2376120220 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f149ca00640 1 --2- 172.21.15.106:0/2376120220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 0x7f149806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f1497e00640 1 -- 172.21.15.106:0/2376120220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 msgr2=0x7f149806ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:13.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f1497e00640 1 --2- 172.21.15.106:0/2376120220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 0x7f149806ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f1497e00640 1 -- 172.21.15.106:0/2376120220 >> v1:172.21.15.112:6789/0 conn(0x7f14980d1840 legacy=0x7f149815bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.803+0000 7f1497e00640 1 -- 172.21.15.106:0/2376120220 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14980b50f0 con 0x7f149815f950 2024-04-26T21:17:13.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f1497e00640 1 --2- 172.21.15.106:0/2376120220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149815f950 0x7f14980d1300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f14980b5020 tx=0x7f148401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3b3d8e0da5386 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:13.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f1497400640 1 -- 172.21.15.106:0/2376120220 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14840b5070 con 0x7f149815f950 2024-04-26T21:17:13.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f1497400640 1 -- 172.21.15.106:0/2376120220 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14840a8a30 con 0x7f149815f950 2024-04-26T21:17:13.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f1497400640 1 -- 172.21.15.106:0/2376120220 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14840a8e00 con 0x7f149815f950 2024-04-26T21:17:13.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 -- 172.21.15.106:0/2376120220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149815f950 msgr2=0x7f14980d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 --2- 172.21.15.106:0/2376120220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149815f950 0x7f14980d1300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f14980b5020 tx=0x7f148401ed30 comp rx=0 tx=0).stop 2024-04-26T21:17:13.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 -- 172.21.15.106:0/2376120220 shutdown_connections 2024-04-26T21:17:13.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 --2- 172.21.15.106:0/2376120220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149815f950 0x7f14980d1300 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 --2- 172.21.15.106:0/2376120220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 0x7f149806ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 -- 172.21.15.106:0/2376120220 >> 172.21.15.106:0/2376120220 conn(0x7f149806c400 msgr2=0x7f149806c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:13.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 -- 172.21.15.106:0/2376120220 shutdown_connections 2024-04-26T21:17:13.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 -- 172.21.15.106:0/2376120220 wait complete. 2024-04-26T21:17:13.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 Processor -- start 2024-04-26T21:17:13.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.807+0000 7f149f400640 1 -- start start 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980d1840 0x7f149814c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 0x7f149815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149815f950 0x7f149815c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149f400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1498070140 con 0x7f14980d1840 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149f400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f149806fe60 con 0x7f149815f950 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149f400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f149815fdb0 con 0x7f149815b570 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980d1840 0x7f149814c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980d1840 0x7f149814c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55412/0 (socket says 172.21.15.106:55412) 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149ca00640 1 -- 172.21.15.106:0/3927229462 learned_addr learned my addr 172.21.15.106:0/3927229462 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f1497e00640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 0x7f149815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149d400640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149815f950 0x7f149815c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149ca00640 1 -- 172.21.15.106:0/3927229462 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 msgr2=0x7f149815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149ca00640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 0x7f149815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149ca00640 1 -- 172.21.15.106:0/3927229462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149815f950 msgr2=0x7f149815c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149ca00640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149815f950 0x7f149815c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149ca00640 1 -- 172.21.15.106:0/3927229462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14980cf0b0 con 0x7f14980d1840 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149ca00640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980d1840 0x7f149814c7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f148c00d800 tx=0x7f148c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f1494c00640 1 -- 172.21.15.106:0/3927229462 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c00b6c0 con 0x7f14980d1840 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f1494c00640 1 -- 172.21.15.106:0/3927229462 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f148c019070 con 0x7f14980d1840 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f1494c00640 1 -- 172.21.15.106:0/3927229462 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c00ba60 con 0x7f14980d1840 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14980cf390 con 0x7f14980d1840 2024-04-26T21:17:13.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14980cf950 con 0x7f14980d1840 2024-04-26T21:17:13.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1498069400 con 0x7f14980d1840 2024-04-26T21:17:13.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.811+0000 7f1494c00640 1 -- 172.21.15.106:0/3927229462 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f148c00bc00 con 0x7f14980d1840 2024-04-26T21:17:13.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.815+0000 7f1494c00640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1478068380 0x7f147806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:13.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.815+0000 7f1494c00640 1 -- 172.21.15.106:0/3927229462 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f148c0871e0 con 0x7f14980d1840 2024-04-26T21:17:13.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.815+0000 7f1497e00640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1478068380 0x7f147806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:13.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.815+0000 7f1497e00640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1478068380 0x7f147806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f14840b2000 tx=0x7f1484009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:13.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.819+0000 7f1494c00640 1 -- 172.21.15.106:0/3927229462 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f148c056cb0 con 0x7f14980d1840 2024-04-26T21:17:13.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f14980d2190 con 0x7f14980d1840 2024-04-26T21:17:13.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f1494c00640 1 -- 172.21.15.106:0/3927229462 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f148c05afb0 con 0x7f14980d1840 2024-04-26T21:17:13.978 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1478068380 msgr2=0x7f147806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1478068380 0x7f147806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f14840b2000 tx=0x7f1484009040 comp rx=0 tx=0).stop 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980d1840 msgr2=0x7f149814c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980d1840 0x7f149814c7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f148c00d800 tx=0x7f148c00dcc0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 shutdown_connections 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149815f950 0x7f149815c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1478068380 0x7f147806a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149815b570 0x7f149815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 --2- 172.21.15.106:0/3927229462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980d1840 0x7f149814c7a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:13.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 >> 172.21.15.106:0/3927229462 conn(0x7f149806c400 msgr2=0x7f149815a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:13.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 shutdown_connections 2024-04-26T21:17:13.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:13.975+0000 7f149f400640 1 -- 172.21.15.106:0/3927229462 wait complete. 2024-04-26T21:17:13.999 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:17:14.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.131+0000 7ff274600640 1 Processor -- start 2024-04-26T21:17:14.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.131+0000 7ff274600640 1 -- start start 2024-04-26T21:17:14.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.131+0000 7ff274600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff26c146490 0x7ff26c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.131+0000 7ff274600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c160ac0 0x7ff26c0cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.131+0000 7ff274600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff26c0cf730 con 0x7ff26c146870 2024-04-26T21:17:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.131+0000 7ff274600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff26c0b3da0 con 0x7ff26c146490 2024-04-26T21:17:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.131+0000 7ff274600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff26c160fa0 con 0x7ff26c160ac0 2024-04-26T21:17:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.135+0000 7ff271200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c160ac0 0x7ff26c0cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.135+0000 7ff271c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff26c146490 0x7ff26c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.135+0000 7ff272600640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff26c146870 0x7ff26c0d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:42326/0 (socket says 172.21.15.106:42326) 2024-04-26T21:17:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.135+0000 7ff272600640 1 -- 172.21.15.106:0/2849574773 learned_addr learned my addr 172.21.15.106:0/2849574773 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.135+0000 7ff271200640 1 -- 172.21.15.106:0/2849574773 >> v2:172.21.15.112:3300/0 conn(0x7ff26c146490 msgr2=0x7ff26c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:14.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.135+0000 7ff271200640 1 --2- 172.21.15.106:0/2849574773 >> v2:172.21.15.112:3300/0 conn(0x7ff26c146490 0x7ff26c15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.135+0000 7ff271200640 1 -- 172.21.15.106:0/2849574773 >> v1:172.21.15.112:6789/0 conn(0x7ff26c146870 legacy=0x7ff26c0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.135+0000 7ff271200640 1 -- 172.21.15.106:0/2849574773 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c161280 con 0x7ff26c160ac0 2024-04-26T21:17:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.135+0000 7ff271200640 1 --2- 172.21.15.106:0/2849574773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c160ac0 0x7ff26c0cf1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff2580097c0 tx=0x7ff25801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba29304963a05de4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff26be00640 1 -- 172.21.15.106:0/2849574773 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2580b2070 con 0x7ff26c160ac0 2024-04-26T21:17:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff26be00640 1 -- 172.21.15.106:0/2849574773 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2580ad640 con 0x7ff26c160ac0 2024-04-26T21:17:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff26be00640 1 -- 172.21.15.106:0/2849574773 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2580ada10 con 0x7ff26c160ac0 2024-04-26T21:17:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 -- 172.21.15.106:0/2849574773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c160ac0 msgr2=0x7ff26c0cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 --2- 172.21.15.106:0/2849574773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c160ac0 0x7ff26c0cf1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff2580097c0 tx=0x7ff25801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 -- 172.21.15.106:0/2849574773 shutdown_connections 2024-04-26T21:17:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 --2- 172.21.15.106:0/2849574773 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c160ac0 0x7ff26c0cf1f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 --2- 172.21.15.106:0/2849574773 >> v2:172.21.15.112:3300/0 conn(0x7ff26c146490 0x7ff26c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 -- 172.21.15.106:0/2849574773 >> 172.21.15.106:0/2849574773 conn(0x7ff26c068340 msgr2=0x7ff26c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:14.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 -- 172.21.15.106:0/2849574773 shutdown_connections 2024-04-26T21:17:14.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 -- 172.21.15.106:0/2849574773 wait complete. 2024-04-26T21:17:14.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 Processor -- start 2024-04-26T21:17:14.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 -- start start 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c146490 0x7ff26c1631d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff26c146870 0x7ff26c141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c160ac0 0x7ff26c1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c0d1630 con 0x7ff26c160ac0 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c0d14b0 con 0x7ff26c146870 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff274600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff26c0b4dc0 con 0x7ff26c146490 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff272600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c160ac0 0x7ff26c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff272600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c160ac0 0x7ff26c1441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55428/0 (socket says 172.21.15.106:55428) 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff272600640 1 -- 172.21.15.106:0/2014064225 learned_addr learned my addr 172.21.15.106:0/2014064225 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:14.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff271c00640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c146490 0x7ff26c1631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.139+0000 7ff271200640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff26c146870 0x7ff26c141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff272600640 1 -- 172.21.15.106:0/2014064225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c146490 msgr2=0x7ff26c1631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff272600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c146490 0x7ff26c1631d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff272600640 1 -- 172.21.15.106:0/2014064225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff26c146870 msgr2=0x7ff26c141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff272600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff26c146870 0x7ff26c141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff272600640 1 -- 172.21.15.106:0/2014064225 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c141d60 con 0x7ff26c160ac0 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff272600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c160ac0 0x7ff26c1441e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff26400caf0 tx=0x7ff26400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff269600640 1 -- 172.21.15.106:0/2014064225 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264017070 con 0x7ff26c160ac0 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff269600640 1 -- 172.21.15.106:0/2014064225 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff26400aca0 con 0x7ff26c160ac0 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff269600640 1 -- 172.21.15.106:0/2014064225 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264012600 con 0x7ff26c160ac0 2024-04-26T21:17:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26c142220 con 0x7ff26c160ac0 2024-04-26T21:17:14.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26c163dd0 con 0x7ff26c160ac0 2024-04-26T21:17:14.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26c069400 con 0x7ff26c160ac0 2024-04-26T21:17:14.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff269600640 1 -- 172.21.15.106:0/2014064225 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff26401a070 con 0x7ff26c160ac0 2024-04-26T21:17:14.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff269600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff24c0683b0 0x7ff24c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff269600640 1 -- 172.21.15.106:0/2014064225 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7ff264086a60 con 0x7ff26c160ac0 2024-04-26T21:17:14.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.143+0000 7ff271c00640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff24c0683b0 0x7ff24c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.147+0000 7ff271c00640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff24c0683b0 0x7ff24c06a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff260009b60 tx=0x7ff260009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:14.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.147+0000 7ff269600640 1 -- 172.21.15.106:0/2014064225 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff26c0cf730 con 0x7ff26c160ac0 2024-04-26T21:17:14.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.315+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff26c167c30 con 0x7ff26c160ac0 2024-04-26T21:17:14.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.315+0000 7ff269600640 1 -- 172.21.15.106:0/2014064225 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7ff264056530 con 0x7ff26c160ac0 2024-04-26T21:17:14.320 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:17:14.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff24c0683b0 msgr2=0x7ff24c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff24c0683b0 0x7ff24c06a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff260009b60 tx=0x7ff260009190 comp rx=0 tx=0).stop 2024-04-26T21:17:14.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c160ac0 msgr2=0x7ff26c1441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c160ac0 0x7ff26c1441e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff26400caf0 tx=0x7ff26400a060 comp rx=0 tx=0).stop 2024-04-26T21:17:14.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 shutdown_connections 2024-04-26T21:17:14.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff26c146870 0x7ff26c141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff24c0683b0 0x7ff24c06a870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c160ac0 0x7ff26c1441e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 --2- 172.21.15.106:0/2014064225 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff26c146490 0x7ff26c1631d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 >> 172.21.15.106:0/2014064225 conn(0x7ff26c068340 msgr2=0x7ff26c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:14.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 shutdown_connections 2024-04-26T21:17:14.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.319+0000 7ff274600640 1 -- 172.21.15.106:0/2014064225 wait complete. 2024-04-26T21:17:14.341 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi106.front.sepia.ceph.com... 2024-04-26T21:17:14.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:14.341 DEBUG:teuthology.orchestra.run.smithi106:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T21:17:14.361 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:17:14.361 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:17:14.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:14.361 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T21:17:14.412 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:17:14.412 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:14.422 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:17:14.422 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:14.475 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:14.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c10e00640 1 Processor -- start 2024-04-26T21:17:14.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c10e00640 1 -- start start 2024-04-26T21:17:14.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c10e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c0c145e20 0x7f8c0c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c10e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c0c146290 0x7f8c0c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c10e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0c0b12b0 con 0x7f8c0c06c400 2024-04-26T21:17:14.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c10e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f8c0c0af2e0 con 0x7f8c0c145e20 2024-04-26T21:17:14.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c10e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8c0c0b1590 con 0x7f8c0c146290 2024-04-26T21:17:14.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c09e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c0c145e20 0x7f8c0c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c09e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c0c145e20 0x7f8c0c070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55444/0 (socket says 172.21.15.106:55444) 2024-04-26T21:17:14.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c09e00640 1 -- 172.21.15.106:0/907840312 learned_addr learned my addr 172.21.15.106:0/907840312 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:14.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c09400640 1 --2- 172.21.15.106:0/907840312 >> v2:172.21.15.112:3300/0 conn(0x7f8c0c146290 0x7f8c0c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c09e00640 1 -- 172.21.15.106:0/907840312 >> v2:172.21.15.112:3300/0 conn(0x7f8c0c146290 msgr2=0x7f8c0c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:14.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c09e00640 1 --2- 172.21.15.106:0/907840312 >> v2:172.21.15.112:3300/0 conn(0x7f8c0c146290 0x7f8c0c0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c09e00640 1 -- 172.21.15.106:0/907840312 >> v1:172.21.15.112:6789/0 conn(0x7f8c0c06c400 legacy=0x7f8c0c06f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.607+0000 7f8c09e00640 1 -- 172.21.15.106:0/907840312 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c073f30 con 0x7f8c0c145e20 2024-04-26T21:17:14.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c09e00640 1 --2- 172.21.15.106:0/907840312 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c145e20 0x7f8c0c070ac0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c073ce0 tx=0x7f8bfc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d6c5127eef23a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:14.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c08a00640 1 -- 172.21.15.106:0/907840312 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0a56c0 con 0x7f8c0c145e20 2024-04-26T21:17:14.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c08a00640 1 -- 172.21.15.106:0/907840312 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc0a5860 con 0x7f8c0c145e20 2024-04-26T21:17:14.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c08a00640 1 -- 172.21.15.106:0/907840312 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0a5c30 con 0x7f8c0c145e20 2024-04-26T21:17:14.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c10e00640 1 -- 172.21.15.106:0/907840312 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c145e20 msgr2=0x7f8c0c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c10e00640 1 --2- 172.21.15.106:0/907840312 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c145e20 0x7f8c0c070ac0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c073ce0 tx=0x7f8bfc01c9f0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c10e00640 1 -- 172.21.15.106:0/907840312 shutdown_connections 2024-04-26T21:17:14.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c10e00640 1 --2- 172.21.15.106:0/907840312 >> v2:172.21.15.112:3300/0 conn(0x7f8c0c146290 0x7f8c0c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c10e00640 1 --2- 172.21.15.106:0/907840312 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c145e20 0x7f8c0c070ac0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c10e00640 1 -- 172.21.15.106:0/907840312 >> 172.21.15.106:0/907840312 conn(0x7f8c0c068140 msgr2=0x7f8c0c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:14.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c10e00640 1 -- 172.21.15.106:0/907840312 shutdown_connections 2024-04-26T21:17:14.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.611+0000 7f8c10e00640 1 -- 172.21.15.106:0/907840312 wait complete. 2024-04-26T21:17:14.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 Processor -- start 2024-04-26T21:17:14.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 -- start start 2024-04-26T21:17:14.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c06c400 0x7f8c0c154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c0c145e20 0x7f8c0c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c0c146290 0x7f8c0c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c0b4e30 con 0x7f8c0c06c400 2024-04-26T21:17:14.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c06fe30 con 0x7f8c0c145e20 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8c0c0b4fb0 con 0x7f8c0c146290 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c06c400 0x7f8c0c154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c06c400 0x7f8c0c154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55448/0 (socket says 172.21.15.106:55448) 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09e00640 1 -- 172.21.15.106:0/1968743342 learned_addr learned my addr 172.21.15.106:0/1968743342 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c0a800640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c0c146290 0x7f8c0c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09400640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c0c145e20 0x7f8c0c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09e00640 1 -- 172.21.15.106:0/1968743342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c0c146290 msgr2=0x7f8c0c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09e00640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c0c146290 0x7f8c0c15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09e00640 1 -- 172.21.15.106:0/1968743342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c0c145e20 msgr2=0x7f8c0c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09e00640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c0c145e20 0x7f8c0c1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09e00640 1 -- 172.21.15.106:0/1968743342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c15fbd0 con 0x7f8c0c06c400 2024-04-26T21:17:14.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c09e00640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c06c400 0x7f8c0c154bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc01a620 tx=0x7f8bfc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:14.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c02000640 1 -- 172.21.15.106:0/1968743342 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0b8670 con 0x7f8c0c06c400 2024-04-26T21:17:14.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c02000640 1 -- 172.21.15.106:0/1968743342 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc0be070 con 0x7f8c0c06c400 2024-04-26T21:17:14.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c02000640 1 -- 172.21.15.106:0/1968743342 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0b8a50 con 0x7f8c0c06c400 2024-04-26T21:17:14.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0c15fe90 con 0x7f8c0c06c400 2024-04-26T21:17:14.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0c15e6c0 con 0x7f8c0c06c400 2024-04-26T21:17:14.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.615+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c0c15e4e0 con 0x7f8c0c06c400 2024-04-26T21:17:14.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.619+0000 7f8c02000640 1 -- 172.21.15.106:0/1968743342 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8bfc0b8bf0 con 0x7f8c0c06c400 2024-04-26T21:17:14.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.619+0000 7f8c02000640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bec068380 0x7f8bec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.619+0000 7f8c02000640 1 -- 172.21.15.106:0/1968743342 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f8bfc121fe0 con 0x7f8c0c06c400 2024-04-26T21:17:14.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.619+0000 7f8c09400640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bec068380 0x7f8bec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.619+0000 7f8c09400640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bec068380 0x7f8bec06a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0b4990 tx=0x7f8bf8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:14.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.623+0000 7f8c02000640 1 -- 172.21.15.106:0/1968743342 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8c0c15e4e0 con 0x7f8c0c06c400 2024-04-26T21:17:14.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.783+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c0c073660 con 0x7f8c0c06c400 2024-04-26T21:17:14.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.783+0000 7f8c02000640 1 -- 172.21.15.106:0/1968743342 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7f8bfc0165e0 con 0x7f8c0c06c400 2024-04-26T21:17:14.787 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:14.788 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:14.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bec068380 msgr2=0x7f8bec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bec068380 0x7f8bec06a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0b4990 tx=0x7f8bf8008040 comp rx=0 tx=0).stop 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c06c400 msgr2=0x7f8c0c154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c06c400 0x7f8c0c154bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc01a620 tx=0x7f8bfc019790 comp rx=0 tx=0).stop 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 shutdown_connections 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c0c145e20 0x7f8c0c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bec068380 0x7f8bec06a840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c0c146290 0x7f8c0c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 --2- 172.21.15.106:0/1968743342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c0c06c400 0x7f8c0c154bf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 >> 172.21.15.106:0/1968743342 conn(0x7f8c0c068140 msgr2=0x7f8c0c0b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 shutdown_connections 2024-04-26T21:17:14.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.787+0000 7f8c10e00640 1 -- 172.21.15.106:0/1968743342 wait complete. 2024-04-26T21:17:14.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:14.809 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:14.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.943+0000 7f6a4b200640 1 Processor -- start 2024-04-26T21:17:14.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.943+0000 7f6a4b200640 1 -- start start 2024-04-26T21:17:14.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a4b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a4415d080 0x7f6a440b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a4b200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a440b4f00 con 0x7f6a4415c4e0 2024-04-26T21:17:14.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a4b200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a440b51e0 con 0x7f6a4415da80 2024-04-26T21:17:14.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a4b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4415d5f0 con 0x7f6a4415d080 2024-04-26T21:17:14.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a43e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6a4415c4e0 0x7f6a4415c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40376/0 (socket says 172.21.15.106:40376) 2024-04-26T21:17:14.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a43e00640 1 -- 172.21.15.106:0/2339806385 learned_addr learned my addr 172.21.15.106:0/2339806385 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:14.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a43400640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a4415d080 0x7f6a440b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017092422 0 0) 0x7f6a440b4f00 con 0x7f6a4415c4e0 2024-04-26T21:17:14.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a28005740 con 0x7f6a4415c4e0 2024-04-26T21:17:14.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2499108271 0 0) 0x7f6a28005740 con 0x7f6a4415c4e0 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a4415d080 msgr2=0x7f6a440b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a4415d080 0x7f6a440b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 >> v1:172.21.15.112:6789/0 conn(0x7f6a4415da80 legacy=0x7f6a4415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a440b54c0 con 0x7f6a4415c4e0 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f6a2c001680 con 0x7f6a4415c4e0 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 >> v1:172.21.15.106:6789/0 conn(0x7f6a4415c4e0 legacy=0x7f6a4415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a4415d080 0x7f6a28005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a28006140 0x7f6a28006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a280073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4415d5f0 con 0x7f6a28006f60 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2800dc40 con 0x7f6a28006140 2024-04-26T21:17:14.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2800de40 con 0x7f6a4415d080 2024-04-26T21:17:14.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a49200640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a280073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a43e00640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a4415d080 0x7f6a28005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a43400640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a28006140 0x7f6a28006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a49200640 1 -- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a4415d080 msgr2=0x7f6a28005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:14.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a49200640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a4415d080 0x7f6a28005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a49200640 1 -- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a28006140 msgr2=0x7f6a28006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:14.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a49200640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a28006140 0x7f6a28006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.947+0000 7f6a49200640 1 -- 172.21.15.106:0/2339806385 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a28005740 con 0x7f6a28006f60 2024-04-26T21:17:14.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a49200640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a280073e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c002010 tx=0x7f6a3c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7de09e14540097a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:14.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0b2070 con 0x7f6a28006f60 2024-04-26T21:17:14.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0a57f0 con 0x7f6a28006f60 2024-04-26T21:17:14.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a42a00640 1 -- 172.21.15.106:0/2339806385 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c001c10 con 0x7f6a28006f60 2024-04-26T21:17:14.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a4b200640 1 -- 172.21.15.106:0/2339806385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 msgr2=0x7f6a280073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a4b200640 1 --2- 172.21.15.106:0/2339806385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a280073e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c002010 tx=0x7f6a3c01c8e0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a49200640 1 -- 172.21.15.106:0/2339806385 reap_dead start 2024-04-26T21:17:14.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a4b200640 1 -- 172.21.15.106:0/2339806385 shutdown_connections 2024-04-26T21:17:14.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a4b200640 1 -- 172.21.15.106:0/2339806385 >> 172.21.15.106:0/2339806385 conn(0x7f6a440b2910 msgr2=0x7f6a440b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:14.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a4b200640 1 -- 172.21.15.106:0/2339806385 shutdown_connections 2024-04-26T21:17:14.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.951+0000 7f6a4b200640 1 -- 172.21.15.106:0/2339806385 wait complete. 2024-04-26T21:17:14.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 Processor -- start 2024-04-26T21:17:14.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 -- start start 2024-04-26T21:17:14.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a441f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a441f5e30 0x7f6a441f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a441f7c90 0x7f6a44142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6a440b4620 con 0x7f6a28006f60 2024-04-26T21:17:14.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6a44145ba0 con 0x7f6a441f7c90 2024-04-26T21:17:14.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6a440b47a0 con 0x7f6a441f5e30 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a441f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a441f85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55456/0 (socket says 172.21.15.106:55456) 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43e00640 1 -- 172.21.15.106:0/167162553 learned_addr learned my addr 172.21.15.106:0/167162553 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43400640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a441f5e30 0x7f6a441f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a49200640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a441f7c90 0x7f6a44142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43e00640 1 -- 172.21.15.106:0/167162553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a441f5e30 msgr2=0x7f6a441f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43e00640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a441f5e30 0x7f6a441f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43e00640 1 -- 172.21.15.106:0/167162553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a441f7c90 msgr2=0x7f6a44142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43e00640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a441f7c90 0x7f6a44142bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43e00640 1 -- 172.21.15.106:0/167162553 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a441e4760 con 0x7f6a28006f60 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a43e00640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a441f85c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0124a0 tx=0x7f6a2c012960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a3be00640 1 -- 172.21.15.106:0/167162553 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c014810 con 0x7f6a28006f60 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a3be00640 1 -- 172.21.15.106:0/167162553 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c01b070 con 0x7f6a28006f60 2024-04-26T21:17:14.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a3be00640 1 -- 172.21.15.106:0/167162553 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c014bb0 con 0x7f6a28006f60 2024-04-26T21:17:14.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a441e4a40 con 0x7f6a28006f60 2024-04-26T21:17:14.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a441e5000 con 0x7f6a28006f60 2024-04-26T21:17:14.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.955+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a44069400 con 0x7f6a28006f60 2024-04-26T21:17:14.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.959+0000 7f6a3be00640 1 -- 172.21.15.106:0/167162553 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a2c016480 con 0x7f6a28006f60 2024-04-26T21:17:14.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.959+0000 7f6a3be00640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6a200683b0 0x7f6a2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:14.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.959+0000 7f6a3be00640 1 -- 172.21.15.106:0/167162553 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f6a2c08a250 con 0x7f6a28006f60 2024-04-26T21:17:14.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.959+0000 7f6a43400640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6a200683b0 0x7f6a2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:14.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.959+0000 7f6a43400640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6a200683b0 0x7f6a2006a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6a440cc5e0 tx=0x7f6a34008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:14.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:14.963+0000 7f6a3be00640 1 -- 172.21.15.106:0/167162553 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6a2c05a400 con 0x7f6a28006f60 2024-04-26T21:17:15.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.119+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a4415ee80 con 0x7f6a28006f60 2024-04-26T21:17:15.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.119+0000 7f6a3be00640 1 -- 172.21.15.106:0/167162553 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f6a2c059d00 con 0x7f6a28006f60 2024-04-26T21:17:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:15.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6a200683b0 msgr2=0x7f6a2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6a200683b0 0x7f6a2006a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6a440cc5e0 tx=0x7f6a34008040 comp rx=0 tx=0).stop 2024-04-26T21:17:15.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 msgr2=0x7f6a441f85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a441f85c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0124a0 tx=0x7f6a2c012960 comp rx=0 tx=0).stop 2024-04-26T21:17:15.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 shutdown_connections 2024-04-26T21:17:15.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6a441f7c90 0x7f6a44142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6a200683b0 0x7f6a2006a870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6a441f5e30 0x7f6a441f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 --2- 172.21.15.106:0/167162553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a28006f60 0x7f6a441f85c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 >> 172.21.15.106:0/167162553 conn(0x7f6a440b2910 msgr2=0x7f6a4415deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:15.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 shutdown_connections 2024-04-26T21:17:15.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.123+0000 7f6a4b200640 1 -- 172.21.15.106:0/167162553 wait complete. 2024-04-26T21:17:15.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:15.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad31400640 1 Processor -- start 2024-04-26T21:17:15.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad31400640 1 -- start start 2024-04-26T21:17:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad31400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fad2c0cf400 0x7fad2c0d3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad31400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad2c15cfb0 0x7fad2c0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad31400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2c0b20d0 con 0x7fad2c0b28d0 2024-04-26T21:17:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad31400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fad2c0d1100 con 0x7fad2c15cfb0 2024-04-26T21:17:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad31400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fad2c0b23f0 con 0x7fad2c0cf400 2024-04-26T21:17:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad23e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad2c15cfb0 0x7fad2c0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad23e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad2c15cfb0 0x7fad2c0cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55470/0 (socket says 172.21.15.106:55470) 2024-04-26T21:17:15.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad23e00640 1 -- 172.21.15.106:0/2378838915 learned_addr learned my addr 172.21.15.106:0/2378838915 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad2be00640 1 --2- 172.21.15.106:0/2378838915 >> v2:172.21.15.112:3300/0 conn(0x7fad2c0cf400 0x7fad2c0d3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad23e00640 1 -- 172.21.15.106:0/2378838915 >> v2:172.21.15.112:3300/0 conn(0x7fad2c0cf400 msgr2=0x7fad2c0d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad23e00640 1 --2- 172.21.15.106:0/2378838915 >> v2:172.21.15.112:3300/0 conn(0x7fad2c0cf400 0x7fad2c0d3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad23e00640 1 -- 172.21.15.106:0/2378838915 >> v1:172.21.15.112:6789/0 conn(0x7fad2c0b28d0 legacy=0x7fad2c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:15.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.283+0000 7fad23e00640 1 -- 172.21.15.106:0/2378838915 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c0cfd20 con 0x7fad2c15cfb0 2024-04-26T21:17:15.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad23e00640 1 --2- 172.21.15.106:0/2378838915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 0x7fad2c0cf7e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fad2c06fb50 tx=0x7fad1401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66a2d4c0fe1c445 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:15.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad2b400640 1 -- 172.21.15.106:0/2378838915 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140b0070 con 0x7fad2c15cfb0 2024-04-26T21:17:15.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad2b400640 1 -- 172.21.15.106:0/2378838915 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad140ab600 con 0x7fad2c15cfb0 2024-04-26T21:17:15.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad2b400640 1 -- 172.21.15.106:0/2378838915 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140ab9d0 con 0x7fad2c15cfb0 2024-04-26T21:17:15.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad31400640 1 -- 172.21.15.106:0/2378838915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 msgr2=0x7fad2c0cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad31400640 1 --2- 172.21.15.106:0/2378838915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 0x7fad2c0cf7e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fad2c06fb50 tx=0x7fad1401c420 comp rx=0 tx=0).stop 2024-04-26T21:17:15.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad31400640 1 -- 172.21.15.106:0/2378838915 shutdown_connections 2024-04-26T21:17:15.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad31400640 1 --2- 172.21.15.106:0/2378838915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 0x7fad2c0cf7e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad31400640 1 --2- 172.21.15.106:0/2378838915 >> v2:172.21.15.112:3300/0 conn(0x7fad2c0cf400 0x7fad2c0d3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad31400640 1 -- 172.21.15.106:0/2378838915 >> 172.21.15.106:0/2378838915 conn(0x7fad2c0d29f0 msgr2=0x7fad2c0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:15.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad31400640 1 -- 172.21.15.106:0/2378838915 shutdown_connections 2024-04-26T21:17:15.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.287+0000 7fad31400640 1 -- 172.21.15.106:0/2378838915 wait complete. 2024-04-26T21:17:15.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 Processor -- start 2024-04-26T21:17:15.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 -- start start 2024-04-26T21:17:15.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c0b28d0 0x7fad2c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad2c0cf400 0x7fad2c0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 0x7fad2c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c169aa0 con 0x7fad2c15cfb0 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c169920 con 0x7fad2c0b28d0 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad2c169c20 con 0x7fad2c0cf400 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad30a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 0x7fad2c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad30a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 0x7fad2c14edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55486/0 (socket says 172.21.15.106:55486) 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad30a00640 1 -- 172.21.15.106:0/1040624256 learned_addr learned my addr 172.21.15.106:0/1040624256 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad2be00640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c0b28d0 0x7fad2c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad23e00640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad2c0cf400 0x7fad2c0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad30a00640 1 -- 172.21.15.106:0/1040624256 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad2c0cf400 msgr2=0x7fad2c0c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad30a00640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad2c0cf400 0x7fad2c0c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad30a00640 1 -- 172.21.15.106:0/1040624256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c0b28d0 msgr2=0x7fad2c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad30a00640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c0b28d0 0x7fad2c0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad30a00640 1 -- 172.21.15.106:0/1040624256 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c0c7c30 con 0x7fad2c15cfb0 2024-04-26T21:17:15.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad2be00640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c0b28d0 0x7fad2c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:15.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad30a00640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 0x7fad2c14edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c780 tx=0x7fad2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:15.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad28c00640 1 -- 172.21.15.106:0/1040624256 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24004b70 con 0x7fad2c15cfb0 2024-04-26T21:17:15.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad28c00640 1 -- 172.21.15.106:0/1040624256 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad24004d10 con 0x7fad2c15cfb0 2024-04-26T21:17:15.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2c0c7f10 con 0x7fad2c15cfb0 2024-04-26T21:17:15.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad28c00640 1 -- 172.21.15.106:0/1040624256 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2400aa30 con 0x7fad2c15cfb0 2024-04-26T21:17:15.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.291+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad2c0b6240 con 0x7fad2c15cfb0 2024-04-26T21:17:15.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.295+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad2c0506d0 con 0x7fad2c15cfb0 2024-04-26T21:17:15.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.295+0000 7fad28c00640 1 -- 172.21.15.106:0/1040624256 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fad2400abd0 con 0x7fad2c15cfb0 2024-04-26T21:17:15.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.295+0000 7fad28c00640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad08068380 0x7fad0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.295+0000 7fad28c00640 1 -- 172.21.15.106:0/1040624256 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fad24086fe0 con 0x7fad2c15cfb0 2024-04-26T21:17:15.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.295+0000 7fad2be00640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad08068380 0x7fad0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.295+0000 7fad2be00640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad08068380 0x7fad0806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad1c007a70 tx=0x7fad1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.299+0000 7fad28c00640 1 -- 172.21.15.106:0/1040624256 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fad24020070 con 0x7fad2c15cfb0 2024-04-26T21:17:15.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.459+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fad2c06d8e0 con 0x7fad2c15cfb0 2024-04-26T21:17:15.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad28c00640 1 -- 172.21.15.106:0/1040624256 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fad240571b0 con 0x7fad2c15cfb0 2024-04-26T21:17:15.465 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad08068380 msgr2=0x7fad0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad08068380 0x7fad0806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad1c007a70 tx=0x7fad1c008040 comp rx=0 tx=0).stop 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 msgr2=0x7fad2c14edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 0x7fad2c14edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c780 tx=0x7fad2400cc40 comp rx=0 tx=0).stop 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 shutdown_connections 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad08068380 0x7fad0806a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad2c15cfb0 0x7fad2c14edb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad2c0cf400 0x7fad2c0c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 --2- 172.21.15.106:0/1040624256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad2c0b28d0 0x7fad2c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 >> 172.21.15.106:0/1040624256 conn(0x7fad2c0d29f0 msgr2=0x7fad2c0d2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 shutdown_connections 2024-04-26T21:17:15.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.463+0000 7fad31400640 1 -- 172.21.15.106:0/1040624256 wait complete. 2024-04-26T21:17:15.485 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:15.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.619+0000 7f9745200640 1 Processor -- start 2024-04-26T21:17:15.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.619+0000 7f9745200640 1 -- start start 2024-04-26T21:17:15.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f9745200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f97400d1be0 0x7f97400b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f9745200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97400cdab0 con 0x7f9740160440 2024-04-26T21:17:15.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f9745200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97400cdd90 con 0x7f97400cfb70 2024-04-26T21:17:15.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f9745200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f97400ce070 con 0x7f97400d1be0 2024-04-26T21:17:15.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f973de00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9740160440 0x7f97400cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40392/0 (socket says 172.21.15.106:40392) 2024-04-26T21:17:15.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f973de00640 1 -- 172.21.15.106:0/866875833 learned_addr learned my addr 172.21.15.106:0/866875833 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:15.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f973e800640 1 --2- 172.21.15.106:0/866875833 >> v2:172.21.15.112:3300/0 conn(0x7f97400d1be0 0x7f97400b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f973ca00640 1 -- 172.21.15.106:0/866875833 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627190582 0 0) 0x7f97400cdab0 con 0x7f9740160440 2024-04-26T21:17:15.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f973ca00640 1 -- 172.21.15.106:0/866875833 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9724003530 con 0x7f9740160440 2024-04-26T21:17:15.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f973e800640 1 -- 172.21.15.106:0/866875833 >> v1:172.21.15.112:6789/0 conn(0x7f97400cfb70 legacy=0x7f97400d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f973e800640 1 -- 172.21.15.106:0/866875833 >> v1:172.21.15.106:6789/0 conn(0x7f9740160440 legacy=0x7f97400cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.623+0000 7f973e800640 1 -- 172.21.15.106:0/866875833 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97400ce350 con 0x7f97400d1be0 2024-04-26T21:17:15.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f973e800640 1 --2- 172.21.15.106:0/866875833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97400d1be0 0x7f97400b5aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9738009d90 tx=0x7f973801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5b5377801c7dc63 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:15.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f973ca00640 1 -- 172.21.15.106:0/866875833 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97380b2070 con 0x7f97400d1be0 2024-04-26T21:17:15.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f973ca00640 1 -- 172.21.15.106:0/866875833 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97380a5a00 con 0x7f97400d1be0 2024-04-26T21:17:15.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f973ca00640 1 -- 172.21.15.106:0/866875833 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97380a5db0 con 0x7f97400d1be0 2024-04-26T21:17:15.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 -- 172.21.15.106:0/866875833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97400d1be0 msgr2=0x7f97400b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 --2- 172.21.15.106:0/866875833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97400d1be0 0x7f97400b5aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9738009d90 tx=0x7f973801c940 comp rx=0 tx=0).stop 2024-04-26T21:17:15.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 -- 172.21.15.106:0/866875833 shutdown_connections 2024-04-26T21:17:15.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 --2- 172.21.15.106:0/866875833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97400d1be0 0x7f97400b5aa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 -- 172.21.15.106:0/866875833 >> 172.21.15.106:0/866875833 conn(0x7f97400d2c50 msgr2=0x7f97400d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:15.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 -- 172.21.15.106:0/866875833 shutdown_connections 2024-04-26T21:17:15.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 -- 172.21.15.106:0/866875833 wait complete. 2024-04-26T21:17:15.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 Processor -- start 2024-04-26T21:17:15.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 -- start start 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97400cfb70 0x7f974014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97400d1be0 0x7f974014aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9740160440 0x7f974014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f974016b040 con 0x7f9740160440 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f974016aec0 con 0x7f97400d1be0 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.627+0000 7f9745200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f974016b1c0 con 0x7f97400cfb70 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9740160440 0x7f974014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9740160440 0x7f974014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55502/0 (socket says 172.21.15.106:55502) 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973e800640 1 -- 172.21.15.106:0/1734770720 learned_addr learned my addr 172.21.15.106:0/1734770720 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97400cfb70 0x7f974014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973d400640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97400d1be0 0x7f974014aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973e800640 1 -- 172.21.15.106:0/1734770720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97400cfb70 msgr2=0x7f974014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973e800640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97400cfb70 0x7f974014f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973e800640 1 -- 172.21.15.106:0/1734770720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97400d1be0 msgr2=0x7f974014aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973e800640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97400d1be0 0x7f974014aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973e800640 1 -- 172.21.15.106:0/1734770720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974015c280 con 0x7f9740160440 2024-04-26T21:17:15.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f973e800640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9740160440 0x7f974014b420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f97380b0040 tx=0x7f97380196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:15.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f9736000640 1 -- 172.21.15.106:0/1734770720 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97380b2040 con 0x7f9740160440 2024-04-26T21:17:15.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f9736000640 1 -- 172.21.15.106:0/1734770720 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97380b8470 con 0x7f9740160440 2024-04-26T21:17:15.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f9736000640 1 -- 172.21.15.106:0/1734770720 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97380b8860 con 0x7f9740160440 2024-04-26T21:17:15.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974015c560 con 0x7f9740160440 2024-04-26T21:17:15.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97401535f0 con 0x7f9740160440 2024-04-26T21:17:15.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9740153100 con 0x7f9740160440 2024-04-26T21:17:15.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.631+0000 7f9736000640 1 -- 172.21.15.106:0/1734770720 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97380c1020 con 0x7f9740160440 2024-04-26T21:17:15.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.635+0000 7f9736000640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f97200683b0 0x7f972006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.635+0000 7f9736000640 1 -- 172.21.15.106:0/1734770720 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f9738121870 con 0x7f9740160440 2024-04-26T21:17:15.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.635+0000 7f973de00640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f97200683b0 0x7f972006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.635+0000 7f973de00640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f97200683b0 0x7f972006a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97300011f0 tx=0x7f9730007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:15.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.639+0000 7f9736000640 1 -- 172.21.15.106:0/1734770720 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9738016560 con 0x7f9740160440 2024-04-26T21:17:15.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.795+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9740069400 con 0x7f9740160440 2024-04-26T21:17:15.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.795+0000 7f9736000640 1 -- 172.21.15.106:0/1734770720 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f97380f1460 con 0x7f9740160440 2024-04-26T21:17:15.800 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:15.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f97200683b0 msgr2=0x7f972006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f97200683b0 0x7f972006a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97300011f0 tx=0x7f9730007d40 comp rx=0 tx=0).stop 2024-04-26T21:17:15.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9740160440 msgr2=0x7f974014b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9740160440 0x7f974014b420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f97380b0040 tx=0x7f97380196e0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 shutdown_connections 2024-04-26T21:17:15.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97400d1be0 0x7f974014aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f97200683b0 0x7f972006a870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9740160440 0x7f974014b420 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 --2- 172.21.15.106:0/1734770720 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f97400cfb70 0x7f974014f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 >> 172.21.15.106:0/1734770720 conn(0x7f97400d2c50 msgr2=0x7f9740071260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:15.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 shutdown_connections 2024-04-26T21:17:15.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.799+0000 7f9745200640 1 -- 172.21.15.106:0/1734770720 wait complete. 2024-04-26T21:17:15.820 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:15.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e3e00640 1 Processor -- start 2024-04-26T21:17:15.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e3e00640 1 -- start start 2024-04-26T21:17:15.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26dc0b5260 0x7f26dc15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f26dc15de50 0x7f26dc166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e3e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26dc0b44a0 con 0x7f26dc15d530 2024-04-26T21:17:15.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e3e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f26dc0b4780 con 0x7f26dc15de50 2024-04-26T21:17:15.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e3e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f26dc0b4a60 con 0x7f26dc0b5260 2024-04-26T21:17:15.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e1e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f26dc15de50 0x7f26dc166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e1e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f26dc15de50 0x7f26dc166ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55518/0 (socket says 172.21.15.106:55518) 2024-04-26T21:17:15.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e1400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f26dc15d530 0x7f26dc0cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40404/0 (socket says 172.21.15.106:40404) 2024-04-26T21:17:15.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e1e00640 1 -- 172.21.15.106:0/1720919739 learned_addr learned my addr 172.21.15.106:0/1720919739 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:15.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e0a00640 1 --2- 172.21.15.106:0/1720919739 >> v2:172.21.15.112:3300/0 conn(0x7f26dc0b5260 0x7f26dc15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e1e00640 1 -- 172.21.15.106:0/1720919739 >> v2:172.21.15.112:3300/0 conn(0x7f26dc0b5260 msgr2=0x7f26dc15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:15.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e1e00640 1 --2- 172.21.15.106:0/1720919739 >> v2:172.21.15.112:3300/0 conn(0x7f26dc0b5260 0x7f26dc15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e1e00640 1 -- 172.21.15.106:0/1720919739 >> v1:172.21.15.106:6789/0 conn(0x7f26dc15d530 legacy=0x7f26dc0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.955+0000 7f26e1e00640 1 -- 172.21.15.106:0/1720919739 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc0b4d40 con 0x7f26dc15de50 2024-04-26T21:17:15.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e1e00640 1 --2- 172.21.15.106:0/1720919739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc15de50 0x7f26dc166ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0b0820 tx=0x7f26d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01cfeebfed7da2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:15.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26dbe00640 1 -- 172.21.15.106:0/1720919739 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d40a6040 con 0x7f26dc15de50 2024-04-26T21:17:15.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26dbe00640 1 -- 172.21.15.106:0/1720919739 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d40af070 con 0x7f26dc15de50 2024-04-26T21:17:15.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26dbe00640 1 -- 172.21.15.106:0/1720919739 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d40aa860 con 0x7f26dc15de50 2024-04-26T21:17:15.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 -- 172.21.15.106:0/1720919739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc15de50 msgr2=0x7f26dc166ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 --2- 172.21.15.106:0/1720919739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc15de50 0x7f26dc166ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0b0820 tx=0x7f26d401c520 comp rx=0 tx=0).stop 2024-04-26T21:17:15.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 -- 172.21.15.106:0/1720919739 shutdown_connections 2024-04-26T21:17:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 --2- 172.21.15.106:0/1720919739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc15de50 0x7f26dc166ae0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 --2- 172.21.15.106:0/1720919739 >> v2:172.21.15.112:3300/0 conn(0x7f26dc0b5260 0x7f26dc15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 -- 172.21.15.106:0/1720919739 >> 172.21.15.106:0/1720919739 conn(0x7f26dc0b2910 msgr2=0x7f26dc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 -- 172.21.15.106:0/1720919739 shutdown_connections 2024-04-26T21:17:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 -- 172.21.15.106:0/1720919739 wait complete. 2024-04-26T21:17:15.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 Processor -- start 2024-04-26T21:17:15.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.959+0000 7f26e3e00640 1 -- start start 2024-04-26T21:17:15.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc0b5260 0x7f26dc071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26dc15d530 0x7f26dc145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e3e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26dc15de50 0x7f26dc15c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e3e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc0d06b0 con 0x7f26dc0b5260 2024-04-26T21:17:15.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e3e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc0d0530 con 0x7f26dc15de50 2024-04-26T21:17:15.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e3e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f26dc169840 con 0x7f26dc15d530 2024-04-26T21:17:15.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc0b5260 0x7f26dc071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc0b5260 0x7f26dc071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55526/0 (socket says 172.21.15.106:55526) 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1400640 1 -- 172.21.15.106:0/2749665941 learned_addr learned my addr 172.21.15.106:0/2749665941 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e0a00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26dc15d530 0x7f26dc145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1e00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26dc15de50 0x7f26dc15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1400640 1 -- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26dc15d530 msgr2=0x7f26dc145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1400640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26dc15d530 0x7f26dc145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1400640 1 -- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26dc15de50 msgr2=0x7f26dc15c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1400640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26dc15de50 0x7f26dc15c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1400640 1 -- 172.21.15.106:0/2749665941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc13f600 con 0x7f26dc0b5260 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e0a00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26dc15d530 0x7f26dc145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1e00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26dc15de50 0x7f26dc15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e1400640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc0b5260 0x7f26dc071f90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c790 tx=0x7f26d000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26d9600640 1 -- 172.21.15.106:0/2749665941 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0017070 con 0x7f26dc0b5260 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26d9600640 1 -- 172.21.15.106:0/2749665941 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d000a640 con 0x7f26dc0b5260 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26dc13f870 con 0x7f26dc0b5260 2024-04-26T21:17:15.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26d9600640 1 -- 172.21.15.106:0/2749665941 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d000a9f0 con 0x7f26dc0b5260 2024-04-26T21:17:15.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26dc0724d0 con 0x7f26dc0b5260 2024-04-26T21:17:15.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26dc13fa40 con 0x7f26dc0b5260 2024-04-26T21:17:15.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.963+0000 7f26d9600640 1 -- 172.21.15.106:0/2749665941 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f26d001a070 con 0x7f26dc0b5260 2024-04-26T21:17:15.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.967+0000 7f26d9600640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f26bc068380 0x7f26bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:15.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.967+0000 7f26d9600640 1 -- 172.21.15.106:0/2749665941 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f26d00863f0 con 0x7f26dc0b5260 2024-04-26T21:17:15.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.967+0000 7f26e0a00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f26bc068380 0x7f26bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:15.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.967+0000 7f26e0a00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f26bc068380 0x7f26bc06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f26dc074130 tx=0x7f26c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:15.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:15.971+0000 7f26d9600640 1 -- 172.21.15.106:0/2749665941 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f26d0055ec0 con 0x7f26dc0b5260 2024-04-26T21:17:16.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f26dc069400 con 0x7f26dc0b5260 2024-04-26T21:17:16.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26d9600640 1 -- 172.21.15.106:0/2749665941 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f26d005a1c0 con 0x7f26dc0b5260 2024-04-26T21:17:16.129 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:16.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f26bc068380 msgr2=0x7f26bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f26bc068380 0x7f26bc06a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f26dc074130 tx=0x7f26c8008040 comp rx=0 tx=0).stop 2024-04-26T21:17:16.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc0b5260 msgr2=0x7f26dc071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc0b5260 0x7f26dc071f90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c790 tx=0x7f26d000cc50 comp rx=0 tx=0).stop 2024-04-26T21:17:16.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 shutdown_connections 2024-04-26T21:17:16.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26dc15de50 0x7f26dc15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f26bc068380 0x7f26bc06a840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26dc15d530 0x7f26dc145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 --2- 172.21.15.106:0/2749665941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26dc0b5260 0x7f26dc071f90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 >> 172.21.15.106:0/2749665941 conn(0x7f26dc0b2910 msgr2=0x7f26dc0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:16.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 shutdown_connections 2024-04-26T21:17:16.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.127+0000 7f26e3e00640 1 -- 172.21.15.106:0/2749665941 wait complete. 2024-04-26T21:17:16.151 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:17:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.283+0000 7fdea4c00640 1 Processor -- start 2024-04-26T21:17:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.283+0000 7fdea4c00640 1 -- start start 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.283+0000 7fdea4c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdea013ed60 0x7fdea015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.283+0000 7fdea4c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea006eb70 0x7fdea00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.283+0000 7fdea4c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea00b3d10 con 0x7fdea013f140 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.283+0000 7fdea4c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdea00b3ac0 con 0x7fdea013ed60 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.283+0000 7fdea4c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdea00b4920 con 0x7fdea006eb70 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.283+0000 7fde95400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdea013f140 0x7fdea00b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40406/0 (socket says 172.21.15.106:40406) 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.283+0000 7fde95400640 1 -- 172.21.15.106:0/2192419746 learned_addr learned my addr 172.21.15.106:0/2192419746 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9de00640 1 --2- 172.21.15.106:0/2192419746 >> v2:172.21.15.112:3300/0 conn(0x7fdea013ed60 0x7fdea015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9e800640 1 --2- 172.21.15.106:0/2192419746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea006eb70 0x7fdea00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9d400640 1 -- 172.21.15.106:0/2192419746 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248969777 0 0) 0x7fdea00b3d10 con 0x7fdea013f140 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9d400640 1 -- 172.21.15.106:0/2192419746 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde84003530 con 0x7fdea013f140 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9e800640 1 -- 172.21.15.106:0/2192419746 >> v2:172.21.15.112:3300/0 conn(0x7fdea013ed60 msgr2=0x7fdea015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9e800640 1 --2- 172.21.15.106:0/2192419746 >> v2:172.21.15.112:3300/0 conn(0x7fdea013ed60 0x7fdea015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9e800640 1 -- 172.21.15.106:0/2192419746 >> v1:172.21.15.106:6789/0 conn(0x7fdea013f140 legacy=0x7fdea00b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9e800640 1 -- 172.21.15.106:0/2192419746 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea00b3ff0 con 0x7fdea006eb70 2024-04-26T21:17:16.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9de00640 1 --2- 172.21.15.106:0/2192419746 >> v2:172.21.15.112:3300/0 conn(0x7fdea013ed60 0x7fdea015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:16.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.287+0000 7fde9e800640 1 --2- 172.21.15.106:0/2192419746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea006eb70 0x7fdea00d0df0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdea00b3c40 tx=0x7fde9801c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51887d4e6994be6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:16.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fde9d400640 1 -- 172.21.15.106:0/2192419746 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde980b2070 con 0x7fdea006eb70 2024-04-26T21:17:16.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fde9d400640 1 -- 172.21.15.106:0/2192419746 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde980a5800 con 0x7fdea006eb70 2024-04-26T21:17:16.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fde9d400640 1 -- 172.21.15.106:0/2192419746 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde980a5bd0 con 0x7fdea006eb70 2024-04-26T21:17:16.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 -- 172.21.15.106:0/2192419746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea006eb70 msgr2=0x7fdea00d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 --2- 172.21.15.106:0/2192419746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea006eb70 0x7fdea00d0df0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdea00b3c40 tx=0x7fde9801c830 comp rx=0 tx=0).stop 2024-04-26T21:17:16.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 -- 172.21.15.106:0/2192419746 shutdown_connections 2024-04-26T21:17:16.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 --2- 172.21.15.106:0/2192419746 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea006eb70 0x7fdea00d0df0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 --2- 172.21.15.106:0/2192419746 >> v2:172.21.15.112:3300/0 conn(0x7fdea013ed60 0x7fdea015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 -- 172.21.15.106:0/2192419746 >> 172.21.15.106:0/2192419746 conn(0x7fdea0068340 msgr2=0x7fdea0068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:16.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 -- 172.21.15.106:0/2192419746 shutdown_connections 2024-04-26T21:17:16.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 -- 172.21.15.106:0/2192419746 wait complete. 2024-04-26T21:17:16.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 Processor -- start 2024-04-26T21:17:16.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 -- start start 2024-04-26T21:17:16.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea013ed60 0x7fdea015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdea00acaf0 0x7fdea00acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea00ad8b0 0x7fdea00add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0160790 con 0x7fdea00acaf0 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0160610 con 0x7fdea00ad8b0 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fdea4c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdea0071f50 con 0x7fdea013ed60 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.291+0000 7fde95400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdea00acaf0 0x7fdea00acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde95400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdea00acaf0 0x7fdea00acf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55528/0 (socket says 172.21.15.106:55528) 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde95400640 1 -- 172.21.15.106:0/2210729149 learned_addr learned my addr 172.21.15.106:0/2210729149 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde9de00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea013ed60 0x7fdea015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde9e800640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea00ad8b0 0x7fdea00add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde95400640 1 -- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea013ed60 msgr2=0x7fdea015a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde95400640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea013ed60 0x7fdea015a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde95400640 1 -- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea00ad8b0 msgr2=0x7fdea00add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde95400640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea00ad8b0 0x7fdea00add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde95400640 1 -- 172.21.15.106:0/2210729149 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea01f7ee0 con 0x7fdea00acaf0 2024-04-26T21:17:16.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde9de00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea013ed60 0x7fdea015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:16.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde9e800640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea00ad8b0 0x7fdea00add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:16.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde95400640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdea00acaf0 0x7fdea00acf50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c420 tx=0x7fde9000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:16.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde96a00640 1 -- 172.21.15.106:0/2210729149 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90017070 con 0x7fdea00acaf0 2024-04-26T21:17:16.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde96a00640 1 -- 172.21.15.106:0/2210729149 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde90005cf0 con 0x7fdea00acaf0 2024-04-26T21:17:16.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea01f81a0 con 0x7fdea00acaf0 2024-04-26T21:17:16.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde96a00640 1 -- 172.21.15.106:0/2210729149 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde900072f0 con 0x7fdea00acaf0 2024-04-26T21:17:16.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea01f8760 con 0x7fdea00acaf0 2024-04-26T21:17:16.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea0069400 con 0x7fdea00acaf0 2024-04-26T21:17:16.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.295+0000 7fde96a00640 1 -- 172.21.15.106:0/2210729149 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fde9001a070 con 0x7fdea00acaf0 2024-04-26T21:17:16.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.299+0000 7fde96a00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde7c068380 0x7fde7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.299+0000 7fde96a00640 1 -- 172.21.15.106:0/2210729149 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fde90086180 con 0x7fdea00acaf0 2024-04-26T21:17:16.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.299+0000 7fde9de00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde7c068380 0x7fde7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.299+0000 7fde9de00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde7c068380 0x7fde7c06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fde8800bc60 tx=0x7fde88008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:16.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.303+0000 7fde96a00640 1 -- 172.21.15.106:0/2210729149 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fde90056340 con 0x7fdea00acaf0 2024-04-26T21:17:16.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdea00ad690 con 0x7fdea00acaf0 2024-04-26T21:17:16.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fde96a00640 1 -- 172.21.15.106:0/2210729149 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fde90055c40 con 0x7fdea00acaf0 2024-04-26T21:17:16.478 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:17:16.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde7c068380 msgr2=0x7fde7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde7c068380 0x7fde7c06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fde8800bc60 tx=0x7fde88008040 comp rx=0 tx=0).stop 2024-04-26T21:17:16.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdea00acaf0 msgr2=0x7fdea00acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdea00acaf0 0x7fdea00acf50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c420 tx=0x7fde9000c8e0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 shutdown_connections 2024-04-26T21:17:16.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea00ad8b0 0x7fdea00add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde7c068380 0x7fde7c06a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdea00acaf0 0x7fdea00acf50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 --2- 172.21.15.106:0/2210729149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdea013ed60 0x7fdea015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 >> 172.21.15.106:0/2210729149 conn(0x7fdea0068340 msgr2=0x7fdea01657a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:16.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 shutdown_connections 2024-04-26T21:17:16.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.475+0000 7fdea4c00640 1 -- 172.21.15.106:0/2210729149 wait complete. 2024-04-26T21:17:16.499 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:17:16.500 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:16.509 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:16.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c36600640 1 Processor -- start 2024-04-26T21:17:16.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c36600640 1 -- start start 2024-04-26T21:17:16.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c36600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c3015d060 0x7f4c300cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c36600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c300b2250 con 0x7f4c300b3a40 2024-04-26T21:17:16.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c36600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c300ce660 con 0x7f4c300cfb70 2024-04-26T21:17:16.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c36600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4c300b25a0 con 0x7f4c3015d060 2024-04-26T21:17:16.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2fe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4c300b3a40 0x7f4c300d0f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40420/0 (socket says 172.21.15.106:40420) 2024-04-26T21:17:16.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2fe00640 1 -- 172.21.15.106:0/1186531255 learned_addr learned my addr 172.21.15.106:0/1186531255 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:16.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2f400640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c3015d060 0x7f4c300cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041850045 0 0) 0x7f4c300b2250 con 0x7f4c300b3a40 2024-04-26T21:17:16.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c14003530 con 0x7f4c300b3a40 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4002520110 0 0) 0x7f4c14003530 con 0x7f4c300b3a40 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c3015d060 msgr2=0x7f4c300cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c3015d060 0x7f4c300cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 >> v1:172.21.15.112:6789/0 conn(0x7f4c300cfb70 legacy=0x7f4c300d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c300ce940 con 0x7f4c300b3a40 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f4c28001a00 con 0x7f4c300b3a40 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 >> v1:172.21.15.106:6789/0 conn(0x7f4c300b3a40 legacy=0x7f4c300d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c140039f0 0x7f4c14003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c14004810 0x7f4c14004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c3015d060 0x7f4c140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4c300b25a0 con 0x7f4c140039f0 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1400ba80 con 0x7f4c14004810 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1400bc80 con 0x7f4c3015d060 2024-04-26T21:17:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2f400640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c140039f0 0x7f4c14003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2fe00640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c3015d060 0x7f4c140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2f400640 1 -- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c3015d060 msgr2=0x7f4c140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2f400640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c3015d060 0x7f4c140051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2f400640 1 -- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c14004810 msgr2=0x7f4c14004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2ea00640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c14004810 0x7f4c14004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2f400640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c14004810 0x7f4c14004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2f400640 1 -- 172.21.15.106:0/1186531255 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c14003530 con 0x7f4c140039f0 2024-04-26T21:17:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.643+0000 7f4c2ea00640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c14004810 0x7f4c14004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:16.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c2f400640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c140039f0 0x7f4c14003e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009ab0 tx=0x7f4c2001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666051366167ccdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:16.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c200b2070 con 0x7f4c140039f0 2024-04-26T21:17:16.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c200a5510 con 0x7f4c140039f0 2024-04-26T21:17:16.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c2e000640 1 -- 172.21.15.106:0/1186531255 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c200096b0 con 0x7f4c140039f0 2024-04-26T21:17:16.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c36600640 1 -- 172.21.15.106:0/1186531255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c140039f0 msgr2=0x7f4c14003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c36600640 1 --2- 172.21.15.106:0/1186531255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c140039f0 0x7f4c14003e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009ab0 tx=0x7f4c2001ca30 comp rx=0 tx=0).stop 2024-04-26T21:17:16.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c2fe00640 1 -- 172.21.15.106:0/1186531255 reap_dead start 2024-04-26T21:17:16.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c36600640 1 -- 172.21.15.106:0/1186531255 shutdown_connections 2024-04-26T21:17:16.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c36600640 1 -- 172.21.15.106:0/1186531255 >> 172.21.15.106:0/1186531255 conn(0x7f4c300d2c60 msgr2=0x7f4c300d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:16.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c36600640 1 -- 172.21.15.106:0/1186531255 shutdown_connections 2024-04-26T21:17:16.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.647+0000 7f4c36600640 1 -- 172.21.15.106:0/1186531255 wait complete. 2024-04-26T21:17:16.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 Processor -- start 2024-04-26T21:17:16.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 -- start start 2024-04-26T21:17:16.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c140039f0 0x7f4c30155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c30157280 0x7f4c30157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c300cb7f0 0x7f4c300cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4c300ce400 con 0x7f4c30157280 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c300ce280 con 0x7f4c300cb7f0 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4c300d1650 con 0x7f4c140039f0 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c30157280 0x7f4c30157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c30157280 0x7f4c30157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55554/0 (socket says 172.21.15.106:55554) 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2ea00640 1 -- 172.21.15.106:0/3788181830 learned_addr learned my addr 172.21.15.106:0/3788181830 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2f400640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c140039f0 0x7f4c30155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2fe00640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c300cb7f0 0x7f4c300cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2ea00640 1 -- 172.21.15.106:0/3788181830 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c140039f0 msgr2=0x7f4c30155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2ea00640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c140039f0 0x7f4c30155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2ea00640 1 -- 172.21.15.106:0/3788181830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c300cb7f0 msgr2=0x7f4c300cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2ea00640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c300cb7f0 0x7f4c300cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2ea00640 1 -- 172.21.15.106:0/3788181830 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c30157d40 con 0x7f4c30157280 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2f400640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c140039f0 0x7f4c30155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c2ea00640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c30157280 0x7f4c30157700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00d7a0 tx=0x7f4c1c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c27400640 1 -- 172.21.15.106:0/3788181830 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c019070 con 0x7f4c30157280 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c27400640 1 -- 172.21.15.106:0/3788181830 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1c005270 con 0x7f4c30157280 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c27400640 1 -- 172.21.15.106:0/3788181830 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c007030 con 0x7f4c30157280 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c30158020 con 0x7f4c30157280 2024-04-26T21:17:16.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.651+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c301585e0 con 0x7f4c30157280 2024-04-26T21:17:16.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.655+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c30069400 con 0x7f4c30157280 2024-04-26T21:17:16.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.655+0000 7f4c27400640 1 -- 172.21.15.106:0/3788181830 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c1c01c070 con 0x7f4c30157280 2024-04-26T21:17:16.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.655+0000 7f4c27400640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c10068380 0x7f4c1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.655+0000 7f4c27400640 1 -- 172.21.15.106:0/3788181830 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f4c1c0865a0 con 0x7f4c30157280 2024-04-26T21:17:16.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.655+0000 7f4c2f400640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c10068380 0x7f4c1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.655+0000 7f4c2f400640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c10068380 0x7f4c1006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4c200af000 tx=0x7f4c200046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:16.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.659+0000 7f4c27400640 1 -- 172.21.15.106:0/3788181830 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4c1c056750 con 0x7f4c30157280 2024-04-26T21:17:16.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.819+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c30075020 con 0x7f4c30157280 2024-04-26T21:17:16.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.819+0000 7f4c27400640 1 -- 172.21.15.106:0/3788181830 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7f4c1c056050 con 0x7f4c30157280 2024-04-26T21:17:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:16.824 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c10068380 msgr2=0x7f4c1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c10068380 0x7f4c1006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4c200af000 tx=0x7f4c200046d0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c30157280 msgr2=0x7f4c30157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c30157280 0x7f4c30157700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00d7a0 tx=0x7f4c1c00dc60 comp rx=0 tx=0).stop 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 shutdown_connections 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c300cb7f0 0x7f4c300cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c10068380 0x7f4c1006a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c30157280 0x7f4c30157700 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 --2- 172.21.15.106:0/3788181830 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c140039f0 0x7f4c30155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 >> 172.21.15.106:0/3788181830 conn(0x7f4c300d2c60 msgr2=0x7f4c30071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:16.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 shutdown_connections 2024-04-26T21:17:16.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.823+0000 7f4c36600640 1 -- 172.21.15.106:0/3788181830 wait complete. 2024-04-26T21:17:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:16.846 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:16.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.979+0000 7fb2c2600640 1 Processor -- start 2024-04-26T21:17:16.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.979+0000 7fb2c2600640 1 -- start start 2024-04-26T21:17:16.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2c2600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2bc15d080 0x7fb2bc0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2c2600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc0b4f00 con 0x7fb2bc15da80 2024-04-26T21:17:16.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2c2600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc0b51e0 con 0x7fb2bc15c4e0 2024-04-26T21:17:16.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2c2600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fb2bc15d5f0 con 0x7fb2bc15d080 2024-04-26T21:17:16.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2b2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2bc15d080 0x7fb2bc0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2bbe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb2bc15da80 0x7fb2bc15df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58926/0 (socket says 172.21.15.106:58926) 2024-04-26T21:17:16.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2bbe00640 1 -- 172.21.15.106:0/3527624970 learned_addr learned my addr 172.21.15.106:0/3527624970 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:16.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2b2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2bc15d080 0x7fb2bc0b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49600/0 (socket says 172.21.15.106:49600) 2024-04-26T21:17:16.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2b2a00640 1 -- 172.21.15.106:0/3527624970 >> v1:172.21.15.112:6789/0 conn(0x7fb2bc15c4e0 legacy=0x7fb2bc15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2b2a00640 1 -- 172.21.15.106:0/3527624970 >> v1:172.21.15.106:6789/0 conn(0x7fb2bc15da80 legacy=0x7fb2bc15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.983+0000 7fb2b2a00640 1 -- 172.21.15.106:0/3527624970 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0b54c0 con 0x7fb2bc15d080 2024-04-26T21:17:16.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2b2a00640 1 --2- 172.21.15.106:0/3527624970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 0x7fb2bc0b4620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40097c0 tx=0x7fb2a401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3d3601fc570e62 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:16.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2baa00640 1 -- 172.21.15.106:0/3527624970 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40ab430 con 0x7fb2bc15d080 2024-04-26T21:17:16.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2baa00640 1 -- 172.21.15.106:0/3527624970 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a40b0070 con 0x7fb2bc15d080 2024-04-26T21:17:16.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2baa00640 1 -- 172.21.15.106:0/3527624970 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40ab7f0 con 0x7fb2bc15d080 2024-04-26T21:17:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2c2600640 1 -- 172.21.15.106:0/3527624970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 msgr2=0x7fb2bc0b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2c2600640 1 --2- 172.21.15.106:0/3527624970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 0x7fb2bc0b4620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40097c0 tx=0x7fb2a401c470 comp rx=0 tx=0).stop 2024-04-26T21:17:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2c2600640 1 -- 172.21.15.106:0/3527624970 shutdown_connections 2024-04-26T21:17:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2c2600640 1 --2- 172.21.15.106:0/3527624970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 0x7fb2bc0b4620 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2c2600640 1 -- 172.21.15.106:0/3527624970 >> 172.21.15.106:0/3527624970 conn(0x7fb2bc0b2910 msgr2=0x7fb2bc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2c2600640 1 -- 172.21.15.106:0/3527624970 shutdown_connections 2024-04-26T21:17:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2c2600640 1 -- 172.21.15.106:0/3527624970 wait complete. 2024-04-26T21:17:16.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2c2600640 1 Processor -- start 2024-04-26T21:17:16.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.987+0000 7fb2c2600640 1 -- start start 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2c2600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2bc15c4e0 0x7fb2bc15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2c2600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 0x7fb2bc0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2c2600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2bc15da80 0x7fb2bc13ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2c2600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc169f50 con 0x7fb2bc15d080 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2c2600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc169dd0 con 0x7fb2bc15da80 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2c2600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc16a0d0 con 0x7fb2bc15c4e0 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 0x7fb2bc0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 0x7fb2bc0cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49606/0 (socket says 172.21.15.106:49606) 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b2a00640 1 -- 172.21.15.106:0/3235103567 learned_addr learned my addr 172.21.15.106:0/3235103567 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2bb400640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2bc15c4e0 0x7fb2bc15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2bbe00640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2bc15da80 0x7fb2bc13ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b2a00640 1 -- 172.21.15.106:0/3235103567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2bc15c4e0 msgr2=0x7fb2bc15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b2a00640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2bc15c4e0 0x7fb2bc15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b2a00640 1 -- 172.21.15.106:0/3235103567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2bc15da80 msgr2=0x7fb2bc13ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b2a00640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2bc15da80 0x7fb2bc13ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b2a00640 1 -- 172.21.15.106:0/3235103567 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0cd0f0 con 0x7fb2bc15d080 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b2a00640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 0x7fb2bc0cc6a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb2a401a0a0 tx=0x7fb2a401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b3e00640 1 -- 172.21.15.106:0/3235103567 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40bf610 con 0x7fb2bc15d080 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b3e00640 1 -- 172.21.15.106:0/3235103567 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a40bf7f0 con 0x7fb2bc15d080 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b3e00640 1 -- 172.21.15.106:0/3235103567 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40bfbe0 con 0x7fb2bc15d080 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc1446a0 con 0x7fb2bc15d080 2024-04-26T21:17:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc144c60 con 0x7fb2bc15d080 2024-04-26T21:17:16.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2bc069400 con 0x7fb2bc15d080 2024-04-26T21:17:16.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.991+0000 7fb2b3e00640 1 -- 172.21.15.106:0/3235103567 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb2a40bd020 con 0x7fb2bc15d080 2024-04-26T21:17:16.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.995+0000 7fb2b3e00640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb298068380 0x7fb29806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:16.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.995+0000 7fb2b3e00640 1 -- 172.21.15.106:0/3235103567 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fb2a40a8030 con 0x7fb2bc15d080 2024-04-26T21:17:16.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.995+0000 7fb2bb400640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb298068380 0x7fb29806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:16.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.995+0000 7fb2bb400640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb298068380 0x7fb29806a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc1fba00 tx=0x7fb2ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:16.999+0000 7fb2b3e00640 1 -- 172.21.15.106:0/3235103567 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb2a40c4060 con 0x7fb2bc15d080 2024-04-26T21:17:17.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.151+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb2bc06fb90 con 0x7fb2bc15d080 2024-04-26T21:17:17.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2b3e00640 1 -- 172.21.15.106:0/3235103567 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fb2a4016090 con 0x7fb2bc15d080 2024-04-26T21:17:17.157 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb298068380 msgr2=0x7fb29806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb298068380 0x7fb29806a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc1fba00 tx=0x7fb2ac009040 comp rx=0 tx=0).stop 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 msgr2=0x7fb2bc0cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 0x7fb2bc0cc6a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb2a401a0a0 tx=0x7fb2a401acb0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 shutdown_connections 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2bc15da80 0x7fb2bc13ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb298068380 0x7fb29806a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2bc15d080 0x7fb2bc0cc6a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 --2- 172.21.15.106:0/3235103567 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2bc15c4e0 0x7fb2bc15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 >> 172.21.15.106:0/3235103567 conn(0x7fb2bc0b2910 msgr2=0x7fb2bc141b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:17.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 shutdown_connections 2024-04-26T21:17:17.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.155+0000 7fb2c2600640 1 -- 172.21.15.106:0/3235103567 wait complete. 2024-04-26T21:17:17.178 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:17.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.311+0000 7fc467800640 1 Processor -- start 2024-04-26T21:17:17.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.311+0000 7fc467800640 1 -- start start 2024-04-26T21:17:17.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc467800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc4600b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc467800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4600b4f00 con 0x7fc46015da80 2024-04-26T21:17:17.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc467800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4600b51e0 con 0x7fc46015c4e0 2024-04-26T21:17:17.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc467800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc46015d5f0 con 0x7fc46015d080 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc465800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc46015da80 0x7fc46015df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58930/0 (socket says 172.21.15.106:58930) 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc465800640 1 -- 172.21.15.106:0/227320004 learned_addr learned my addr 172.21.15.106:0/227320004 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc457e00640 1 --2- 172.21.15.106:0/227320004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc4600b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc45fe00640 1 -- 172.21.15.106:0/227320004 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566800546 0 0) 0x7fc4600b4f00 con 0x7fc46015da80 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc45fe00640 1 -- 172.21.15.106:0/227320004 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc444005740 con 0x7fc46015da80 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc45fe00640 1 -- 172.21.15.106:0/227320004 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603959089 0 0) 0x7fc4600b51e0 con 0x7fc46015c4e0 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc45fe00640 1 -- 172.21.15.106:0/227320004 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4600b4f00 con 0x7fc46015c4e0 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc45fe00640 1 -- 172.21.15.106:0/227320004 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2665055160 0 0) 0x7fc444005740 con 0x7fc46015da80 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc457e00640 1 -- 172.21.15.106:0/227320004 >> v1:172.21.15.112:6789/0 conn(0x7fc46015c4e0 legacy=0x7fc46015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc457e00640 1 -- 172.21.15.106:0/227320004 >> v1:172.21.15.106:6789/0 conn(0x7fc46015da80 legacy=0x7fc46015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.315+0000 7fc457e00640 1 -- 172.21.15.106:0/227320004 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4600b54c0 con 0x7fc46015d080 2024-04-26T21:17:17.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc457e00640 1 --2- 172.21.15.106:0/227320004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc4600b4620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc448009820 tx=0x7fc44801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b8274ea159876 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc45fe00640 1 -- 172.21.15.106:0/227320004 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4480b0070 con 0x7fc46015d080 2024-04-26T21:17:17.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc45fe00640 1 -- 172.21.15.106:0/227320004 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4480ab400 con 0x7fc46015d080 2024-04-26T21:17:17.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc45fe00640 1 -- 172.21.15.106:0/227320004 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458001a00 con 0x7fc46015d080 2024-04-26T21:17:17.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 -- 172.21.15.106:0/227320004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 msgr2=0x7fc4600b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 --2- 172.21.15.106:0/227320004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc4600b4620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc448009820 tx=0x7fc44801c3b0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 -- 172.21.15.106:0/227320004 shutdown_connections 2024-04-26T21:17:17.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 --2- 172.21.15.106:0/227320004 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc4600b4620 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 -- 172.21.15.106:0/227320004 >> 172.21.15.106:0/227320004 conn(0x7fc4600b2910 msgr2=0x7fc4600b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:17.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 -- 172.21.15.106:0/227320004 shutdown_connections 2024-04-26T21:17:17.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 -- 172.21.15.106:0/227320004 wait complete. 2024-04-26T21:17:17.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 Processor -- start 2024-04-26T21:17:17.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 -- start start 2024-04-26T21:17:17.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46015c4e0 0x7fc460144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc460141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc46015da80 0x7fc4601f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc46006ea00 con 0x7fc46015da80 2024-04-26T21:17:17.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc46006e880 con 0x7fc46015c4e0 2024-04-26T21:17:17.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc467800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc46006eb80 con 0x7fc46015d080 2024-04-26T21:17:17.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc465800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc46015da80 0x7fc4601f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc465800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc46015da80 0x7fc4601f3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49614/0 (socket says 172.21.15.106:49614) 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.319+0000 7fc465800640 1 -- 172.21.15.106:0/1599227045 learned_addr learned my addr 172.21.15.106:0/1599227045 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc457e00640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc460141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc464e00640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46015c4e0 0x7fc460144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc465800640 1 -- 172.21.15.106:0/1599227045 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 msgr2=0x7fc460141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc465800640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc460141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc465800640 1 -- 172.21.15.106:0/1599227045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46015c4e0 msgr2=0x7fc460144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc465800640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46015c4e0 0x7fc460144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc465800640 1 -- 172.21.15.106:0/1599227045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4600d1200 con 0x7fc46015da80 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc457e00640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc460141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc465800640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc46015da80 0x7fc4601f3db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc45800cbf0 tx=0x7fc45800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc45d600640 1 -- 172.21.15.106:0/1599227045 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458017070 con 0x7fc46015da80 2024-04-26T21:17:17.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc45d600640 1 -- 172.21.15.106:0/1599227045 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45800ad50 con 0x7fc46015da80 2024-04-26T21:17:17.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4600d14e0 con 0x7fc46015da80 2024-04-26T21:17:17.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc45d600640 1 -- 172.21.15.106:0/1599227045 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458012600 con 0x7fc46015da80 2024-04-26T21:17:17.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc460144950 con 0x7fc46015da80 2024-04-26T21:17:17.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc460069400 con 0x7fc46015da80 2024-04-26T21:17:17.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc45d600640 1 -- 172.21.15.106:0/1599227045 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc45801a070 con 0x7fc46015da80 2024-04-26T21:17:17.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc45d600640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc43c068380 0x7fc43c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc45d600640 1 -- 172.21.15.106:0/1599227045 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc458086bb0 con 0x7fc46015da80 2024-04-26T21:17:17.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.323+0000 7fc464e00640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc43c068380 0x7fc43c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.327+0000 7fc464e00640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc43c068380 0x7fc43c06a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4500011f0 tx=0x7fc450009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.327+0000 7fc45d600640 1 -- 172.21.15.106:0/1599227045 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc458056710 con 0x7fc46015da80 2024-04-26T21:17:17.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc46006fb90 con 0x7fc46015da80 2024-04-26T21:17:17.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc45d600640 1 -- 172.21.15.106:0/1599227045 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fc45805aa10 con 0x7fc46015da80 2024-04-26T21:17:17.490 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc43c068380 msgr2=0x7fc43c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc43c068380 0x7fc43c06a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4500011f0 tx=0x7fc450009040 comp rx=0 tx=0).stop 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc46015da80 msgr2=0x7fc4601f3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc46015da80 0x7fc4601f3db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc45800cbf0 tx=0x7fc45800a430 comp rx=0 tx=0).stop 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 shutdown_connections 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc43c068380 0x7fc43c06a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc46015da80 0x7fc4601f3db0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc46015d080 0x7fc460141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 --2- 172.21.15.106:0/1599227045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46015c4e0 0x7fc460144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 >> 172.21.15.106:0/1599227045 conn(0x7fc4600b2910 msgr2=0x7fc460073780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 shutdown_connections 2024-04-26T21:17:17.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.487+0000 7fc467800640 1 -- 172.21.15.106:0/1599227045 wait complete. 2024-04-26T21:17:17.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:17.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f68a00640 1 Processor -- start 2024-04-26T21:17:17.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f68a00640 1 -- start start 2024-04-26T21:17:17.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f68a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 0x7f1f6415f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f68a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f640729c0 con 0x7f1f64159890 2024-04-26T21:17:17.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f68a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f64072ca0 con 0x7f1f64162bd0 2024-04-26T21:17:17.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f68a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1f64072770 con 0x7f1f640d1850 2024-04-26T21:17:17.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f61e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1f64159890 0x7f1f6406ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58936/0 (socket says 172.21.15.106:58936) 2024-04-26T21:17:17.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f61e00640 1 -- 172.21.15.106:0/4156505088 learned_addr learned my addr 172.21.15.106:0/4156505088 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:17.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f62800640 1 --2- 172.21.15.106:0/4156505088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 0x7f1f6415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f60a00640 1 -- 172.21.15.106:0/4156505088 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401834454 0 0) 0x7f1f640729c0 con 0x7f1f64159890 2024-04-26T21:17:17.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f60a00640 1 -- 172.21.15.106:0/4156505088 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f48003530 con 0x7f1f64159890 2024-04-26T21:17:17.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f60a00640 1 -- 172.21.15.106:0/4156505088 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2328120865 0 0) 0x7f1f64072ca0 con 0x7f1f64162bd0 2024-04-26T21:17:17.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f60a00640 1 -- 172.21.15.106:0/4156505088 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f640729c0 con 0x7f1f64162bd0 2024-04-26T21:17:17.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f62800640 1 -- 172.21.15.106:0/4156505088 >> v1:172.21.15.112:6789/0 conn(0x7f1f64162bd0 legacy=0x7f1f640d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f62800640 1 -- 172.21.15.106:0/4156505088 >> v1:172.21.15.106:6789/0 conn(0x7f1f64159890 legacy=0x7f1f6406ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.647+0000 7f1f62800640 1 -- 172.21.15.106:0/4156505088 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f64072f80 con 0x7f1f640d1850 2024-04-26T21:17:17.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.651+0000 7f1f62800640 1 --2- 172.21.15.106:0/4156505088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 0x7f1f6415f850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009dc0 tx=0x7f1f5c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ebe36a0d8f0e0c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.651+0000 7f1f60a00640 1 -- 172.21.15.106:0/4156505088 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0b2070 con 0x7f1f640d1850 2024-04-26T21:17:17.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.651+0000 7f1f60a00640 1 -- 172.21.15.106:0/4156505088 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5c0a5850 con 0x7f1f640d1850 2024-04-26T21:17:17.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.651+0000 7f1f60a00640 1 -- 172.21.15.106:0/4156505088 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0a5c20 con 0x7f1f640d1850 2024-04-26T21:17:17.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.651+0000 7f1f68a00640 1 -- 172.21.15.106:0/4156505088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 msgr2=0x7f1f6415f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.651+0000 7f1f68a00640 1 --2- 172.21.15.106:0/4156505088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 0x7f1f6415f850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009dc0 tx=0x7f1f5c01c990 comp rx=0 tx=0).stop 2024-04-26T21:17:17.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 -- 172.21.15.106:0/4156505088 shutdown_connections 2024-04-26T21:17:17.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 --2- 172.21.15.106:0/4156505088 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 0x7f1f6415f850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 -- 172.21.15.106:0/4156505088 >> 172.21.15.106:0/4156505088 conn(0x7f1f6406c400 msgr2=0x7f1f6406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:17.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 -- 172.21.15.106:0/4156505088 shutdown_connections 2024-04-26T21:17:17.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 -- 172.21.15.106:0/4156505088 wait complete. 2024-04-26T21:17:17.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 Processor -- start 2024-04-26T21:17:17.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 -- start start 2024-04-26T21:17:17.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 0x7f1f6415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f64162bd0 0x7f1f641544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f64154a30 0x7f1f64155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6416cf80 con 0x7f1f64154a30 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1f64162fe0 con 0x7f1f64162bd0 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f68a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6416d100 con 0x7f1f640d1850 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f62800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f64154a30 0x7f1f64155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f62800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f64154a30 0x7f1f64155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49622/0 (socket says 172.21.15.106:49622) 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f62800640 1 -- 172.21.15.106:0/4153872652 learned_addr learned my addr 172.21.15.106:0/4153872652 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f61e00640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 0x7f1f6415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f61400640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f64162bd0 0x7f1f641544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f62800640 1 -- 172.21.15.106:0/4153872652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 msgr2=0x7f1f6415b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f62800640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 0x7f1f6415b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f62800640 1 -- 172.21.15.106:0/4153872652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f64162bd0 msgr2=0x7f1f641544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f62800640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f64162bd0 0x7f1f641544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f62800640 1 -- 172.21.15.106:0/4153872652 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f64154ed0 con 0x7f1f64154a30 2024-04-26T21:17:17.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f61400640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f64162bd0 0x7f1f641544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:17.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.655+0000 7f1f62800640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f64154a30 0x7f1f64155b40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c01a5c0 tx=0x7f1f5c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f5a000640 1 -- 172.21.15.106:0/4153872652 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0b2040 con 0x7f1f64154a30 2024-04-26T21:17:17.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f5a000640 1 -- 172.21.15.106:0/4153872652 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5c0bf070 con 0x7f1f64154a30 2024-04-26T21:17:17.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6415a8c0 con 0x7f1f64154a30 2024-04-26T21:17:17.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f5a000640 1 -- 172.21.15.106:0/4153872652 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0b86b0 con 0x7f1f64154a30 2024-04-26T21:17:17.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6415ae80 con 0x7f1f64154a30 2024-04-26T21:17:17.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6415b080 con 0x7f1f64154a30 2024-04-26T21:17:17.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f5a000640 1 -- 172.21.15.106:0/4153872652 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f5c0b8850 con 0x7f1f64154a30 2024-04-26T21:17:17.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f5a000640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1f40068380 0x7f1f4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f5a000640 1 -- 172.21.15.106:0/4153872652 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f1f5c121db0 con 0x7f1f64154a30 2024-04-26T21:17:17.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f61e00640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1f40068380 0x7f1f4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.659+0000 7f1f61e00640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1f40068380 0x7f1f4006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c007fd0 tx=0x7f1f4c007d80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.663+0000 7f1f5a000640 1 -- 172.21.15.106:0/4153872652 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1f6415b080 con 0x7f1f64154a30 2024-04-26T21:17:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.819+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1f64069400 con 0x7f1f64154a30 2024-04-26T21:17:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.819+0000 7f1f5a000640 1 -- 172.21.15.106:0/4153872652 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f1f5c016580 con 0x7f1f64154a30 2024-04-26T21:17:17.824 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1f40068380 msgr2=0x7f1f4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1f40068380 0x7f1f4006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c007fd0 tx=0x7f1f4c007d80 comp rx=0 tx=0).stop 2024-04-26T21:17:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f64154a30 msgr2=0x7f1f64155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f64154a30 0x7f1f64155b40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c01a5c0 tx=0x7f1f5c019730 comp rx=0 tx=0).stop 2024-04-26T21:17:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 shutdown_connections 2024-04-26T21:17:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f64162bd0 0x7f1f641544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1f40068380 0x7f1f4006a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f64154a30 0x7f1f64155b40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 --2- 172.21.15.106:0/4153872652 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1f640d1850 0x7f1f6415b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 >> 172.21.15.106:0/4153872652 conn(0x7f1f6406c400 msgr2=0x7f1f6406e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:17.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 shutdown_connections 2024-04-26T21:17:17.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.823+0000 7f1f68a00640 1 -- 172.21.15.106:0/4153872652 wait complete. 2024-04-26T21:17:17.845 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:17.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e2ec00640 1 Processor -- start 2024-04-26T21:17:17.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e2ec00640 1 -- start start 2024-04-26T21:17:17.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e2ec00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e280b5260 0x7f3e2815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e2ec00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3e2815de50 0x7f3e28166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e2ec00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e280b44a0 con 0x7f3e2815d530 2024-04-26T21:17:17.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e2ec00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f3e280b4780 con 0x7f3e280b5260 2024-04-26T21:17:17.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e2ec00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3e280b4a60 con 0x7f3e2815de50 2024-04-26T21:17:17.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e27e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3e2815d530 0x7f3e280cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58950/0 (socket says 172.21.15.106:58950) 2024-04-26T21:17:17.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e27e00640 1 -- 172.21.15.106:0/2560570840 learned_addr learned my addr 172.21.15.106:0/2560570840 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:17.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e1f400640 1 --2- 172.21.15.106:0/2560570840 >> v2:172.21.15.106:3300/0 conn(0x7f3e280b5260 0x7f3e2815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.979+0000 7f3e2cc00640 1 --2- 172.21.15.106:0/2560570840 >> v2:172.21.15.112:3300/0 conn(0x7f3e2815de50 0x7f3e28166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e1f400640 1 -- 172.21.15.106:0/2560570840 >> v2:172.21.15.112:3300/0 conn(0x7f3e2815de50 msgr2=0x7f3e28166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:17.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e1f400640 1 --2- 172.21.15.106:0/2560570840 >> v2:172.21.15.112:3300/0 conn(0x7f3e2815de50 0x7f3e28166ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e1f400640 1 -- 172.21.15.106:0/2560570840 >> v1:172.21.15.106:6789/0 conn(0x7f3e2815d530 legacy=0x7f3e280cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e1f400640 1 -- 172.21.15.106:0/2560570840 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e280b4d40 con 0x7f3e280b5260 2024-04-26T21:17:17.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e2cc00640 1 --2- 172.21.15.106:0/2560570840 >> v2:172.21.15.112:3300/0 conn(0x7f3e2815de50 0x7f3e28166ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:17.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e1f400640 1 --2- 172.21.15.106:0/2560570840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e280b5260 0x7f3e2815d910 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e28146db0 tx=0x7f3e1001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce18e8be52589ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e27400640 1 -- 172.21.15.106:0/2560570840 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e100ab640 con 0x7f3e280b5260 2024-04-26T21:17:17.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e27400640 1 -- 172.21.15.106:0/2560570840 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e100b0070 con 0x7f3e280b5260 2024-04-26T21:17:17.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e27400640 1 -- 172.21.15.106:0/2560570840 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e100aba00 con 0x7f3e280b5260 2024-04-26T21:17:17.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e2ec00640 1 -- 172.21.15.106:0/2560570840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e280b5260 msgr2=0x7f3e2815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e2ec00640 1 --2- 172.21.15.106:0/2560570840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e280b5260 0x7f3e2815d910 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e28146db0 tx=0x7f3e1001c480 comp rx=0 tx=0).stop 2024-04-26T21:17:17.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e2ec00640 1 -- 172.21.15.106:0/2560570840 shutdown_connections 2024-04-26T21:17:17.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e2ec00640 1 --2- 172.21.15.106:0/2560570840 >> v2:172.21.15.112:3300/0 conn(0x7f3e2815de50 0x7f3e28166ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e2ec00640 1 --2- 172.21.15.106:0/2560570840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e280b5260 0x7f3e2815d910 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e2ec00640 1 -- 172.21.15.106:0/2560570840 >> 172.21.15.106:0/2560570840 conn(0x7f3e280b2910 msgr2=0x7f3e280b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:17.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.983+0000 7f3e2ec00640 1 -- 172.21.15.106:0/2560570840 shutdown_connections 2024-04-26T21:17:17.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 -- 172.21.15.106:0/2560570840 wait complete. 2024-04-26T21:17:17.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 Processor -- start 2024-04-26T21:17:17.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 -- start start 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e280b5260 0x7f3e2813c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e2815d530 0x7f3e28138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e2815de50 0x7f3e28140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3e280d06b0 con 0x7f3e2815d530 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3e280d0530 con 0x7f3e280b5260 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3e28169840 con 0x7f3e2815de50 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e1f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e2815d530 0x7f3e28138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e1f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e2815d530 0x7f3e28138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49636/0 (socket says 172.21.15.106:49636) 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e1f400640 1 -- 172.21.15.106:0/1061164030 learned_addr learned my addr 172.21.15.106:0/1061164030 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e27e00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e280b5260 0x7f3e2813c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2cc00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e2815de50 0x7f3e28140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e1f400640 1 -- 172.21.15.106:0/1061164030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e2815de50 msgr2=0x7f3e28140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e1f400640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e2815de50 0x7f3e28140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e1f400640 1 -- 172.21.15.106:0/1061164030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e280b5260 msgr2=0x7f3e2813c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:17.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e1f400640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e280b5260 0x7f3e2813c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:17.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e1f400640 1 -- 172.21.15.106:0/1061164030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e28143f60 con 0x7f3e2815d530 2024-04-26T21:17:17.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2cc00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e2815de50 0x7f3e28140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:17.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e1f400640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e2815d530 0x7f3e28138d40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3e100ad040 tx=0x7f3e1001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e24c00640 1 -- 172.21.15.106:0/1061164030 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e100bf410 con 0x7f3e2815d530 2024-04-26T21:17:17.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e24c00640 1 -- 172.21.15.106:0/1061164030 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e100bf5b0 con 0x7f3e2815d530 2024-04-26T21:17:17.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e28143c80 con 0x7f3e2815d530 2024-04-26T21:17:17.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.987+0000 7f3e24c00640 1 -- 172.21.15.106:0/1061164030 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e100bf9a0 con 0x7f3e2815d530 2024-04-26T21:17:17.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.991+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2813bbc0 con 0x7f3e2815d530 2024-04-26T21:17:17.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.991+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e28069400 con 0x7f3e2815d530 2024-04-26T21:17:17.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.991+0000 7f3e24c00640 1 -- 172.21.15.106:0/1061164030 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e100bd020 con 0x7f3e2815d530 2024-04-26T21:17:17.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.991+0000 7f3e24c00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e04068380 0x7f3e0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:17.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.991+0000 7f3e24c00640 1 -- 172.21.15.106:0/1061164030 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f3e101213c0 con 0x7f3e2815d530 2024-04-26T21:17:17.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.991+0000 7f3e27e00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e04068380 0x7f3e0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:17.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.991+0000 7f3e27e00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e04068380 0x7f3e0406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e18000f70 tx=0x7f3e18007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:17.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:17.995+0000 7f3e24c00640 1 -- 172.21.15.106:0/1061164030 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3e10016070 con 0x7f3e2815d530 2024-04-26T21:17:18.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.151+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3e2813f520 con 0x7f3e2815d530 2024-04-26T21:17:18.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.151+0000 7f3e24c00640 1 -- 172.21.15.106:0/1061164030 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f3e100f0fc0 con 0x7f3e2815d530 2024-04-26T21:17:18.155 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:18.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e04068380 msgr2=0x7f3e0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e04068380 0x7f3e0406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e18000f70 tx=0x7f3e18007e90 comp rx=0 tx=0).stop 2024-04-26T21:17:18.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e2815d530 msgr2=0x7f3e28138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e2815d530 0x7f3e28138d40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3e100ad040 tx=0x7f3e1001acc0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 shutdown_connections 2024-04-26T21:17:18.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3e04068380 0x7f3e0406a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3e2815de50 0x7f3e28140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e2815d530 0x7f3e28138d40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 --2- 172.21.15.106:0/1061164030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e280b5260 0x7f3e2813c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 >> 172.21.15.106:0/1061164030 conn(0x7f3e280b2910 msgr2=0x7f3e280b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:18.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 shutdown_connections 2024-04-26T21:17:18.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.155+0000 7f3e2ec00640 1 -- 172.21.15.106:0/1061164030 wait complete. 2024-04-26T21:17:18.176 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:17:18.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe23e200640 1 Processor -- start 2024-04-26T21:17:18.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe23e200640 1 -- start start 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe23e200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2380d1500 0x7fe2380b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe23e200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe238146b70 0x7fe2380b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe23e200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe238163b70 con 0x7fe2381464d0 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe23e200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe2381468b0 con 0x7fe2380d1500 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe23e200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe238163e10 con 0x7fe238146b70 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe236a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2380d1500 0x7fe2380b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe236a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2380d1500 0x7fe2380b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49652/0 (socket says 172.21.15.106:49652) 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe236a00640 1 -- 172.21.15.106:0/1907195321 learned_addr learned my addr 172.21.15.106:0/1907195321 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe237e00640 1 --2- 172.21.15.106:0/1907195321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe238146b70 0x7fe2380b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe236a00640 1 -- 172.21.15.106:0/1907195321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe238146b70 msgr2=0x7fe2380b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe236a00640 1 --2- 172.21.15.106:0/1907195321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe238146b70 0x7fe2380b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe236a00640 1 -- 172.21.15.106:0/1907195321 >> v1:172.21.15.112:6789/0 conn(0x7fe2381464d0 legacy=0x7fe2380d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe236a00640 1 -- 172.21.15.106:0/1907195321 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2381640f0 con 0x7fe2380d1500 2024-04-26T21:17:18.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.311+0000 7fe237e00640 1 --2- 172.21.15.106:0/1907195321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe238146b70 0x7fe2380b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:18.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe236a00640 1 --2- 172.21.15.106:0/1907195321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2380d1500 0x7fe2380b3c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe224009870 tx=0x7fe22401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8d446efedbec42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:18.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe236000640 1 -- 172.21.15.106:0/1907195321 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240aa650 con 0x7fe2380d1500 2024-04-26T21:17:18.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe236000640 1 -- 172.21.15.106:0/1907195321 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2240af070 con 0x7fe2380d1500 2024-04-26T21:17:18.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe236000640 1 -- 172.21.15.106:0/1907195321 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240aaa10 con 0x7fe2380d1500 2024-04-26T21:17:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe23e200640 1 -- 172.21.15.106:0/1907195321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2380d1500 msgr2=0x7fe2380b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe23e200640 1 --2- 172.21.15.106:0/1907195321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2380d1500 0x7fe2380b3c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe224009870 tx=0x7fe22401c530 comp rx=0 tx=0).stop 2024-04-26T21:17:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe23e200640 1 -- 172.21.15.106:0/1907195321 shutdown_connections 2024-04-26T21:17:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe23e200640 1 --2- 172.21.15.106:0/1907195321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe238146b70 0x7fe2380b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe23e200640 1 --2- 172.21.15.106:0/1907195321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2380d1500 0x7fe2380b3c80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe23e200640 1 -- 172.21.15.106:0/1907195321 >> 172.21.15.106:0/1907195321 conn(0x7fe238068340 msgr2=0x7fe238068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe23e200640 1 -- 172.21.15.106:0/1907195321 shutdown_connections 2024-04-26T21:17:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.315+0000 7fe23e200640 1 -- 172.21.15.106:0/1907195321 wait complete. 2024-04-26T21:17:18.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 Processor -- start 2024-04-26T21:17:18.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 -- start start 2024-04-26T21:17:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2380d1500 0x7fe238156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2381464d0 0x7fe23813fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe238146b70 0x7fe2380b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe238149620 con 0x7fe238146b70 2024-04-26T21:17:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2381494a0 con 0x7fe2381464d0 2024-04-26T21:17:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe2381497a0 con 0x7fe2380d1500 2024-04-26T21:17:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe238146b70 0x7fe2380b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe238146b70 0x7fe2380b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49664/0 (socket says 172.21.15.106:49664) 2024-04-26T21:17:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237e00640 1 -- 172.21.15.106:0/2529696795 learned_addr learned my addr 172.21.15.106:0/2529696795 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237400640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2380d1500 0x7fe238156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe236a00640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2381464d0 0x7fe23813fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237e00640 1 -- 172.21.15.106:0/2529696795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2380d1500 msgr2=0x7fe238156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237e00640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2380d1500 0x7fe238156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237e00640 1 -- 172.21.15.106:0/2529696795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2381464d0 msgr2=0x7fe23813fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237e00640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2381464d0 0x7fe23813fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237e00640 1 -- 172.21.15.106:0/2529696795 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2380b12f0 con 0x7fe238146b70 2024-04-26T21:17:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe237e00640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe238146b70 0x7fe2380b0db0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe230007e70 tx=0x7fe23000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:18.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe22f400640 1 -- 172.21.15.106:0/2529696795 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23001a070 con 0x7fe238146b70 2024-04-26T21:17:18.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe22f400640 1 -- 172.21.15.106:0/2529696795 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe230003bc0 con 0x7fe238146b70 2024-04-26T21:17:18.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe22f400640 1 -- 172.21.15.106:0/2529696795 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230004030 con 0x7fe238146b70 2024-04-26T21:17:18.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2380b1590 con 0x7fe238146b70 2024-04-26T21:17:18.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2380b1b50 con 0x7fe238146b70 2024-04-26T21:17:18.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.319+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe238069400 con 0x7fe238146b70 2024-04-26T21:17:18.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.323+0000 7fe22f400640 1 -- 172.21.15.106:0/2529696795 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe23001d070 con 0x7fe238146b70 2024-04-26T21:17:18.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.323+0000 7fe22f400640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe218068380 0x7fe21806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.323+0000 7fe22f400640 1 -- 172.21.15.106:0/2529696795 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe230087040 con 0x7fe238146b70 2024-04-26T21:17:18.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.323+0000 7fe237400640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe218068380 0x7fe21806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.323+0000 7fe237400640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe218068380 0x7fe21806a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe238166c90 tx=0x7fe228009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:18.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.327+0000 7fe22f400640 1 -- 172.21.15.106:0/2529696795 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe230010070 con 0x7fe238146b70 2024-04-26T21:17:18.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe23816e1c0 con 0x7fe238146b70 2024-04-26T21:17:18.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe22f400640 1 -- 172.21.15.106:0/2529696795 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fe230057200 con 0x7fe238146b70 2024-04-26T21:17:18.498 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe218068380 msgr2=0x7fe21806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe218068380 0x7fe21806a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe238166c90 tx=0x7fe228009040 comp rx=0 tx=0).stop 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe238146b70 msgr2=0x7fe2380b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe238146b70 0x7fe2380b0db0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe230007e70 tx=0x7fe23000d4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 shutdown_connections 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2381464d0 0x7fe23813fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe218068380 0x7fe21806a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe238146b70 0x7fe2380b0db0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 --2- 172.21.15.106:0/2529696795 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe2380d1500 0x7fe238156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 >> 172.21.15.106:0/2529696795 conn(0x7fe238068340 msgr2=0x7fe238068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 shutdown_connections 2024-04-26T21:17:18.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.495+0000 7fe23e200640 1 -- 172.21.15.106:0/2529696795 wait complete. 2024-04-26T21:17:18.520 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-04-26T21:17:18.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:18.520 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-26T21:17:18.551 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:17:18.552 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:17:18.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:18.552 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T21:17:18.593 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:17:18.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:17:18.621 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:17:18.622 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:18.648 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:17:18.648 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:18.700 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:18.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8309c00640 1 Processor -- start 2024-04-26T21:17:18.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8309c00640 1 -- start start 2024-04-26T21:17:18.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8309c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f830413f140 0x7f830415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8309c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f830406eb70 0x7f83040d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8309c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83040b3d10 con 0x7f830413ed60 2024-04-26T21:17:18.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8309c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f83040b3ac0 con 0x7f830406eb70 2024-04-26T21:17:18.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8309c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f83040b4920 con 0x7f830413f140 2024-04-26T21:17:18.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8303400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f830406eb70 0x7f83040d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8303400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f830406eb70 0x7f83040d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49680/0 (socket says 172.21.15.106:49680) 2024-04-26T21:17:18.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8303400640 1 -- 172.21.15.106:0/1195503621 learned_addr learned my addr 172.21.15.106:0/1195503621 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:18.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8302000640 1 --2- 172.21.15.106:0/1195503621 >> v2:172.21.15.112:3300/0 conn(0x7f830413f140 0x7f830415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8303400640 1 -- 172.21.15.106:0/1195503621 >> v2:172.21.15.112:3300/0 conn(0x7f830413f140 msgr2=0x7f830415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:18.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8303400640 1 --2- 172.21.15.106:0/1195503621 >> v2:172.21.15.112:3300/0 conn(0x7f830413f140 0x7f830415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8303400640 1 -- 172.21.15.106:0/1195503621 >> v1:172.21.15.112:6789/0 conn(0x7f830413ed60 legacy=0x7f83040b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.875+0000 7f8303400640 1 -- 172.21.15.106:0/1195503621 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83040b3ff0 con 0x7f830406eb70 2024-04-26T21:17:18.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8303400640 1 --2- 172.21.15.106:0/1195503621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f830406eb70 0x7f83040d0df0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f830415f930 tx=0x7f82fc01ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b697e26e80dd0a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:18.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8301600640 1 -- 172.21.15.106:0/1195503621 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc00b2d0 con 0x7f830406eb70 2024-04-26T21:17:18.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8301600640 1 -- 172.21.15.106:0/1195503621 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82fc00b470 con 0x7f830406eb70 2024-04-26T21:17:18.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8301600640 1 -- 172.21.15.106:0/1195503621 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0a7ad0 con 0x7f830406eb70 2024-04-26T21:17:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8309c00640 1 -- 172.21.15.106:0/1195503621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f830406eb70 msgr2=0x7f83040d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8309c00640 1 --2- 172.21.15.106:0/1195503621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f830406eb70 0x7f83040d0df0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f830415f930 tx=0x7f82fc01ead0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8309c00640 1 -- 172.21.15.106:0/1195503621 shutdown_connections 2024-04-26T21:17:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8309c00640 1 --2- 172.21.15.106:0/1195503621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f830406eb70 0x7f83040d0df0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8309c00640 1 --2- 172.21.15.106:0/1195503621 >> v2:172.21.15.112:3300/0 conn(0x7f830413f140 0x7f830415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8309c00640 1 -- 172.21.15.106:0/1195503621 >> 172.21.15.106:0/1195503621 conn(0x7f8304068340 msgr2=0x7f8304068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8309c00640 1 -- 172.21.15.106:0/1195503621 shutdown_connections 2024-04-26T21:17:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.879+0000 7f8309c00640 1 -- 172.21.15.106:0/1195503621 wait complete. 2024-04-26T21:17:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 Processor -- start 2024-04-26T21:17:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 -- start start 2024-04-26T21:17:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f830413ed60 0x7f830413da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830415dd90 0x7f830415d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83040b16b0 0x7f8304157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8304160790 con 0x7f83040b16b0 2024-04-26T21:17:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8304160610 con 0x7f830415dd90 2024-04-26T21:17:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8304071f50 con 0x7f830413ed60 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8303400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83040b16b0 0x7f8304157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8303400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83040b16b0 0x7f8304157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49684/0 (socket says 172.21.15.106:49684) 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8303400640 1 -- 172.21.15.106:0/4194051213 learned_addr learned my addr 172.21.15.106:0/4194051213 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8302000640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830415dd90 0x7f830415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8302a00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f830413ed60 0x7f830413da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8303400640 1 -- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f830413ed60 msgr2=0x7f830413da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8303400640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f830413ed60 0x7f830413da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8303400640 1 -- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830415dd90 msgr2=0x7f830415d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8303400640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830415dd90 0x7f830415d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8303400640 1 -- 172.21.15.106:0/4194051213 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830413df50 con 0x7f83040b16b0 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8302000640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830415dd90 0x7f830415d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8302a00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f830413ed60 0x7f830413da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8303400640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83040b16b0 0x7f8304157500 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f82fc01b6e0 tx=0x7f82fc01b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f82faa00640 1 -- 172.21.15.106:0/4194051213 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc009800 con 0x7f83040b16b0 2024-04-26T21:17:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f82faa00640 1 -- 172.21.15.106:0/4194051213 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82fc0be070 con 0x7f83040b16b0 2024-04-26T21:17:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f82faa00640 1 -- 172.21.15.106:0/4194051213 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc009be0 con 0x7f83040b16b0 2024-04-26T21:17:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83040b2070 con 0x7f83040b16b0 2024-04-26T21:17:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.883+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830415cb70 con 0x7f83040b16b0 2024-04-26T21:17:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.887+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8304069400 con 0x7f83040b16b0 2024-04-26T21:17:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.887+0000 7f82faa00640 1 -- 172.21.15.106:0/4194051213 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82fc0b6070 con 0x7f83040b16b0 2024-04-26T21:17:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.887+0000 7f82faa00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f82e0068380 0x7f82e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.887+0000 7f82faa00640 1 -- 172.21.15.106:0/4194051213 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f82fc121bb0 con 0x7f83040b16b0 2024-04-26T21:17:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.887+0000 7f8302a00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f82e0068380 0x7f82e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.887+0000 7f8302a00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f82e0068380 0x7f82e006a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f82f40016f0 tx=0x7f82f4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:18.891+0000 7f82faa00640 1 -- 172.21.15.106:0/4194051213 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f82fc0187e0 con 0x7f83040b16b0 2024-04-26T21:17:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.047+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83040b25c0 con 0x7f83040b16b0 2024-04-26T21:17:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f82faa00640 1 -- 172.21.15.106:0/4194051213 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7f82fc0aee40 con 0x7f83040b16b0 2024-04-26T21:17:19.053 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:19.053 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f82e0068380 msgr2=0x7f82e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f82e0068380 0x7f82e006a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f82f40016f0 tx=0x7f82f4009040 comp rx=0 tx=0).stop 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83040b16b0 msgr2=0x7f8304157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83040b16b0 0x7f8304157500 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f82fc01b6e0 tx=0x7f82fc01b870 comp rx=0 tx=0).stop 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 shutdown_connections 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f830415dd90 0x7f830415d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f82e0068380 0x7f82e006a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83040b16b0 0x7f8304157500 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 --2- 172.21.15.106:0/4194051213 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f830413ed60 0x7f830413da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 >> 172.21.15.106:0/4194051213 conn(0x7f8304068340 msgr2=0x7f83040ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 shutdown_connections 2024-04-26T21:17:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.051+0000 7f8309c00640 1 -- 172.21.15.106:0/4194051213 wait complete. 2024-04-26T21:17:19.074 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:19.075 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:19.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.207+0000 7f564cc00640 1 Processor -- start 2024-04-26T21:17:19.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f564cc00640 1 -- start start 2024-04-26T21:17:19.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f564cc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f564815d530 0x7f56480cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f564cc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56480b5260 0x7f56480d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f564cc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56480b44a0 con 0x7f564815d910 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f564cc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f56480b4780 con 0x7f564815d530 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f564cc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f56480b4a60 con 0x7f56480b5260 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5645e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f564815d530 0x7f56480cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5646800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f564815d910 0x7f564815dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58964/0 (socket says 172.21.15.106:58964) 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5645e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f564815d530 0x7f56480cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49700/0 (socket says 172.21.15.106:49700) 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5646800640 1 -- 172.21.15.106:0/2290517157 learned_addr learned my addr 172.21.15.106:0/2290517157 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5645400640 1 --2- 172.21.15.106:0/2290517157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56480b5260 0x7f56480d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5645e00640 1 -- 172.21.15.106:0/2290517157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56480b5260 msgr2=0x7f56480d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5645e00640 1 --2- 172.21.15.106:0/2290517157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56480b5260 0x7f56480d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5645e00640 1 -- 172.21.15.106:0/2290517157 >> v1:172.21.15.106:6789/0 conn(0x7f564815d910 legacy=0x7f564815dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5645e00640 1 -- 172.21.15.106:0/2290517157 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480b4d40 con 0x7f564815d530 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5644a00640 1 -- 172.21.15.106:0/2290517157 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909812835 0 0) 0x7f56480b44a0 con 0x7f564815d910 2024-04-26T21:17:19.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.211+0000 7f5645400640 1 --2- 172.21.15.106:0/2290517157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56480b5260 0x7f56480d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f5645e00640 1 --2- 172.21.15.106:0/2290517157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d530 0x7f56480cfe20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f56380097c0 tx=0x7f563801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3a0e3c9c137172 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f5644a00640 1 -- 172.21.15.106:0/2290517157 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380b0070 con 0x7f564815d530 2024-04-26T21:17:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f5644a00640 1 -- 172.21.15.106:0/2290517157 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5638004230 con 0x7f564815d530 2024-04-26T21:17:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f5644a00640 1 -- 172.21.15.106:0/2290517157 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638003620 con 0x7f564815d530 2024-04-26T21:17:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 -- 172.21.15.106:0/2290517157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d530 msgr2=0x7f56480cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 --2- 172.21.15.106:0/2290517157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d530 0x7f56480cfe20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f56380097c0 tx=0x7f563801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 -- 172.21.15.106:0/2290517157 shutdown_connections 2024-04-26T21:17:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 --2- 172.21.15.106:0/2290517157 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f56480b5260 0x7f56480d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 --2- 172.21.15.106:0/2290517157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d530 0x7f56480cfe20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 -- 172.21.15.106:0/2290517157 >> 172.21.15.106:0/2290517157 conn(0x7f56480b2910 msgr2=0x7f56480b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 -- 172.21.15.106:0/2290517157 shutdown_connections 2024-04-26T21:17:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 -- 172.21.15.106:0/2290517157 wait complete. 2024-04-26T21:17:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 Processor -- start 2024-04-26T21:17:19.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.215+0000 7f564cc00640 1 -- start start 2024-04-26T21:17:19.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f564cc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56480b5260 0x7f564813b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f564cc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564815d530 0x7f564813ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f564cc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d910 0x7f5648141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f564cc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5648169690 con 0x7f564815d910 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f564cc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5648169510 con 0x7f56480b5260 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f564cc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5648169810 con 0x7f564815d530 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5646800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d910 0x7f5648141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5646800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d910 0x7f5648141670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49710/0 (socket says 172.21.15.106:49710) 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5646800640 1 -- 172.21.15.106:0/4025682671 learned_addr learned my addr 172.21.15.106:0/4025682671 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5645400640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564815d530 0x7f564813ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5645e00640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56480b5260 0x7f564813b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5646800640 1 -- 172.21.15.106:0/4025682671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564815d530 msgr2=0x7f564813ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5646800640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564815d530 0x7f564813ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5646800640 1 -- 172.21.15.106:0/4025682671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56480b5260 msgr2=0x7f564813b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5646800640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56480b5260 0x7f564813b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5646800640 1 -- 172.21.15.106:0/4025682671 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564813d410 con 0x7f564815d910 2024-04-26T21:17:19.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f5646800640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d910 0x7f5648141670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f564000c700 tx=0x7f564000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f563e000640 1 -- 172.21.15.106:0/4025682671 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5640018070 con 0x7f564815d910 2024-04-26T21:17:19.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f563e000640 1 -- 172.21.15.106:0/4025682671 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f564000ce10 con 0x7f564815d910 2024-04-26T21:17:19.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564813d6f0 con 0x7f564815d910 2024-04-26T21:17:19.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f563e000640 1 -- 172.21.15.106:0/4025682671 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564000a860 con 0x7f564815d910 2024-04-26T21:17:19.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564813dcb0 con 0x7f564815d910 2024-04-26T21:17:19.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5648069400 con 0x7f564815d910 2024-04-26T21:17:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.219+0000 7f563e000640 1 -- 172.21.15.106:0/4025682671 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f564001b070 con 0x7f564815d910 2024-04-26T21:17:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.223+0000 7f563e000640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5628068380 0x7f562806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.223+0000 7f563e000640 1 -- 172.21.15.106:0/4025682671 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f5640086290 con 0x7f564815d910 2024-04-26T21:17:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.223+0000 7f5645e00640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5628068380 0x7f562806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.223+0000 7f5645e00640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5628068380 0x7f562806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56380ad000 tx=0x7f5638008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.227+0000 7f563e000640 1 -- 172.21.15.106:0/4025682671 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5640055e00 con 0x7f564815d910 2024-04-26T21:17:19.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f56480b0930 con 0x7f564815d910 2024-04-26T21:17:19.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f563e000640 1 -- 172.21.15.106:0/4025682671 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f564005a100 con 0x7f564815d910 2024-04-26T21:17:19.390 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:19.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5628068380 msgr2=0x7f562806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5628068380 0x7f562806a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56380ad000 tx=0x7f5638008040 comp rx=0 tx=0).stop 2024-04-26T21:17:19.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d910 msgr2=0x7f5648141670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d910 0x7f5648141670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f564000c700 tx=0x7f564000cbc0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 shutdown_connections 2024-04-26T21:17:19.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5628068380 0x7f562806a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f564815d910 0x7f5648141670 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f564815d530 0x7f564813ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 --2- 172.21.15.106:0/4025682671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f56480b5260 0x7f564813b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 >> 172.21.15.106:0/4025682671 conn(0x7f56480b2910 msgr2=0x7f56480ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:19.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 shutdown_connections 2024-04-26T21:17:19.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.387+0000 7f564cc00640 1 -- 172.21.15.106:0/4025682671 wait complete. 2024-04-26T21:17:19.412 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:19.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.547+0000 7f7eb6600640 1 Processor -- start 2024-04-26T21:17:19.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.547+0000 7f7eb6600640 1 -- start start 2024-04-26T21:17:19.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.547+0000 7f7eb6600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7eb0159890 0x7f7eb0071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.547+0000 7f7eb6600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00ae8d0 0x7f7eb00b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.547+0000 7f7eb6600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb0072af0 con 0x7f7eb00aed30 2024-04-26T21:17:19.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.547+0000 7f7eb6600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7eb00b3e20 con 0x7f7eb0159890 2024-04-26T21:17:19.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.547+0000 7f7eb6600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb00b43c0 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.551+0000 7f7eaea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00ae8d0 0x7f7eb00b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.551+0000 7f7eaf400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7eb0159890 0x7f7eb0071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.551+0000 7f7eafe00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7eb00aed30 0x7f7eb00b4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:40458/0 (socket says 172.21.15.106:40458) 2024-04-26T21:17:19.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.551+0000 7f7eaea00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00ae8d0 0x7f7eb00b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:55002/0 (socket says 172.21.15.106:55002) 2024-04-26T21:17:19.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.551+0000 7f7eafe00640 1 -- 172.21.15.106:0/1003219371 learned_addr learned my addr 172.21.15.106:0/1003219371 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:19.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.551+0000 7f7eaea00640 1 -- 172.21.15.106:0/1003219371 >> v2:172.21.15.112:3300/0 conn(0x7f7eb0159890 msgr2=0x7f7eb0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:19.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.551+0000 7f7eaea00640 1 --2- 172.21.15.106:0/1003219371 >> v2:172.21.15.112:3300/0 conn(0x7f7eb0159890 0x7f7eb0071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.551+0000 7f7eaea00640 1 -- 172.21.15.106:0/1003219371 >> v1:172.21.15.112:6789/0 conn(0x7f7eb00aed30 legacy=0x7f7eb00b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.551+0000 7f7eaea00640 1 -- 172.21.15.106:0/1003219371 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb0072dd0 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eaea00640 1 --2- 172.21.15.106:0/1003219371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00ae8d0 0x7f7eb00b5690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0097c0 tx=0x7f7e9c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4e13afb8a6d9aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eae000640 1 -- 172.21.15.106:0/1003219371 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0b5070 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eae000640 1 -- 172.21.15.106:0/1003219371 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0a8990 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eae000640 1 -- 172.21.15.106:0/1003219371 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0a8d60 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 -- 172.21.15.106:0/1003219371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00ae8d0 msgr2=0x7f7eb00b5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 --2- 172.21.15.106:0/1003219371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00ae8d0 0x7f7eb00b5690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0097c0 tx=0x7f7e9c01ec90 comp rx=0 tx=0).stop 2024-04-26T21:17:19.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 -- 172.21.15.106:0/1003219371 shutdown_connections 2024-04-26T21:17:19.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 --2- 172.21.15.106:0/1003219371 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00ae8d0 0x7f7eb00b5690 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 --2- 172.21.15.106:0/1003219371 >> v2:172.21.15.112:3300/0 conn(0x7f7eb0159890 0x7f7eb0071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 -- 172.21.15.106:0/1003219371 >> 172.21.15.106:0/1003219371 conn(0x7f7eb00b2910 msgr2=0x7f7eb00b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:19.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 -- 172.21.15.106:0/1003219371 shutdown_connections 2024-04-26T21:17:19.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 -- 172.21.15.106:0/1003219371 wait complete. 2024-04-26T21:17:19.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 Processor -- start 2024-04-26T21:17:19.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.555+0000 7f7eb6600640 1 -- start start 2024-04-26T21:17:19.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eb6600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7eb00ae8d0 0x7f7eb01f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eb6600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00aed30 0x7f7eb0144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eb6600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb0159890 0x7f7eb01e9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eb6600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb00730b0 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eb6600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0160580 con 0x7f7eb0159890 2024-04-26T21:17:19.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eb6600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb00724d0 con 0x7f7eb00aed30 2024-04-26T21:17:19.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaf400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7eb00ae8d0 0x7f7eb01f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaf400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7eb00ae8d0 0x7f7eb01f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49714/0 (socket says 172.21.15.106:49714) 2024-04-26T21:17:19.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaf400640 1 -- 172.21.15.106:0/3270878818 learned_addr learned my addr 172.21.15.106:0/3270878818 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaea00640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00aed30 0x7f7eb0144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eafe00640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb0159890 0x7f7eb01e9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaf400640 1 -- 172.21.15.106:0/3270878818 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00aed30 msgr2=0x7f7eb0144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaf400640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00aed30 0x7f7eb0144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaf400640 1 -- 172.21.15.106:0/3270878818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb0159890 msgr2=0x7f7eb01e9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaf400640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb0159890 0x7f7eb01e9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaf400640 1 -- 172.21.15.106:0/3270878818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb0144f00 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eaf400640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7eb00ae8d0 0x7f7eb01f83c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009d10 tx=0x7f7ea000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7ea7400640 1 -- 172.21.15.106:0/3270878818 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0018020 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7ea7400640 1 -- 172.21.15.106:0/3270878818 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea0014480 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb01f8c10 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7ea7400640 1 -- 172.21.15.106:0/3270878818 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0014830 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb01f91d0 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb0069400 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.559+0000 7f7ea7400640 1 -- 172.21.15.106:0/3270878818 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ea001b020 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.563+0000 7f7ea7400640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7e90068380 0x7f7e9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.563+0000 7f7ea7400640 1 -- 172.21.15.106:0/3270878818 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f7ea0087610 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.563+0000 7f7eaea00640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7e90068380 0x7f7e9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.563+0000 7f7eaea00640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7e90068380 0x7f7e9006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0b2000 tx=0x7f7e9c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.567+0000 7f7ea7400640 1 -- 172.21.15.106:0/3270878818 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ea0022070 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7eb006fc00 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7ea7400640 1 -- 172.21.15.106:0/3270878818 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f7ea0010040 con 0x7f7eb00ae8d0 2024-04-26T21:17:19.730 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:19.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7e90068380 msgr2=0x7f7e9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7e90068380 0x7f7e9006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0b2000 tx=0x7f7e9c008040 comp rx=0 tx=0).stop 2024-04-26T21:17:19.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7eb00ae8d0 msgr2=0x7f7eb01f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7eb00ae8d0 0x7f7eb01f83c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009d10 tx=0x7f7ea000c490 comp rx=0 tx=0).stop 2024-04-26T21:17:19.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 shutdown_connections 2024-04-26T21:17:19.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eb0159890 0x7f7eb01e9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7e90068380 0x7f7e9006a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7eb00aed30 0x7f7eb0144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 --2- 172.21.15.106:0/3270878818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7eb00ae8d0 0x7f7eb01f83c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 >> 172.21.15.106:0/3270878818 conn(0x7f7eb00b2910 msgr2=0x7f7eb00d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:19.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 shutdown_connections 2024-04-26T21:17:19.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.727+0000 7f7eb6600640 1 -- 172.21.15.106:0/3270878818 wait complete. 2024-04-26T21:17:19.749 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:19.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.883+0000 7fbd97600640 1 Processor -- start 2024-04-26T21:17:19.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.883+0000 7fbd97600640 1 -- start start 2024-04-26T21:17:19.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd97600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbd900d0580 0x7fbd9015bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd97600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd90159600 con 0x7fbd9006ef90 2024-04-26T21:17:19.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd97600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd900b3d40 con 0x7fbd90159220 2024-04-26T21:17:19.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd97600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fbd900b4020 con 0x7fbd900d0580 2024-04-26T21:17:19.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd8fe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbd9006ef90 0x7fbd9015cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58966/0 (socket says 172.21.15.106:58966) 2024-04-26T21:17:19.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd8fe00640 1 -- 172.21.15.106:0/987728006 learned_addr learned my addr 172.21.15.106:0/987728006 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:19.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd95600640 1 --2- 172.21.15.106:0/987728006 >> v2:172.21.15.106:3300/0 conn(0x7fbd900d0580 0x7fbd9015bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd8f400640 1 -- 172.21.15.106:0/987728006 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311639554 0 0) 0x7fbd90159600 con 0x7fbd9006ef90 2024-04-26T21:17:19.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd8f400640 1 -- 172.21.15.106:0/987728006 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd74003450 con 0x7fbd9006ef90 2024-04-26T21:17:19.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd95600640 1 -- 172.21.15.106:0/987728006 >> v1:172.21.15.112:6789/0 conn(0x7fbd90159220 legacy=0x7fbd9006e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd95600640 1 -- 172.21.15.106:0/987728006 >> v1:172.21.15.106:6789/0 conn(0x7fbd9006ef90 legacy=0x7fbd9015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd95600640 1 -- 172.21.15.106:0/987728006 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd900b4300 con 0x7fbd900d0580 2024-04-26T21:17:19.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.887+0000 7fbd95600640 1 --2- 172.21.15.106:0/987728006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd900d0580 0x7fbd9015bb30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009dc0 tx=0x7fbd9015dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a574fe1fb1de4a83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd8f400640 1 -- 172.21.15.106:0/987728006 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd880b2070 con 0x7fbd900d0580 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd8f400640 1 -- 172.21.15.106:0/987728006 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd880a5850 con 0x7fbd900d0580 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd8f400640 1 -- 172.21.15.106:0/987728006 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd880a5c20 con 0x7fbd900d0580 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 -- 172.21.15.106:0/987728006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd900d0580 msgr2=0x7fbd9015bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 --2- 172.21.15.106:0/987728006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd900d0580 0x7fbd9015bb30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009dc0 tx=0x7fbd9015dc90 comp rx=0 tx=0).stop 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 -- 172.21.15.106:0/987728006 shutdown_connections 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 --2- 172.21.15.106:0/987728006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd900d0580 0x7fbd9015bb30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 -- 172.21.15.106:0/987728006 >> 172.21.15.106:0/987728006 conn(0x7fbd900b2910 msgr2=0x7fbd900b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 -- 172.21.15.106:0/987728006 shutdown_connections 2024-04-26T21:17:19.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 -- 172.21.15.106:0/987728006 wait complete. 2024-04-26T21:17:19.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 Processor -- start 2024-04-26T21:17:19.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 -- start start 2024-04-26T21:17:19.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd9006ef90 0x7fbd90156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd900d0580 0x7fbd901f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd90159220 0x7fbd90146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9006e170 con 0x7fbd90159220 2024-04-26T21:17:19.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9006dff0 con 0x7fbd9006ef90 2024-04-26T21:17:19.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd97600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9006e2f0 con 0x7fbd900d0580 2024-04-26T21:17:19.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd95600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd90159220 0x7fbd90146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd95600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd90159220 0x7fbd90146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49738/0 (socket says 172.21.15.106:49738) 2024-04-26T21:17:19.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd95600640 1 -- 172.21.15.106:0/874915590 learned_addr learned my addr 172.21.15.106:0/874915590 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:19.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd94c00640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd9006ef90 0x7fbd90156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd95600640 1 -- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd900d0580 msgr2=0x7fbd901f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd8fe00640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd900d0580 0x7fbd901f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.891+0000 7fbd95600640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd900d0580 0x7fbd901f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd95600640 1 -- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd9006ef90 msgr2=0x7fbd90156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd95600640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd9006ef90 0x7fbd90156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd95600640 1 -- 172.21.15.106:0/874915590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd901f8e40 con 0x7fbd90159220 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd94c00640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd9006ef90 0x7fbd90156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd8fe00640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd900d0580 0x7fbd901f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd95600640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd90159220 0x7fbd90146450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd8801cda0 tx=0x7fbd88019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd8cc00640 1 -- 172.21.15.106:0/874915590 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd880b2040 con 0x7fbd90159220 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd8cc00640 1 -- 172.21.15.106:0/874915590 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd880039a0 con 0x7fbd90159220 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd8cc00640 1 -- 172.21.15.106:0/874915590 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88003d90 con 0x7fbd90159220 2024-04-26T21:17:19.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd901f9120 con 0x7fbd90159220 2024-04-26T21:17:19.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd901f96e0 con 0x7fbd90159220 2024-04-26T21:17:19.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd90069400 con 0x7fbd90159220 2024-04-26T21:17:19.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd8cc00640 1 -- 172.21.15.106:0/874915590 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd88004030 con 0x7fbd90159220 2024-04-26T21:17:19.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd8cc00640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbd6c068380 0x7fbd6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd8cc00640 1 -- 172.21.15.106:0/874915590 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fbd88121a20 con 0x7fbd90159220 2024-04-26T21:17:19.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.895+0000 7fbd94c00640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbd6c068380 0x7fbd6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.899+0000 7fbd94c00640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbd6c068380 0x7fbd6c06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd78000f70 tx=0x7fbd78009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:19.899+0000 7fbd8cc00640 1 -- 172.21.15.106:0/874915590 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbd88016540 con 0x7fbd90159220 2024-04-26T21:17:20.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.055+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbd9006f5b0 con 0x7fbd90159220 2024-04-26T21:17:20.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd8cc00640 1 -- 172.21.15.106:0/874915590 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fbd880f1be0 con 0x7fbd90159220 2024-04-26T21:17:20.060 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:20.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbd6c068380 msgr2=0x7fbd6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbd6c068380 0x7fbd6c06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd78000f70 tx=0x7fbd78009040 comp rx=0 tx=0).stop 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd90159220 msgr2=0x7fbd90146450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd90159220 0x7fbd90146450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd8801cda0 tx=0x7fbd88019660 comp rx=0 tx=0).stop 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 shutdown_connections 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbd6c068380 0x7fbd6c06a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd90159220 0x7fbd90146450 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbd900d0580 0x7fbd901f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 --2- 172.21.15.106:0/874915590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd9006ef90 0x7fbd90156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 >> 172.21.15.106:0/874915590 conn(0x7fbd900b2910 msgr2=0x7fbd90074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 shutdown_connections 2024-04-26T21:17:20.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.059+0000 7fbd97600640 1 -- 172.21.15.106:0/874915590 wait complete. 2024-04-26T21:17:20.082 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:20.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0860a00640 1 Processor -- start 2024-04-26T21:17:20.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0860a00640 1 -- start start 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0860a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f085c15c4e0 0x7f085c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0860a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f085c15da80 0x7f085c15df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0860a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f085c15ce00 con 0x7f085c15d080 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0860a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f085c15d5f0 con 0x7f085c15da80 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0860a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f085c0b4f00 con 0x7f085c15c4e0 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f085a800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f085c15da80 0x7f085c15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f085a800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f085c15da80 0x7f085c15df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49744/0 (socket says 172.21.15.106:49744) 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f085a800640 1 -- 172.21.15.106:0/73902635 learned_addr learned my addr 172.21.15.106:0/73902635 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0859400640 1 --1- 172.21.15.106:0/73902635 >> v1:172.21.15.106:6789/0 conn(0x7f085c15d080 0x7f085c0b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58976/0 (socket says 172.21.15.106:58976) 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0859e00640 1 --2- 172.21.15.106:0/73902635 >> v2:172.21.15.112:3300/0 conn(0x7f085c15c4e0 0x7f085c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f085a800640 1 -- 172.21.15.106:0/73902635 >> v2:172.21.15.112:3300/0 conn(0x7f085c15c4e0 msgr2=0x7f085c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f085a800640 1 --2- 172.21.15.106:0/73902635 >> v2:172.21.15.112:3300/0 conn(0x7f085c15c4e0 0x7f085c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f085a800640 1 -- 172.21.15.106:0/73902635 >> v1:172.21.15.106:6789/0 conn(0x7f085c15d080 legacy=0x7f085c0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f085a800640 1 -- 172.21.15.106:0/73902635 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085c0b51e0 con 0x7f085c15da80 2024-04-26T21:17:20.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0858a00640 1 -- 172.21.15.106:0/73902635 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010655405 0 0) 0x7f085c15ce00 con 0x7f085c15d080 2024-04-26T21:17:20.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.219+0000 7f0859e00640 1 --2- 172.21.15.106:0/73902635 >> v2:172.21.15.112:3300/0 conn(0x7f085c15c4e0 0x7f085c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:20.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f085a800640 1 --2- 172.21.15.106:0/73902635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 0x7f085c15df10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f085c070310 tx=0x7f085401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983525a3b1a23514 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0858a00640 1 -- 172.21.15.106:0/73902635 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08540a57a0 con 0x7f085c15da80 2024-04-26T21:17:20.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0858a00640 1 -- 172.21.15.106:0/73902635 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540a5940 con 0x7f085c15da80 2024-04-26T21:17:20.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0858a00640 1 -- 172.21.15.106:0/73902635 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08540a5d10 con 0x7f085c15da80 2024-04-26T21:17:20.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 -- 172.21.15.106:0/73902635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 msgr2=0x7f085c15df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 --2- 172.21.15.106:0/73902635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 0x7f085c15df10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f085c070310 tx=0x7f085401c9f0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 -- 172.21.15.106:0/73902635 shutdown_connections 2024-04-26T21:17:20.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 --2- 172.21.15.106:0/73902635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 0x7f085c15df10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 --2- 172.21.15.106:0/73902635 >> v2:172.21.15.112:3300/0 conn(0x7f085c15c4e0 0x7f085c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 -- 172.21.15.106:0/73902635 >> 172.21.15.106:0/73902635 conn(0x7f085c0b2910 msgr2=0x7f085c0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 -- 172.21.15.106:0/73902635 shutdown_connections 2024-04-26T21:17:20.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 -- 172.21.15.106:0/73902635 wait complete. 2024-04-26T21:17:20.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 Processor -- start 2024-04-26T21:17:20.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.223+0000 7f0860a00640 1 -- start start 2024-04-26T21:17:20.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0860a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f085c15c4e0 0x7f085c136340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0860a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f085c15d080 0x7f085c1380b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0860a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 0x7f085c15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0860a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f085c168f40 con 0x7f085c15da80 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0860a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f085c168dc0 con 0x7f085c15c4e0 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0860a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f085c1690c0 con 0x7f085c15d080 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f085a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 0x7f085c15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f085a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 0x7f085c15b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49756/0 (socket says 172.21.15.106:49756) 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f085a800640 1 -- 172.21.15.106:0/1758845584 learned_addr learned my addr 172.21.15.106:0/1758845584 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0859e00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f085c15c4e0 0x7f085c136340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0859400640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f085c15d080 0x7f085c1380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f085a800640 1 -- 172.21.15.106:0/1758845584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f085c15d080 msgr2=0x7f085c1380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f085a800640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f085c15d080 0x7f085c1380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f085a800640 1 -- 172.21.15.106:0/1758845584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f085c15c4e0 msgr2=0x7f085c136340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f085a800640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f085c15c4e0 0x7f085c136340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f085a800640 1 -- 172.21.15.106:0/1758845584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085c1420a0 con 0x7f085c15da80 2024-04-26T21:17:20.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0859e00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f085c15c4e0 0x7f085c136340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:20.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f085a800640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 0x7f085c15b0c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0854019600 tx=0x7f0854019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0852000640 1 -- 172.21.15.106:0/1758845584 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08540b8670 con 0x7f085c15da80 2024-04-26T21:17:20.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0852000640 1 -- 172.21.15.106:0/1758845584 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540be070 con 0x7f085c15da80 2024-04-26T21:17:20.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085c142380 con 0x7f085c15da80 2024-04-26T21:17:20.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0852000640 1 -- 172.21.15.106:0/1758845584 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08540b8ab0 con 0x7f085c15da80 2024-04-26T21:17:20.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085c13d740 con 0x7f085c15da80 2024-04-26T21:17:20.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.227+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085c069400 con 0x7f085c15da80 2024-04-26T21:17:20.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.231+0000 7f0852000640 1 -- 172.21.15.106:0/1758845584 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f085c15ec60 con 0x7f085c15da80 2024-04-26T21:17:20.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.231+0000 7f0852000640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f083c068380 0x7f083c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.231+0000 7f0852000640 1 -- 172.21.15.106:0/1758845584 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f0854121d70 con 0x7f085c15da80 2024-04-26T21:17:20.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.231+0000 7f0859e00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f083c068380 0x7f083c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.231+0000 7f0859e00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f083c068380 0x7f083c06a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f084c006fd0 tx=0x7f084c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.235+0000 7f0852000640 1 -- 172.21.15.106:0/1758845584 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f08540165e0 con 0x7f085c15da80 2024-04-26T21:17:20.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f085c06e2a0 con 0x7f085c15da80 2024-04-26T21:17:20.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0852000640 1 -- 172.21.15.106:0/1758845584 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f08540f1fd0 con 0x7f085c15da80 2024-04-26T21:17:20.397 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:20.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f083c068380 msgr2=0x7f083c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f083c068380 0x7f083c06a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f084c006fd0 tx=0x7f084c008040 comp rx=0 tx=0).stop 2024-04-26T21:17:20.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 msgr2=0x7f085c15b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 0x7f085c15b0c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0854019600 tx=0x7f0854019790 comp rx=0 tx=0).stop 2024-04-26T21:17:20.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 shutdown_connections 2024-04-26T21:17:20.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f083c068380 0x7f083c06a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c15da80 0x7f085c15b0c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f085c15d080 0x7f085c1380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 --2- 172.21.15.106:0/1758845584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f085c15c4e0 0x7f085c136340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 >> 172.21.15.106:0/1758845584 conn(0x7f085c0b2910 msgr2=0x7f085c1438f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 shutdown_connections 2024-04-26T21:17:20.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.395+0000 7f0860a00640 1 -- 172.21.15.106:0/1758845584 wait complete. 2024-04-26T21:17:20.417 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:17:20.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca5e400640 1 Processor -- start 2024-04-26T21:17:20.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca5e400640 1 -- start start 2024-04-26T21:17:20.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca5e400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca5815d060 0x7fca580cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca5e400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fca580cfb70 0x7fca580cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca5e400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca580b2250 con 0x7fca580d0830 2024-04-26T21:17:20.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca5e400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fca580b25a0 con 0x7fca580cfb70 2024-04-26T21:17:20.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca5e400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fca580ce660 con 0x7fca5815d060 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca4fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fca580cfb70 0x7fca580cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca57400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca5815d060 0x7fca580cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca4fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fca580cfb70 0x7fca580cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:46506/0 (socket says 172.21.15.106:46506) 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca4fe00640 1 -- 172.21.15.106:0/2261265062 learned_addr learned my addr 172.21.15.106:0/2261265062 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca57e00640 1 --1- 172.21.15.106:0/2261265062 >> v1:172.21.15.112:6789/0 conn(0x7fca580d0830 0x7fca580d0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:40476/0 (socket says 172.21.15.106:40476) 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca4fe00640 1 -- 172.21.15.106:0/2261265062 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca5815d060 msgr2=0x7fca580cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca4fe00640 1 --2- 172.21.15.106:0/2261265062 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca5815d060 0x7fca580cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca4fe00640 1 -- 172.21.15.106:0/2261265062 >> v1:172.21.15.112:6789/0 conn(0x7fca580d0830 legacy=0x7fca580d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca4fe00640 1 -- 172.21.15.106:0/2261265062 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca580ce940 con 0x7fca580cfb70 2024-04-26T21:17:20.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca57400640 1 --2- 172.21.15.106:0/2261265062 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca5815d060 0x7fca580cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:20.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.555+0000 7fca56a00640 1 -- 172.21.15.106:0/2261265062 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072480929 0 0) 0x7fca580b2250 con 0x7fca580d0830 2024-04-26T21:17:20.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca4fe00640 1 --2- 172.21.15.106:0/2261265062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca580cfb70 0x7fca580cfff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fca40009870 tx=0x7fca4001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=423210d1c1155b8e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca56a00640 1 -- 172.21.15.106:0/2261265062 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca400a7070 con 0x7fca580cfb70 2024-04-26T21:17:20.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca56a00640 1 -- 172.21.15.106:0/2261265062 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca400b0070 con 0x7fca580cfb70 2024-04-26T21:17:20.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca56a00640 1 -- 172.21.15.106:0/2261265062 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca400ab890 con 0x7fca580cfb70 2024-04-26T21:17:20.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca5e400640 1 -- 172.21.15.106:0/2261265062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca580cfb70 msgr2=0x7fca580cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca5e400640 1 --2- 172.21.15.106:0/2261265062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca580cfb70 0x7fca580cfff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fca40009870 tx=0x7fca4001c560 comp rx=0 tx=0).stop 2024-04-26T21:17:20.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca5e400640 1 -- 172.21.15.106:0/2261265062 shutdown_connections 2024-04-26T21:17:20.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca5e400640 1 --2- 172.21.15.106:0/2261265062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca580cfb70 0x7fca580cfff0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca5e400640 1 --2- 172.21.15.106:0/2261265062 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca5815d060 0x7fca580cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca5e400640 1 -- 172.21.15.106:0/2261265062 >> 172.21.15.106:0/2261265062 conn(0x7fca580d2c60 msgr2=0x7fca580d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca5e400640 1 -- 172.21.15.106:0/2261265062 shutdown_connections 2024-04-26T21:17:20.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.559+0000 7fca5e400640 1 -- 172.21.15.106:0/2261265062 wait complete. 2024-04-26T21:17:20.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 Processor -- start 2024-04-26T21:17:20.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 -- start start 2024-04-26T21:17:20.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca580cfb70 0x7fca5814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca580d0830 0x7fca5814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca5815d060 0x7fca5814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fca580ce400 con 0x7fca5815d060 2024-04-26T21:17:20.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fca580ce280 con 0x7fca580cfb70 2024-04-26T21:17:20.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fca5816a410 con 0x7fca580d0830 2024-04-26T21:17:20.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca5815d060 0x7fca5814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca5815d060 0x7fca5814e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49772/0 (socket says 172.21.15.106:49772) 2024-04-26T21:17:20.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57e00640 1 -- 172.21.15.106:0/445065677 learned_addr learned my addr 172.21.15.106:0/445065677 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:20.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca580cfb70 0x7fca5814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca4fe00640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca580d0830 0x7fca5814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57e00640 1 -- 172.21.15.106:0/445065677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca580d0830 msgr2=0x7fca5814e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57e00640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca580d0830 0x7fca5814e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57e00640 1 -- 172.21.15.106:0/445065677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca580cfb70 msgr2=0x7fca5814fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57e00640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca580cfb70 0x7fca5814fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57e00640 1 -- 172.21.15.106:0/445065677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca581582f0 con 0x7fca5815d060 2024-04-26T21:17:20.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca57e00640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca5815d060 0x7fca5814e9b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c7a0 tx=0x7fca5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca4f400640 1 -- 172.21.15.106:0/445065677 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50018070 con 0x7fca5815d060 2024-04-26T21:17:20.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca4f400640 1 -- 172.21.15.106:0/445065677 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5000a640 con 0x7fca5815d060 2024-04-26T21:17:20.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca4f400640 1 -- 172.21.15.106:0/445065677 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5000aab0 con 0x7fca5815d060 2024-04-26T21:17:20.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca581585d0 con 0x7fca5815d060 2024-04-26T21:17:20.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca58158b90 con 0x7fca5815d060 2024-04-26T21:17:20.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.563+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca58069400 con 0x7fca5815d060 2024-04-26T21:17:20.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.567+0000 7fca4f400640 1 -- 172.21.15.106:0/445065677 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca5000ac50 con 0x7fca5815d060 2024-04-26T21:17:20.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.567+0000 7fca4f400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fca34068380 0x7fca3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.567+0000 7fca4f400640 1 -- 172.21.15.106:0/445065677 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fca50086360 con 0x7fca5815d060 2024-04-26T21:17:20.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.567+0000 7fca57400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fca34068380 0x7fca3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.567+0000 7fca57400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fca34068380 0x7fca3406a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca58071ff0 tx=0x7fca48009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.571+0000 7fca4f400640 1 -- 172.21.15.106:0/445065677 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fca50055ec0 con 0x7fca5815d060 2024-04-26T21:17:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fca58159ab0 con 0x7fca5815d060 2024-04-26T21:17:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca4f400640 1 -- 172.21.15.106:0/445065677 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fca5005a1c0 con 0x7fca5815d060 2024-04-26T21:17:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:17:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fca34068380 msgr2=0x7fca3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fca34068380 0x7fca3406a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca58071ff0 tx=0x7fca48009190 comp rx=0 tx=0).stop 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca5815d060 msgr2=0x7fca5814e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca5815d060 0x7fca5814e9b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c7a0 tx=0x7fca5000cc60 comp rx=0 tx=0).stop 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 shutdown_connections 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fca34068380 0x7fca3406a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca5815d060 0x7fca5814e9b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca580d0830 0x7fca5814e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 --2- 172.21.15.106:0/445065677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca580cfb70 0x7fca5814fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 >> 172.21.15.106:0/445065677 conn(0x7fca580d2c60 msgr2=0x7fca580af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 shutdown_connections 2024-04-26T21:17:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.743+0000 7fca5e400640 1 -- 172.21.15.106:0/445065677 wait complete. 2024-04-26T21:17:20.766 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:17:20.766 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:20.775 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:20.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb7800640 1 Processor -- start 2024-04-26T21:17:20.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb7800640 1 -- start start 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb7800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7effb0160ac0 0x7effb015df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb7800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7effb0146870 0x7effb00d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb7800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb00b3da0 con 0x7effb0146490 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb7800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7effb0160fa0 con 0x7effb0146870 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb7800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7effb0161280 con 0x7effb0160ac0 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb5800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7effb0146870 0x7effb00d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb5800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7effb0146870 0x7effb00d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49782/0 (socket says 172.21.15.106:49782) 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb5800640 1 -- 172.21.15.106:0/1620010934 learned_addr learned my addr 172.21.15.106:0/1620010934 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effa7e00640 1 --2- 172.21.15.106:0/1620010934 >> v2:172.21.15.112:3300/0 conn(0x7effb0160ac0 0x7effb015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb5800640 1 -- 172.21.15.106:0/1620010934 >> v2:172.21.15.112:3300/0 conn(0x7effb0160ac0 msgr2=0x7effb015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:20.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb5800640 1 --2- 172.21.15.106:0/1620010934 >> v2:172.21.15.112:3300/0 conn(0x7effb0160ac0 0x7effb015df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb5800640 1 -- 172.21.15.106:0/1620010934 >> v1:172.21.15.112:6789/0 conn(0x7effb0146490 legacy=0x7effb00cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effb5800640 1 -- 172.21.15.106:0/1620010934 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb0161560 con 0x7effb0146870 2024-04-26T21:17:20.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.947+0000 7effa7e00640 1 --2- 172.21.15.106:0/1620010934 >> v2:172.21.15.112:3300/0 conn(0x7effb0160ac0 0x7effb015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:20.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effb5800640 1 --2- 172.21.15.106:0/1620010934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0146870 0x7effb00d0da0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7effb0157b20 tx=0x7effa801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753e4ddc45dc17bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effafe00640 1 -- 172.21.15.106:0/1620010934 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80a56c0 con 0x7effb0146870 2024-04-26T21:17:20.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effafe00640 1 -- 172.21.15.106:0/1620010934 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa80a5860 con 0x7effb0146870 2024-04-26T21:17:20.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effafe00640 1 -- 172.21.15.106:0/1620010934 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80a5c30 con 0x7effb0146870 2024-04-26T21:17:20.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effb7800640 1 -- 172.21.15.106:0/1620010934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0146870 msgr2=0x7effb00d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effb7800640 1 --2- 172.21.15.106:0/1620010934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0146870 0x7effb00d0da0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7effb0157b20 tx=0x7effa801c9f0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effb7800640 1 -- 172.21.15.106:0/1620010934 shutdown_connections 2024-04-26T21:17:20.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effb7800640 1 --2- 172.21.15.106:0/1620010934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0146870 0x7effb00d0da0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effb7800640 1 --2- 172.21.15.106:0/1620010934 >> v2:172.21.15.112:3300/0 conn(0x7effb0160ac0 0x7effb015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effb7800640 1 -- 172.21.15.106:0/1620010934 >> 172.21.15.106:0/1620010934 conn(0x7effb0068340 msgr2=0x7effb0068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effb7800640 1 -- 172.21.15.106:0/1620010934 shutdown_connections 2024-04-26T21:17:20.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.951+0000 7effb7800640 1 -- 172.21.15.106:0/1620010934 wait complete. 2024-04-26T21:17:20.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 Processor -- start 2024-04-26T21:17:20.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 -- start start 2024-04-26T21:17:20.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb0146490 0x7effb0145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb0146870 0x7effb0139f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0160ac0 0x7effb013db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7effb00b5150 con 0x7effb0160ac0 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7effb00b4fd0 con 0x7effb0146870 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7effb0169e60 con 0x7effb0146490 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb5800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0160ac0 0x7effb013db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb5800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0160ac0 0x7effb013db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49790/0 (socket says 172.21.15.106:49790) 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb5800640 1 -- 172.21.15.106:0/3173402605 learned_addr learned my addr 172.21.15.106:0/3173402605 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effa7e00640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb0146870 0x7effb0139f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb4e00640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb0146490 0x7effb0145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb5800640 1 -- 172.21.15.106:0/3173402605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb0146490 msgr2=0x7effb0145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb5800640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb0146490 0x7effb0145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb5800640 1 -- 172.21.15.106:0/3173402605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb0146870 msgr2=0x7effb0139f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb5800640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb0146870 0x7effb0139f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb5800640 1 -- 172.21.15.106:0/3173402605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb013e060 con 0x7effb0160ac0 2024-04-26T21:17:20.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb5800640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0160ac0 0x7effb013db20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7effa80af040 tx=0x7effa8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effad600640 1 -- 172.21.15.106:0/3173402605 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80b8670 con 0x7effb0160ac0 2024-04-26T21:17:20.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effad600640 1 -- 172.21.15.106:0/3173402605 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa80be070 con 0x7effb0160ac0 2024-04-26T21:17:20.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb0145cc0 con 0x7effb0160ac0 2024-04-26T21:17:20.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effad600640 1 -- 172.21.15.106:0/3173402605 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80b8a70 con 0x7effb0160ac0 2024-04-26T21:17:20.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.955+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb0151810 con 0x7effb0160ac0 2024-04-26T21:17:20.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.959+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb0069400 con 0x7effb0160ac0 2024-04-26T21:17:20.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.959+0000 7effad600640 1 -- 172.21.15.106:0/3173402605 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7effa80b8c10 con 0x7effb0160ac0 2024-04-26T21:17:20.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.959+0000 7effad600640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7eff8c068380 0x7eff8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.959+0000 7effad600640 1 -- 172.21.15.106:0/3173402605 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7effa8121dc0 con 0x7effb0160ac0 2024-04-26T21:17:20.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.959+0000 7effb4e00640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7eff8c068380 0x7eff8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.959+0000 7effb4e00640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7eff8c068380 0x7eff8c06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7effb006df30 tx=0x7effa0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:20.963+0000 7effad600640 1 -- 172.21.15.106:0/3173402605 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7effb013e060 con 0x7effb0160ac0 2024-04-26T21:17:21.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effb0073d70 con 0x7effb0160ac0 2024-04-26T21:17:21.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effad600640 1 -- 172.21.15.106:0/3173402605 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7effa80165e0 con 0x7effb0160ac0 2024-04-26T21:17:21.126 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:21.126 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7eff8c068380 msgr2=0x7eff8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7eff8c068380 0x7eff8c06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7effb006df30 tx=0x7effa0009040 comp rx=0 tx=0).stop 2024-04-26T21:17:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0160ac0 msgr2=0x7effb013db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0160ac0 0x7effb013db20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7effa80af040 tx=0x7effa8019790 comp rx=0 tx=0).stop 2024-04-26T21:17:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 shutdown_connections 2024-04-26T21:17:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb0146870 0x7effb0139f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7eff8c068380 0x7eff8c06a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effb0160ac0 0x7effb013db20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 --2- 172.21.15.106:0/3173402605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7effb0146490 0x7effb0145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 >> 172.21.15.106:0/3173402605 conn(0x7effb0068340 msgr2=0x7effb0074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 shutdown_connections 2024-04-26T21:17:21.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.123+0000 7effb7800640 1 -- 172.21.15.106:0/3173402605 wait complete. 2024-04-26T21:17:21.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:21.147 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:21.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2fe00640 1 Processor -- start 2024-04-26T21:17:21.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2fe00640 1 -- start start 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf2815c4e0 0x7faf2815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2fe00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf2815d080 0x7faf280b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf2815fa20 0x7faf2815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2fe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7faf2815d5f0 con 0x7faf2815c4e0 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2fe00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faf2815ce00 con 0x7faf2815d080 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faf280b4f00 con 0x7faf2815fa20 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf2815c4e0 0x7faf2815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf2815c4e0 0x7faf2815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49806/0 (socket says 172.21.15.106:49806) 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2d400640 1 -- 172.21.15.106:0/1740977432 learned_addr learned my addr 172.21.15.106:0/1740977432 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2ca00640 1 --2- 172.21.15.106:0/1740977432 >> v2:172.21.15.112:3300/0 conn(0x7faf2815d080 0x7faf280b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2de00640 1 --2- 172.21.15.106:0/1740977432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf2815fa20 0x7faf2815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2d400640 1 -- 172.21.15.106:0/1740977432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf2815fa20 msgr2=0x7faf2815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2d400640 1 --2- 172.21.15.106:0/1740977432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf2815fa20 0x7faf2815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2d400640 1 -- 172.21.15.106:0/1740977432 >> v2:172.21.15.112:3300/0 conn(0x7faf2815d080 msgr2=0x7faf280b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:21.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2d400640 1 --2- 172.21.15.106:0/1740977432 >> v2:172.21.15.112:3300/0 conn(0x7faf2815d080 0x7faf280b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2d400640 1 -- 172.21.15.106:0/1740977432 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf280b51e0 con 0x7faf2815c4e0 2024-04-26T21:17:21.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.283+0000 7faf2ca00640 1 --2- 172.21.15.106:0/1740977432 >> v2:172.21.15.112:3300/0 conn(0x7faf2815d080 0x7faf280b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2d400640 1 --2- 172.21.15.106:0/1740977432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 0x7faf2815c8c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf28074860 tx=0x7faf1c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b7602e1d3ab5d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf27e00640 1 -- 172.21.15.106:0/1740977432 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0aa610 con 0x7faf2815c4e0 2024-04-26T21:17:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf27e00640 1 -- 172.21.15.106:0/1740977432 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c0af070 con 0x7faf2815c4e0 2024-04-26T21:17:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf27e00640 1 -- 172.21.15.106:0/1740977432 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0aa9d0 con 0x7faf2815c4e0 2024-04-26T21:17:21.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2fe00640 1 -- 172.21.15.106:0/1740977432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 msgr2=0x7faf2815c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2fe00640 1 --2- 172.21.15.106:0/1740977432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 0x7faf2815c8c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf28074860 tx=0x7faf1c01c4f0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2fe00640 1 -- 172.21.15.106:0/1740977432 shutdown_connections 2024-04-26T21:17:21.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2fe00640 1 --2- 172.21.15.106:0/1740977432 >> v2:172.21.15.112:3300/0 conn(0x7faf2815d080 0x7faf280b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2fe00640 1 --2- 172.21.15.106:0/1740977432 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf2815fa20 0x7faf2815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2fe00640 1 --2- 172.21.15.106:0/1740977432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 0x7faf2815c8c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2fe00640 1 -- 172.21.15.106:0/1740977432 >> 172.21.15.106:0/1740977432 conn(0x7faf280b2910 msgr2=0x7faf280b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2fe00640 1 -- 172.21.15.106:0/1740977432 shutdown_connections 2024-04-26T21:17:21.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.287+0000 7faf2fe00640 1 -- 172.21.15.106:0/1740977432 wait complete. 2024-04-26T21:17:21.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 Processor -- start 2024-04-26T21:17:21.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 -- start start 2024-04-26T21:17:21.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 0x7faf28139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf2815d080 0x7faf2813e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf2815fa20 0x7faf2813ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faf280b4b60 con 0x7faf2815c4e0 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf28145ba0 con 0x7faf2815d080 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faf280b4ce0 con 0x7faf2815fa20 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 0x7faf28139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 0x7faf28139640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49818/0 (socket says 172.21.15.106:49818) 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2d400640 1 -- 172.21.15.106:0/903773595 learned_addr learned my addr 172.21.15.106:0/903773595 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2d400640 1 -- 172.21.15.106:0/903773595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf2815fa20 msgr2=0x7faf2813ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2d400640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf2815fa20 0x7faf2813ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2d400640 1 -- 172.21.15.106:0/903773595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf2815d080 msgr2=0x7faf2813e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2d400640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf2815d080 0x7faf2813e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2d400640 1 -- 172.21.15.106:0/903773595 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf281f9590 con 0x7faf2815c4e0 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2d400640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 0x7faf28139640 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf1c01aba0 tx=0x7faf1c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf25600640 1 -- 172.21.15.106:0/903773595 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0bd5f0 con 0x7faf2815c4e0 2024-04-26T21:17:21.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf25600640 1 -- 172.21.15.106:0/903773595 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c0bd790 con 0x7faf2815c4e0 2024-04-26T21:17:21.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf25600640 1 -- 172.21.15.106:0/903773595 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0bdb60 con 0x7faf2815c4e0 2024-04-26T21:17:21.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf281f9830 con 0x7faf2815c4e0 2024-04-26T21:17:21.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf281f9df0 con 0x7faf2815c4e0 2024-04-26T21:17:21.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.291+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf28069400 con 0x7faf2815c4e0 2024-04-26T21:17:21.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.295+0000 7faf25600640 1 -- 172.21.15.106:0/903773595 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faf1c0b33f0 con 0x7faf2815c4e0 2024-04-26T21:17:21.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.295+0000 7faf25600640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faf08068380 0x7faf0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.295+0000 7faf25600640 1 -- 172.21.15.106:0/903773595 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7faf1c1219a0 con 0x7faf2815c4e0 2024-04-26T21:17:21.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.295+0000 7faf2ca00640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faf08068380 0x7faf0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.295+0000 7faf2ca00640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faf08068380 0x7faf0806a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faf281f93c0 tx=0x7faf14008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.299+0000 7faf25600640 1 -- 172.21.15.106:0/903773595 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faf1c0a7070 con 0x7faf2815c4e0 2024-04-26T21:17:21.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.455+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faf2806e2a0 con 0x7faf2815c4e0 2024-04-26T21:17:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.455+0000 7faf25600640 1 -- 172.21.15.106:0/903773595 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7faf1c016110 con 0x7faf2815c4e0 2024-04-26T21:17:21.459 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:21.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faf08068380 msgr2=0x7faf0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faf08068380 0x7faf0806a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faf281f93c0 tx=0x7faf14008040 comp rx=0 tx=0).stop 2024-04-26T21:17:21.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 msgr2=0x7faf28139640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 0x7faf28139640 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf1c01aba0 tx=0x7faf1c01ad30 comp rx=0 tx=0).stop 2024-04-26T21:17:21.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 shutdown_connections 2024-04-26T21:17:21.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf2815d080 0x7faf2813e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faf08068380 0x7faf0806a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf2815fa20 0x7faf2813ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 --2- 172.21.15.106:0/903773595 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2815c4e0 0x7faf28139640 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 >> 172.21.15.106:0/903773595 conn(0x7faf280b2910 msgr2=0x7faf280ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 shutdown_connections 2024-04-26T21:17:21.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.459+0000 7faf2fe00640 1 -- 172.21.15.106:0/903773595 wait complete. 2024-04-26T21:17:21.480 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f6344000640 1 Processor -- start 2024-04-26T21:17:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f6344000640 1 -- start start 2024-04-26T21:17:21.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f6344000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c15e020 0x7f633c167af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f6344000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633c0b44a0 con 0x7f633c15d530 2024-04-26T21:17:21.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f6344000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633c0b4780 con 0x7f633c0b5260 2024-04-26T21:17:21.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f6344000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f633c0b4a60 con 0x7f633c15e020 2024-04-26T21:17:21.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f6341600640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f633c15d530 0x7f633c0cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58982/0 (socket says 172.21.15.106:58982) 2024-04-26T21:17:21.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f6341600640 1 -- 172.21.15.106:0/1929382388 learned_addr learned my addr 172.21.15.106:0/1929382388 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:21.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f6342000640 1 --2- 172.21.15.106:0/1929382388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c15e020 0x7f633c167af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f633be00640 1 -- 172.21.15.106:0/1929382388 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864133039 0 0) 0x7f633c0b44a0 con 0x7f633c15d530 2024-04-26T21:17:21.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.615+0000 7f633be00640 1 -- 172.21.15.106:0/1929382388 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6324003530 con 0x7f633c15d530 2024-04-26T21:17:21.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6342000640 1 -- 172.21.15.106:0/1929382388 >> v1:172.21.15.112:6789/0 conn(0x7f633c0b5260 legacy=0x7f633c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6342000640 1 -- 172.21.15.106:0/1929382388 >> v1:172.21.15.106:6789/0 conn(0x7f633c15d530 legacy=0x7f633c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f633be00640 1 -- 172.21.15.106:0/1929382388 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2827203582 0 0) 0x7f6324003530 con 0x7f633c15d530 2024-04-26T21:17:21.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6342000640 1 -- 172.21.15.106:0/1929382388 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c0b4d40 con 0x7f633c15e020 2024-04-26T21:17:21.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6342000640 1 --2- 172.21.15.106:0/1929382388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c15e020 0x7f633c167af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63340097f0 tx=0x7f633401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d77d89cd87e9c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f633be00640 1 -- 172.21.15.106:0/1929382388 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63340b0070 con 0x7f633c15e020 2024-04-26T21:17:21.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f633be00640 1 -- 172.21.15.106:0/1929382388 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63340ab400 con 0x7f633c15e020 2024-04-26T21:17:21.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f633be00640 1 -- 172.21.15.106:0/1929382388 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330001a00 con 0x7f633c15e020 2024-04-26T21:17:21.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6344000640 1 -- 172.21.15.106:0/1929382388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c15e020 msgr2=0x7f633c167af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6344000640 1 --2- 172.21.15.106:0/1929382388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c15e020 0x7f633c167af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63340097f0 tx=0x7f633401c400 comp rx=0 tx=0).stop 2024-04-26T21:17:21.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6344000640 1 -- 172.21.15.106:0/1929382388 shutdown_connections 2024-04-26T21:17:21.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6344000640 1 --2- 172.21.15.106:0/1929382388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c15e020 0x7f633c167af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6344000640 1 -- 172.21.15.106:0/1929382388 >> 172.21.15.106:0/1929382388 conn(0x7f633c0b2910 msgr2=0x7f633c0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6344000640 1 -- 172.21.15.106:0/1929382388 shutdown_connections 2024-04-26T21:17:21.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.619+0000 7f6344000640 1 -- 172.21.15.106:0/1929382388 wait complete. 2024-04-26T21:17:21.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 Processor -- start 2024-04-26T21:17:21.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 -- start start 2024-04-26T21:17:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c0b5260 0x7f633c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c15d530 0x7f633c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15e020 0x7f633c13b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f633c16a9d0 con 0x7f633c15d530 2024-04-26T21:17:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f633c16a850 con 0x7f633c15e020 2024-04-26T21:17:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f633c16ab50 con 0x7f633c0b5260 2024-04-26T21:17:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6340c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c15d530 0x7f633c13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6341600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c0b5260 0x7f633c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6342000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15e020 0x7f633c13b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6340c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c15d530 0x7f633c13fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49834/0 (socket says 172.21.15.106:49834) 2024-04-26T21:17:21.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6340c00640 1 -- 172.21.15.106:0/3371228435 learned_addr learned my addr 172.21.15.106:0/3371228435 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:21.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6340c00640 1 -- 172.21.15.106:0/3371228435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c0b5260 msgr2=0x7f633c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6340c00640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c0b5260 0x7f633c159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6340c00640 1 -- 172.21.15.106:0/3371228435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15e020 msgr2=0x7f633c13b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6340c00640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15e020 0x7f633c13b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6340c00640 1 -- 172.21.15.106:0/3371228435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c146630 con 0x7f633c15d530 2024-04-26T21:17:21.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6341600640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c0b5260 0x7f633c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:21.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6340c00640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c15d530 0x7f633c13fb30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f632800c400 tx=0x7f632800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6339600640 1 -- 172.21.15.106:0/3371228435 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328017070 con 0x7f633c15d530 2024-04-26T21:17:21.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6339600640 1 -- 172.21.15.106:0/3371228435 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63280052d0 con 0x7f633c15d530 2024-04-26T21:17:21.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c1404f0 con 0x7f633c15d530 2024-04-26T21:17:21.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6339600640 1 -- 172.21.15.106:0/3371228435 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328003840 con 0x7f633c15d530 2024-04-26T21:17:21.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.623+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c140ab0 con 0x7f633c15d530 2024-04-26T21:17:21.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.627+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f633c069400 con 0x7f633c15d530 2024-04-26T21:17:21.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.627+0000 7f6339600640 1 -- 172.21.15.106:0/3371228435 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f632801a070 con 0x7f633c15d530 2024-04-26T21:17:21.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.627+0000 7f6339600640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f631c068380 0x7f631c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.627+0000 7f6339600640 1 -- 172.21.15.106:0/3371228435 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f6328086170 con 0x7f633c15d530 2024-04-26T21:17:21.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.627+0000 7f6341600640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f631c068380 0x7f631c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.627+0000 7f6341600640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f631c068380 0x7f631c06a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6330001b70 tx=0x7f6330009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.631+0000 7f6339600640 1 -- 172.21.15.106:0/3371228435 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6328005480 con 0x7f633c15d530 2024-04-26T21:17:21.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f633c0cde10 con 0x7f633c15d530 2024-04-26T21:17:21.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6339600640 1 -- 172.21.15.106:0/3371228435 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f6328055c40 con 0x7f633c15d530 2024-04-26T21:17:21.798 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f631c068380 msgr2=0x7f631c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f631c068380 0x7f631c06a840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6330001b70 tx=0x7f6330009040 comp rx=0 tx=0).stop 2024-04-26T21:17:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c15d530 msgr2=0x7f633c13fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c15d530 0x7f633c13fb30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f632800c400 tx=0x7f632800c8c0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 shutdown_connections 2024-04-26T21:17:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f633c15e020 0x7f633c13b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f631c068380 0x7f631c06a840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c15d530 0x7f633c13fb30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 --2- 172.21.15.106:0/3371228435 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f633c0b5260 0x7f633c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 >> 172.21.15.106:0/3371228435 conn(0x7f633c0b2910 msgr2=0x7f633c0b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 shutdown_connections 2024-04-26T21:17:21.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.795+0000 7f6344000640 1 -- 172.21.15.106:0/3371228435 wait complete. 2024-04-26T21:17:21.818 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b17e00640 1 Processor -- start 2024-04-26T21:17:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b17e00640 1 -- start start 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b17e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b1015c4e0 0x7f3b1015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b17e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b100b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b17e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b1015ce00 con 0x7f3b1015fa20 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b17e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f3b1015d5f0 con 0x7f3b1015c4e0 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b17e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3b100b4f00 con 0x7f3b1015d080 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b15400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b1015c4e0 0x7f3b1015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b15400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b1015c4e0 0x7f3b1015c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49846/0 (socket says 172.21.15.106:49846) 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b15400640 1 -- 172.21.15.106:0/252952301 learned_addr learned my addr 172.21.15.106:0/252952301 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b14a00640 1 --2- 172.21.15.106:0/252952301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b100b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b15400640 1 -- 172.21.15.106:0/252952301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 msgr2=0x7f3b100b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b15400640 1 --2- 172.21.15.106:0/252952301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b100b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b15400640 1 -- 172.21.15.106:0/252952301 >> v1:172.21.15.106:6789/0 conn(0x7f3b1015fa20 legacy=0x7f3b1015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b15400640 1 -- 172.21.15.106:0/252952301 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b100b51e0 con 0x7f3b1015c4e0 2024-04-26T21:17:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.955+0000 7f3b14a00640 1 --2- 172.21.15.106:0/252952301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b100b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:21.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b15400640 1 --2- 172.21.15.106:0/252952301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 0x7f3b1015c8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009870 tx=0x7f3b0401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbe05df89efc560 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b0fe00640 1 -- 172.21.15.106:0/252952301 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b040a95f0 con 0x7f3b1015c4e0 2024-04-26T21:17:21.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b0fe00640 1 -- 172.21.15.106:0/252952301 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b040a9790 con 0x7f3b1015c4e0 2024-04-26T21:17:21.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b0fe00640 1 -- 172.21.15.106:0/252952301 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b040a9b60 con 0x7f3b1015c4e0 2024-04-26T21:17:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b17e00640 1 -- 172.21.15.106:0/252952301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 msgr2=0x7f3b1015c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b17e00640 1 --2- 172.21.15.106:0/252952301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 0x7f3b1015c8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009870 tx=0x7f3b0401c530 comp rx=0 tx=0).stop 2024-04-26T21:17:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b17e00640 1 -- 172.21.15.106:0/252952301 shutdown_connections 2024-04-26T21:17:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b17e00640 1 --2- 172.21.15.106:0/252952301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b100b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b17e00640 1 --2- 172.21.15.106:0/252952301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 0x7f3b1015c8c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b17e00640 1 -- 172.21.15.106:0/252952301 >> 172.21.15.106:0/252952301 conn(0x7f3b100b2910 msgr2=0x7f3b100b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b17e00640 1 -- 172.21.15.106:0/252952301 shutdown_connections 2024-04-26T21:17:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.959+0000 7f3b17e00640 1 -- 172.21.15.106:0/252952301 wait complete. 2024-04-26T21:17:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 Processor -- start 2024-04-26T21:17:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 -- start start 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 0x7f3b10140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b101f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b1015fa20 0x7f3b101fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100b4ce0 con 0x7f3b1015c4e0 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100b4b60 con 0x7f3b1015fa20 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3b101695d0 con 0x7f3b1015d080 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 0x7f3b10140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 0x7f3b10140590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49858/0 (socket says 172.21.15.106:49858) 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15400640 1 -- 172.21.15.106:0/732349497 learned_addr learned my addr 172.21.15.106:0/732349497 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b14a00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b101f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15e00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b1015fa20 0x7f3b101fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15400640 1 -- 172.21.15.106:0/732349497 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 msgr2=0x7f3b101f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15400640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b101f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15400640 1 -- 172.21.15.106:0/732349497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b1015fa20 msgr2=0x7f3b101fb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15400640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b1015fa20 0x7f3b101fb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15400640 1 -- 172.21.15.106:0/732349497 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b10073e70 con 0x7f3b1015c4e0 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b14a00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b101f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b15400640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 0x7f3b10140590 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3b0401abe0 tx=0x7f3b040192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b0d600640 1 -- 172.21.15.106:0/732349497 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b040b1800 con 0x7f3b1015c4e0 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b0d600640 1 -- 172.21.15.106:0/732349497 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b040b19a0 con 0x7f3b1015c4e0 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b0d600640 1 -- 172.21.15.106:0/732349497 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b040b1d90 con 0x7f3b1015c4e0 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b10165020 con 0x7f3b1015c4e0 2024-04-26T21:17:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b101655e0 con 0x7f3b1015c4e0 2024-04-26T21:17:21.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.963+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b10069400 con 0x7f3b1015c4e0 2024-04-26T21:17:21.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.967+0000 7f3b0d600640 1 -- 172.21.15.106:0/732349497 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3b040bb3f0 con 0x7f3b1015c4e0 2024-04-26T21:17:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.967+0000 7f3b0d600640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3af0068380 0x7f3af006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.967+0000 7f3b0d600640 1 -- 172.21.15.106:0/732349497 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f3b04121250 con 0x7f3b1015c4e0 2024-04-26T21:17:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.967+0000 7f3b14a00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3af0068380 0x7f3af006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.967+0000 7f3b14a00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3af0068380 0x7f3af006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b100b2840 tx=0x7f3afc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:21.971+0000 7f3b0d600640 1 -- 172.21.15.106:0/732349497 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3b040c2030 con 0x7f3b1015c4e0 2024-04-26T21:17:22.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.126+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3b1006fb90 con 0x7f3b1015c4e0 2024-04-26T21:17:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b0d600640 1 -- 172.21.15.106:0/732349497 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f3b040ad020 con 0x7f3b1015c4e0 2024-04-26T21:17:22.133 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3af0068380 msgr2=0x7f3af006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3af0068380 0x7f3af006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b100b2840 tx=0x7f3afc008040 comp rx=0 tx=0).stop 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 msgr2=0x7f3b10140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 0x7f3b10140590 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3b0401abe0 tx=0x7f3b040192d0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 shutdown_connections 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b1015fa20 0x7f3b101fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3af0068380 0x7f3af006a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b1015d080 0x7f3b101f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 --2- 172.21.15.106:0/732349497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b1015c4e0 0x7f3b10140590 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 >> 172.21.15.106:0/732349497 conn(0x7f3b100b2910 msgr2=0x7f3b1013fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 shutdown_connections 2024-04-26T21:17:22.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.130+0000 7f3b17e00640 1 -- 172.21.15.106:0/732349497 wait complete. 2024-04-26T21:17:22.154 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.286+0000 7f4c4de00640 1 Processor -- start 2024-04-26T21:17:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.286+0000 7f4c4de00640 1 -- start start 2024-04-26T21:17:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c4de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c4815d530 0x7f4c480cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c4de00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c480b5260 0x7f4c480d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c4de00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c480b44a0 con 0x7f4c4815d910 2024-04-26T21:17:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c4de00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4c480b4780 con 0x7f4c4815d530 2024-04-26T21:17:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c4de00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4c480b4a60 con 0x7f4c480b5260 2024-04-26T21:17:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c46a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c4815d530 0x7f4c480cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c46a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c4815d530 0x7f4c480cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49860/0 (socket says 172.21.15.106:49860) 2024-04-26T21:17:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c46a00640 1 -- 172.21.15.106:0/1976077214 learned_addr learned my addr 172.21.15.106:0/1976077214 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c46000640 1 --2- 172.21.15.106:0/1976077214 >> v2:172.21.15.112:3300/0 conn(0x7f4c480b5260 0x7f4c480d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c46a00640 1 -- 172.21.15.106:0/1976077214 >> v2:172.21.15.112:3300/0 conn(0x7f4c480b5260 msgr2=0x7f4c480d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c46a00640 1 --2- 172.21.15.106:0/1976077214 >> v2:172.21.15.112:3300/0 conn(0x7f4c480b5260 0x7f4c480d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c46a00640 1 -- 172.21.15.106:0/1976077214 >> v1:172.21.15.112:6789/0 conn(0x7f4c4815d910 legacy=0x7f4c4815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c46a00640 1 -- 172.21.15.106:0/1976077214 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c480b4d40 con 0x7f4c4815d530 2024-04-26T21:17:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.290+0000 7f4c46000640 1 --2- 172.21.15.106:0/1976077214 >> v2:172.21.15.112:3300/0 conn(0x7f4c480b5260 0x7f4c480d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c46a00640 1 --2- 172.21.15.106:0/1976077214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c4815d530 0x7f4c480cfe20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4c480b0820 tx=0x7f4c3001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece008409cff2941 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c45600640 1 -- 172.21.15.106:0/1976077214 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c300a6040 con 0x7f4c4815d530 2024-04-26T21:17:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c45600640 1 -- 172.21.15.106:0/1976077214 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c300af070 con 0x7f4c4815d530 2024-04-26T21:17:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c45600640 1 -- 172.21.15.106:0/1976077214 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c300aa860 con 0x7f4c4815d530 2024-04-26T21:17:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 -- 172.21.15.106:0/1976077214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c4815d530 msgr2=0x7f4c480cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 --2- 172.21.15.106:0/1976077214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c4815d530 0x7f4c480cfe20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4c480b0820 tx=0x7f4c3001c520 comp rx=0 tx=0).stop 2024-04-26T21:17:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 -- 172.21.15.106:0/1976077214 shutdown_connections 2024-04-26T21:17:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 --2- 172.21.15.106:0/1976077214 >> v2:172.21.15.112:3300/0 conn(0x7f4c480b5260 0x7f4c480d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 --2- 172.21.15.106:0/1976077214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c4815d530 0x7f4c480cfe20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 -- 172.21.15.106:0/1976077214 >> 172.21.15.106:0/1976077214 conn(0x7f4c480b2910 msgr2=0x7f4c480b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 -- 172.21.15.106:0/1976077214 shutdown_connections 2024-04-26T21:17:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 -- 172.21.15.106:0/1976077214 wait complete. 2024-04-26T21:17:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 Processor -- start 2024-04-26T21:17:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.294+0000 7f4c4de00640 1 -- start start 2024-04-26T21:17:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c4de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c480b5260 0x7f4c48139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c4de00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c4815d530 0x7f4c4815bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c4de00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4815d910 0x7f4c48143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c4de00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4c48169690 con 0x7f4c480b5260 2024-04-26T21:17:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c4de00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c48169510 con 0x7f4c4815d910 2024-04-26T21:17:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c4de00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4c48169810 con 0x7f4c4815d530 2024-04-26T21:17:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c480b5260 0x7f4c48139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c480b5260 0x7f4c48139620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49870/0 (socket says 172.21.15.106:49870) 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46a00640 1 -- 172.21.15.106:0/3602396028 learned_addr learned my addr 172.21.15.106:0/3602396028 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46000640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c4815d530 0x7f4c4815bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c47400640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4815d910 0x7f4c48143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46a00640 1 -- 172.21.15.106:0/3602396028 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c4815d530 msgr2=0x7f4c4815bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46a00640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c4815d530 0x7f4c4815bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46a00640 1 -- 172.21.15.106:0/3602396028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4815d910 msgr2=0x7f4c48143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46a00640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4815d910 0x7f4c48143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46a00640 1 -- 172.21.15.106:0/3602396028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4815c460 con 0x7f4c480b5260 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c46a00640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c480b5260 0x7f4c48139620 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4c3001a150 tx=0x7f4c3001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c3f400640 1 -- 172.21.15.106:0/3602396028 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c300bd3f0 con 0x7f4c480b5260 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c3f400640 1 -- 172.21.15.106:0/3602396028 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c300bd590 con 0x7f4c480b5260 2024-04-26T21:17:22.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4815c740 con 0x7f4c480b5260 2024-04-26T21:17:22.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c3f400640 1 -- 172.21.15.106:0/3602396028 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c300bd940 con 0x7f4c480b5260 2024-04-26T21:17:22.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4815cd00 con 0x7f4c480b5260 2024-04-26T21:17:22.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.298+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c48069400 con 0x7f4c480b5260 2024-04-26T21:17:22.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.302+0000 7f4c3f400640 1 -- 172.21.15.106:0/3602396028 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c300b33f0 con 0x7f4c480b5260 2024-04-26T21:17:22.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.302+0000 7f4c3f400640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c24068380 0x7f4c2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.302+0000 7f4c3f400640 1 -- 172.21.15.106:0/3602396028 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f4c30121040 con 0x7f4c480b5260 2024-04-26T21:17:22.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.302+0000 7f4c46000640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c24068380 0x7f4c2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.302+0000 7f4c46000640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c24068380 0x7f4c2406a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4c48140a90 tx=0x7f4c38008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:22.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.306+0000 7f4c3f400640 1 -- 172.21.15.106:0/3602396028 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4c300c3060 con 0x7f4c480b5260 2024-04-26T21:17:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.462+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4c4815e970 con 0x7f4c480b5260 2024-04-26T21:17:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.462+0000 7f4c3f400640 1 -- 172.21.15.106:0/3602396028 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f4c30016110 con 0x7f4c480b5260 2024-04-26T21:17:22.467 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c24068380 msgr2=0x7f4c2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c24068380 0x7f4c2406a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4c48140a90 tx=0x7f4c38008040 comp rx=0 tx=0).stop 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c480b5260 msgr2=0x7f4c48139620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c480b5260 0x7f4c48139620 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4c3001a150 tx=0x7f4c3001ad60 comp rx=0 tx=0).stop 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 shutdown_connections 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c4815d910 0x7f4c48143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4c24068380 0x7f4c2406a840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4c4815d530 0x7f4c4815bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 --2- 172.21.15.106:0/3602396028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c480b5260 0x7f4c48139620 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 >> 172.21.15.106:0/3602396028 conn(0x7f4c480b2910 msgr2=0x7f4c4815ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 shutdown_connections 2024-04-26T21:17:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.466+0000 7f4c4de00640 1 -- 172.21.15.106:0/3602396028 wait complete. 2024-04-26T21:17:22.489 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:17:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c3c800640 1 Processor -- start 2024-04-26T21:17:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c3c800640 1 -- start start 2024-04-26T21:17:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c3c800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c3413f140 0x7f8c3415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c3c800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c340b3d10 con 0x7f8c3406eb70 2024-04-26T21:17:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c3c800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c340b3ff0 con 0x7f8c3413ed60 2024-04-26T21:17:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c3c800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8c340b3ac0 con 0x7f8c3413f140 2024-04-26T21:17:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c3a800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8c3406eb70 0x7f8c340d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59010/0 (socket says 172.21.15.106:59010) 2024-04-26T21:17:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c3a800640 1 -- 172.21.15.106:0/2898720455 learned_addr learned my addr 172.21.15.106:0/2898720455 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c39400640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c3413f140 0x7f8c3415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2923572823 0 0) 0x7f8c340b3d10 con 0x7f8c3406eb70 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c1c005740 con 0x7f8c3406eb70 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692230478 0 0) 0x7f8c340b3ff0 con 0x7f8c3413ed60 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c340b3d10 con 0x7f8c3413ed60 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4029399965 0 0) 0x7f8c1c005740 con 0x7f8c3406eb70 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c3413f140 msgr2=0x7f8c3415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c3413f140 0x7f8c3415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 >> v1:172.21.15.112:6789/0 conn(0x7f8c3413ed60 legacy=0x7f8c340b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c340b42d0 con 0x7f8c3406eb70 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f8c30001a20 con 0x7f8c3406eb70 2024-04-26T21:17:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 >> v1:172.21.15.106:6789/0 conn(0x7f8c3406eb70 legacy=0x7f8c340d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c005d90 0x7f8c1c006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c006a20 0x7f8c1c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c007430 0x7f8c1c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8c340b3ac0 con 0x7f8c1c006a20 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c00e1d0 con 0x7f8c1c005d90 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c00e3d0 con 0x7f8c1c007430 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c39400640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c006a20 0x7f8c1c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c39e00640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c005d90 0x7f8c1c006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c3a800640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c007430 0x7f8c1c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c39400640 1 -- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c007430 msgr2=0x7f8c1c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c39400640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c007430 0x7f8c1c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c39400640 1 -- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c005d90 msgr2=0x7f8c1c006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c39400640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c005d90 0x7f8c1c006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.622+0000 7f8c39400640 1 -- 172.21.15.106:0/2898720455 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c005740 con 0x7f8c1c006a20 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c39400640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c006a20 0x7f8c1c006ea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c24009ae0 tx=0x7f8c2401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3079ad2ec6cbd19c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240096b0 con 0x7f8c1c006a20 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c240a6450 con 0x7f8c1c006a20 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c38a00640 1 -- 172.21.15.106:0/2898720455 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240a6840 con 0x7f8c1c006a20 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c3c800640 1 -- 172.21.15.106:0/2898720455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c006a20 msgr2=0x7f8c1c006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c3c800640 1 --2- 172.21.15.106:0/2898720455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c006a20 0x7f8c1c006ea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c24009ae0 tx=0x7f8c2401ca70 comp rx=0 tx=0).stop 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c3a800640 1 -- 172.21.15.106:0/2898720455 reap_dead start 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c3c800640 1 -- 172.21.15.106:0/2898720455 shutdown_connections 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c3c800640 1 -- 172.21.15.106:0/2898720455 >> 172.21.15.106:0/2898720455 conn(0x7f8c34068340 msgr2=0x7f8c34068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c3c800640 1 -- 172.21.15.106:0/2898720455 shutdown_connections 2024-04-26T21:17:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.626+0000 7f8c3c800640 1 -- 172.21.15.106:0/2898720455 wait complete. 2024-04-26T21:17:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 Processor -- start 2024-04-26T21:17:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 -- start start 2024-04-26T21:17:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c006a20 0x7f8c3413b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c3415a7b0 0x7f8c3415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c3413c4a0 0x7f8c3413c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3415c3e0 con 0x7f8c3415a7b0 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c340d1710 con 0x7f8c3413c4a0 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8c3415c560 con 0x7f8c1c006a20 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c3415a7b0 0x7f8c3415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c3415a7b0 0x7f8c3415ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49894/0 (socket says 172.21.15.106:49894) 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39400640 1 -- 172.21.15.106:0/3812070824 learned_addr learned my addr 172.21.15.106:0/3812070824 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39e00640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c006a20 0x7f8c3413b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3a800640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c3413c4a0 0x7f8c3413c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39400640 1 -- 172.21.15.106:0/3812070824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c006a20 msgr2=0x7f8c3413b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39400640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c006a20 0x7f8c3413b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39400640 1 -- 172.21.15.106:0/3812070824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c3413c4a0 msgr2=0x7f8c3413c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39400640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c3413c4a0 0x7f8c3413c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39400640 1 -- 172.21.15.106:0/3812070824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3415b170 con 0x7f8c3415a7b0 2024-04-26T21:17:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c39400640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c3415a7b0 0x7f8c3415ac30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8c2401cf50 tx=0x7f8c1c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c2e000640 1 -- 172.21.15.106:0/3812070824 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240be070 con 0x7f8c3415a7b0 2024-04-26T21:17:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c2e000640 1 -- 172.21.15.106:0/3812070824 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c240a6c80 con 0x7f8c3415a7b0 2024-04-26T21:17:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3413d210 con 0x7f8c3415a7b0 2024-04-26T21:17:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c2e000640 1 -- 172.21.15.106:0/3812070824 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240a7670 con 0x7f8c3415a7b0 2024-04-26T21:17:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.630+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c3413d7d0 con 0x7f8c3415a7b0 2024-04-26T21:17:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.634+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c34069400 con 0x7f8c3415a7b0 2024-04-26T21:17:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.634+0000 7f8c2e000640 1 -- 172.21.15.106:0/3812070824 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c240c1070 con 0x7f8c3415a7b0 2024-04-26T21:17:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.634+0000 7f8c2e000640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8c180683b0 0x7f8c1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.634+0000 7f8c2e000640 1 -- 172.21.15.106:0/3812070824 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f8c24120870 con 0x7f8c3415a7b0 2024-04-26T21:17:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.634+0000 7f8c39e00640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8c180683b0 0x7f8c1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.634+0000 7f8c39e00640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8c180683b0 0x7f8c1806a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8c280010f0 tx=0x7f8c28009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.638+0000 7f8c2e000640 1 -- 172.21.15.106:0/3812070824 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8c240ac020 con 0x7f8c3415a7b0 2024-04-26T21:17:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.806+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8c34072b40 con 0x7f8c3415a7b0 2024-04-26T21:17:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c2e000640 1 -- 172.21.15.106:0/3812070824 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f8c24016780 con 0x7f8c3415a7b0 2024-04-26T21:17:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:17:22.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8c180683b0 msgr2=0x7f8c1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8c180683b0 0x7f8c1806a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8c280010f0 tx=0x7f8c28009040 comp rx=0 tx=0).stop 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c3415a7b0 msgr2=0x7f8c3415ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c3415a7b0 0x7f8c3415ac30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8c2401cf50 tx=0x7f8c1c007a50 comp rx=0 tx=0).stop 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 shutdown_connections 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c3413c4a0 0x7f8c3413c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8c180683b0 0x7f8c1806a870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c3415a7b0 0x7f8c3415ac30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 --2- 172.21.15.106:0/3812070824 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c006a20 0x7f8c3413b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 >> 172.21.15.106:0/3812070824 conn(0x7f8c34068340 msgr2=0x7f8c340cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 shutdown_connections 2024-04-26T21:17:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:22.810+0000 7f8c3c800640 1 -- 172.21.15.106:0/3812070824 wait complete. 2024-04-26T21:17:22.833 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi106.front.sepia.ceph.com... 2024-04-26T21:17:22.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:22.834 DEBUG:teuthology.orchestra.run.smithi106:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-26T21:17:22.854 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:17:22.854 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:17:22.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:22.854 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-26T21:17:22.908 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:17:22.908 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:22.918 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:17:22.918 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:22.966 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:23.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbbe200640 1 Processor -- start 2024-04-26T21:17:23.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbbe200640 1 -- start start 2024-04-26T21:17:23.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbbe200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbb815d060 0x7fbbb80cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbbe200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbbb80cfb70 0x7fbbb80cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbbe200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb80b2250 con 0x7fbbb80d0830 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbbe200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fbbb80b25a0 con 0x7fbbb815d060 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbbe200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbbb80ce660 con 0x7fbbb80cfb70 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbb7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbb815d060 0x7fbbb80cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbb7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbb815d060 0x7fbbb80cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49908/0 (socket says 172.21.15.106:49908) 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbb7400640 1 -- 172.21.15.106:0/3818827098 learned_addr learned my addr 172.21.15.106:0/3818827098 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbb6a00640 1 --2- 172.21.15.106:0/3818827098 >> v2:172.21.15.112:3300/0 conn(0x7fbbb80cfb70 0x7fbbb80cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbb7400640 1 -- 172.21.15.106:0/3818827098 >> v2:172.21.15.112:3300/0 conn(0x7fbbb80cfb70 msgr2=0x7fbbb80cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbb7400640 1 --2- 172.21.15.106:0/3818827098 >> v2:172.21.15.112:3300/0 conn(0x7fbbb80cfb70 0x7fbbb80cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbb7400640 1 -- 172.21.15.106:0/3818827098 >> v1:172.21.15.112:6789/0 conn(0x7fbbb80d0830 legacy=0x7fbbb80d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.098+0000 7fbbb7400640 1 -- 172.21.15.106:0/3818827098 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb80ce940 con 0x7fbbb815d060 2024-04-26T21:17:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbb7400640 1 --2- 172.21.15.106:0/3818827098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb815d060 0x7fbbb80cf630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8073340 tx=0x7fbba801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ec39a185c702aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:23.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbb6000640 1 -- 172.21.15.106:0/3818827098 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba80ab430 con 0x7fbbb815d060 2024-04-26T21:17:23.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbb6000640 1 -- 172.21.15.106:0/3818827098 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba80b0070 con 0x7fbbb815d060 2024-04-26T21:17:23.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbb6000640 1 -- 172.21.15.106:0/3818827098 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba80ab7f0 con 0x7fbbb815d060 2024-04-26T21:17:23.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbbe200640 1 -- 172.21.15.106:0/3818827098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb815d060 msgr2=0x7fbbb80cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbbe200640 1 --2- 172.21.15.106:0/3818827098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb815d060 0x7fbbb80cf630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8073340 tx=0x7fbba801c520 comp rx=0 tx=0).stop 2024-04-26T21:17:23.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbbe200640 1 -- 172.21.15.106:0/3818827098 shutdown_connections 2024-04-26T21:17:23.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbbe200640 1 --2- 172.21.15.106:0/3818827098 >> v2:172.21.15.112:3300/0 conn(0x7fbbb80cfb70 0x7fbbb80cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbbe200640 1 --2- 172.21.15.106:0/3818827098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb815d060 0x7fbbb80cf630 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbbe200640 1 -- 172.21.15.106:0/3818827098 >> 172.21.15.106:0/3818827098 conn(0x7fbbb80d2c60 msgr2=0x7fbbb80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:23.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbbe200640 1 -- 172.21.15.106:0/3818827098 shutdown_connections 2024-04-26T21:17:23.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.102+0000 7fbbbe200640 1 -- 172.21.15.106:0/3818827098 wait complete. 2024-04-26T21:17:23.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 Processor -- start 2024-04-26T21:17:23.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 -- start start 2024-04-26T21:17:23.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb80cfb70 0x7fbbb8154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80d0830 0x7fbbb8156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbb815d060 0x7fbbb815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb80ce400 con 0x7fbbb80d0830 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb80ce280 con 0x7fbbb80cfb70 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb816a410 con 0x7fbbb815d060 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80d0830 0x7fbbb8156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80d0830 0x7fbbb8156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49912/0 (socket says 172.21.15.106:49912) 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb6a00640 1 -- 172.21.15.106:0/505432845 learned_addr learned my addr 172.21.15.106:0/505432845 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb7400640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb80cfb70 0x7fbbb8154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb7e00640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbb815d060 0x7fbbb815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb6a00640 1 -- 172.21.15.106:0/505432845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbb815d060 msgr2=0x7fbbb815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb6a00640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbb815d060 0x7fbbb815bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb6a00640 1 -- 172.21.15.106:0/505432845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb80cfb70 msgr2=0x7fbbb8154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb6a00640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb80cfb70 0x7fbbb8154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb6a00640 1 -- 172.21.15.106:0/505432845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb80c77a0 con 0x7fbbb80d0830 2024-04-26T21:17:23.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb7400640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb80cfb70 0x7fbbb8154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:23.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbb6a00640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80d0830 0x7fbbb8156a80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbba400e8a0 tx=0x7fbba400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:23.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbaf400640 1 -- 172.21.15.106:0/505432845 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4017070 con 0x7fbbb80d0830 2024-04-26T21:17:23.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbaf400640 1 -- 172.21.15.106:0/505432845 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba400c940 con 0x7fbbb80d0830 2024-04-26T21:17:23.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb81651a0 con 0x7fbbb80d0830 2024-04-26T21:17:23.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbaf400640 1 -- 172.21.15.106:0/505432845 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba400cd10 con 0x7fbbb80d0830 2024-04-26T21:17:23.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb8165760 con 0x7fbbb80d0830 2024-04-26T21:17:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.106+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb8069400 con 0x7fbbb80d0830 2024-04-26T21:17:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.110+0000 7fbbaf400640 1 -- 172.21.15.106:0/505432845 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbba401a070 con 0x7fbbb80d0830 2024-04-26T21:17:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.110+0000 7fbbaf400640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb98068380 0x7fbb9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.110+0000 7fbbaf400640 1 -- 172.21.15.106:0/505432845 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fbba4086d50 con 0x7fbbb80d0830 2024-04-26T21:17:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.110+0000 7fbbb7400640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb98068380 0x7fbb9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.110+0000 7fbbb7400640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb98068380 0x7fbb9806a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbba80af000 tx=0x7fbba80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.114+0000 7fbbaf400640 1 -- 172.21.15.106:0/505432845 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbba4056e70 con 0x7fbbb80d0830 2024-04-26T21:17:23.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbb80af960 con 0x7fbbb80d0830 2024-04-26T21:17:23.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbaf400640 1 -- 172.21.15.106:0/505432845 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7fbba4056770 con 0x7fbbb80d0830 2024-04-26T21:17:23.278 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:23.278 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:23.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb98068380 msgr2=0x7fbb9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb98068380 0x7fbb9806a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbba80af000 tx=0x7fbba80a7000 comp rx=0 tx=0).stop 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80d0830 msgr2=0x7fbbb8156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80d0830 0x7fbbb8156a80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbba400e8a0 tx=0x7fbba400ed60 comp rx=0 tx=0).stop 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 shutdown_connections 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb98068380 0x7fbb9806a840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbb815d060 0x7fbbb815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80d0830 0x7fbbb8156a80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 --2- 172.21.15.106:0/505432845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbb80cfb70 0x7fbbb8154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.274+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 >> 172.21.15.106:0/505432845 conn(0x7fbbb80d2c60 msgr2=0x7fbbb80b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.278+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 shutdown_connections 2024-04-26T21:17:23.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.278+0000 7fbbbe200640 1 -- 172.21.15.106:0/505432845 wait complete. 2024-04-26T21:17:23.299 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:23.299 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbc4a00640 1 Processor -- start 2024-04-26T21:17:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbc4a00640 1 -- start start 2024-04-26T21:17:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbc4a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc0159890 0x7fbbc0162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbc4a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbbc006ffb0 0x7fbbc00d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbc4a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbc0070410 0x7fbbc00d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbc4a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc0072770 con 0x7fbbc0070410 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbc4a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc0163b60 con 0x7fbbc006ffb0 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbc4a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc00729c0 con 0x7fbbc0159890 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbbe800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbc0070410 0x7fbbc00d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbbe800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbc0070410 0x7fbbc00d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49916/0 (socket says 172.21.15.106:49916) 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbbe800640 1 -- 172.21.15.106:0/2740845703 learned_addr learned my addr 172.21.15.106:0/2740845703 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbbde00640 1 --2- 172.21.15.106:0/2740845703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc0159890 0x7fbbc0162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbb5400640 1 --2- 172.21.15.106:0/2740845703 >> v2:172.21.15.112:3300/0 conn(0x7fbbc006ffb0 0x7fbbc00d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbbe800640 1 -- 172.21.15.106:0/2740845703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc0159890 msgr2=0x7fbbc0162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:23.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbbe800640 1 --2- 172.21.15.106:0/2740845703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc0159890 0x7fbbc0162bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbbe800640 1 -- 172.21.15.106:0/2740845703 >> v2:172.21.15.112:3300/0 conn(0x7fbbc006ffb0 msgr2=0x7fbbc00d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:23.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbbe800640 1 --2- 172.21.15.106:0/2740845703 >> v2:172.21.15.112:3300/0 conn(0x7fbbc006ffb0 0x7fbbc00d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.438+0000 7fbbbe800640 1 -- 172.21.15.106:0/2740845703 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc0072ca0 con 0x7fbbc0070410 2024-04-26T21:17:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbbe800640 1 --2- 172.21.15.106:0/2740845703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0070410 0x7fbbc00d1680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0073c10 tx=0x7fbbb801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e462954876f86d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbbd400640 1 -- 172.21.15.106:0/2740845703 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80a5870 con 0x7fbbc0070410 2024-04-26T21:17:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbbd400640 1 -- 172.21.15.106:0/2740845703 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb80a5a10 con 0x7fbbc0070410 2024-04-26T21:17:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbbd400640 1 -- 172.21.15.106:0/2740845703 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80a5de0 con 0x7fbbc0070410 2024-04-26T21:17:23.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbc4a00640 1 -- 172.21.15.106:0/2740845703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0070410 msgr2=0x7fbbc00d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/2740845703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0070410 0x7fbbc00d1680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0073c10 tx=0x7fbbb801c9f0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbc4a00640 1 -- 172.21.15.106:0/2740845703 shutdown_connections 2024-04-26T21:17:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/2740845703 >> v2:172.21.15.112:3300/0 conn(0x7fbbc006ffb0 0x7fbbc00d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/2740845703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0070410 0x7fbbc00d1680 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/2740845703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc0159890 0x7fbbc0162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbc4a00640 1 -- 172.21.15.106:0/2740845703 >> 172.21.15.106:0/2740845703 conn(0x7fbbc006c400 msgr2=0x7fbbc006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbc4a00640 1 -- 172.21.15.106:0/2740845703 shutdown_connections 2024-04-26T21:17:23.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.442+0000 7fbbc4a00640 1 -- 172.21.15.106:0/2740845703 wait complete. 2024-04-26T21:17:23.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 Processor -- start 2024-04-26T21:17:23.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 -- start start 2024-04-26T21:17:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbc006ffb0 0x7fbbc015c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc00cde40 0x7fbbc0155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0155650 0x7fbbc0159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc0160060 con 0x7fbbc0155650 2024-04-26T21:17:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc0075e30 con 0x7fbbc006ffb0 2024-04-26T21:17:23.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc01601e0 con 0x7fbbc00cde40 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbe800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0155650 0x7fbbc0159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbe800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0155650 0x7fbbc0159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49922/0 (socket says 172.21.15.106:49922) 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbe800640 1 -- 172.21.15.106:0/409157502 learned_addr learned my addr 172.21.15.106:0/409157502 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbde00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbc006ffb0 0x7fbbc015c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbb5400640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc00cde40 0x7fbbc0155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbe800640 1 -- 172.21.15.106:0/409157502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc00cde40 msgr2=0x7fbbc0155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbe800640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc00cde40 0x7fbbc0155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbe800640 1 -- 172.21.15.106:0/409157502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbc006ffb0 msgr2=0x7fbbc015c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbe800640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbc006ffb0 0x7fbbc015c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbe800640 1 -- 172.21.15.106:0/409157502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc00aea70 con 0x7fbbc0155650 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbbe800640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0155650 0x7fbbc0159cc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80af040 tx=0x7fbbb8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbb6a00640 1 -- 172.21.15.106:0/409157502 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80bc020 con 0x7fbbc0155650 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbb6a00640 1 -- 172.21.15.106:0/409157502 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb80b8690 con 0x7fbbc0155650 2024-04-26T21:17:23.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc00aed50 con 0x7fbbc0155650 2024-04-26T21:17:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbb6a00640 1 -- 172.21.15.106:0/409157502 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80b8a80 con 0x7fbbc0155650 2024-04-26T21:17:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.446+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc00af5f0 con 0x7fbbc0155650 2024-04-26T21:17:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.450+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc0069400 con 0x7fbbc0155650 2024-04-26T21:17:23.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.450+0000 7fbbb6a00640 1 -- 172.21.15.106:0/409157502 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbbb80bf020 con 0x7fbbc0155650 2024-04-26T21:17:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.450+0000 7fbbb6a00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb9c068380 0x7fbb9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.450+0000 7fbbb6a00640 1 -- 172.21.15.106:0/409157502 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fbbb8121be0 con 0x7fbbc0155650 2024-04-26T21:17:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.450+0000 7fbbbde00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb9c068380 0x7fbb9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.450+0000 7fbbbde00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb9c068380 0x7fbb9c06a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009ac0 tx=0x7fbbb0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:23.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.454+0000 7fbbb6a00640 1 -- 172.21.15.106:0/409157502 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbbb80c6030 con 0x7fbbc0155650 2024-04-26T21:17:23.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.614+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbbc00d2170 con 0x7fbbc0155650 2024-04-26T21:17:23.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.614+0000 7fbbb6a00640 1 -- 172.21.15.106:0/409157502 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fbbb80165e0 con 0x7fbbc0155650 2024-04-26T21:17:23.619 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:23.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb9c068380 msgr2=0x7fbb9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb9c068380 0x7fbb9c06a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009ac0 tx=0x7fbbb0009190 comp rx=0 tx=0).stop 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0155650 msgr2=0x7fbbc0159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0155650 0x7fbbc0159cc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80af040 tx=0x7fbbb8019790 comp rx=0 tx=0).stop 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 shutdown_connections 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fbb9c068380 0x7fbb9c06a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc0155650 0x7fbbc0159cc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbbc00cde40 0x7fbbc0155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 --2- 172.21.15.106:0/409157502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbc006ffb0 0x7fbbc015c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 >> 172.21.15.106:0/409157502 conn(0x7fbbc006c400 msgr2=0x7fbbc00b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 shutdown_connections 2024-04-26T21:17:23.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.618+0000 7fbbc4a00640 1 -- 172.21.15.106:0/409157502 wait complete. 2024-04-26T21:17:23.640 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:23.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.774+0000 7f0267a00640 1 Processor -- start 2024-04-26T21:17:23.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.774+0000 7f0267a00640 1 -- start start 2024-04-26T21:17:23.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0267a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f026015d530 0x7f02600cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0267a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 0x7f02600d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0267a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02600b44a0 con 0x7f02600b5260 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0267a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f02600b4780 con 0x7f026015d530 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0267a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f02600b4a60 con 0x7f026015e020 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0265000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f026015d530 0x7f02600cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0257e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f02600b5260 0x7f026015d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59018/0 (socket says 172.21.15.106:59018) 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0265000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f026015d530 0x7f02600cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49934/0 (socket says 172.21.15.106:49934) 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0257e00640 1 -- 172.21.15.106:0/3610023987 learned_addr learned my addr 172.21.15.106:0/3610023987 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0265a00640 1 --2- 172.21.15.106:0/3610023987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 0x7f02600d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0265000640 1 -- 172.21.15.106:0/3610023987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 msgr2=0x7f02600d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0265000640 1 --2- 172.21.15.106:0/3610023987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 0x7f02600d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0265000640 1 -- 172.21.15.106:0/3610023987 >> v1:172.21.15.106:6789/0 conn(0x7f02600b5260 legacy=0x7f026015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.778+0000 7f0265000640 1 -- 172.21.15.106:0/3610023987 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02600b4d40 con 0x7f026015d530 2024-04-26T21:17:23.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0265000640 1 --2- 172.21.15.106:0/3610023987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 0x7f02600cfe20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f02500097c0 tx=0x7f025001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170ba2be9da4dfdb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:23.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f025fe00640 1 -- 172.21.15.106:0/3610023987 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02500b0070 con 0x7f026015d530 2024-04-26T21:17:23.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f025fe00640 1 -- 172.21.15.106:0/3610023987 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02500ab600 con 0x7f026015d530 2024-04-26T21:17:23.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f025fe00640 1 -- 172.21.15.106:0/3610023987 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02500ab9d0 con 0x7f026015d530 2024-04-26T21:17:23.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 -- 172.21.15.106:0/3610023987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 msgr2=0x7f02600cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 --2- 172.21.15.106:0/3610023987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 0x7f02600cfe20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f02500097c0 tx=0x7f025001c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 -- 172.21.15.106:0/3610023987 shutdown_connections 2024-04-26T21:17:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 --2- 172.21.15.106:0/3610023987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 0x7f02600d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 --2- 172.21.15.106:0/3610023987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 0x7f02600cfe20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 -- 172.21.15.106:0/3610023987 >> 172.21.15.106:0/3610023987 conn(0x7f02600b2910 msgr2=0x7f02600b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 -- 172.21.15.106:0/3610023987 shutdown_connections 2024-04-26T21:17:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 -- 172.21.15.106:0/3610023987 wait complete. 2024-04-26T21:17:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 Processor -- start 2024-04-26T21:17:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 -- start start 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02600b5260 0x7f0260073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 0x7f0260159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 0x7f0260145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0260169690 con 0x7f026015d530 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0260169510 con 0x7f02600b5260 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.782+0000 7f0267a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0260169810 con 0x7f026015e020 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0257e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 0x7f0260159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0257e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 0x7f0260159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49936/0 (socket says 172.21.15.106:49936) 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0257e00640 1 -- 172.21.15.106:0/3258323039 learned_addr learned my addr 172.21.15.106:0/3258323039 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:23.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0265000640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02600b5260 0x7f0260073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0265a00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 0x7f0260145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0257e00640 1 -- 172.21.15.106:0/3258323039 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 msgr2=0x7f0260145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0257e00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 0x7f0260145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0257e00640 1 -- 172.21.15.106:0/3258323039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02600b5260 msgr2=0x7f0260073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0257e00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02600b5260 0x7f0260073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0257e00640 1 -- 172.21.15.106:0/3258323039 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0260072490 con 0x7f026015d530 2024-04-26T21:17:23.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0257e00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 0x7f0260159c40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f024800c340 tx=0x7f024800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f025d600640 1 -- 172.21.15.106:0/3258323039 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248017070 con 0x7f026015d530 2024-04-26T21:17:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f025d600640 1 -- 172.21.15.106:0/3258323039 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0248005cf0 con 0x7f026015d530 2024-04-26T21:17:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f025d600640 1 -- 172.21.15.106:0/3258323039 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248007310 con 0x7f026015d530 2024-04-26T21:17:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0260072770 con 0x7f026015d530 2024-04-26T21:17:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0260072d30 con 0x7f026015d530 2024-04-26T21:17:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0260069400 con 0x7f026015d530 2024-04-26T21:17:23.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f025d600640 1 -- 172.21.15.106:0/3258323039 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f024801a070 con 0x7f026015d530 2024-04-26T21:17:23.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.786+0000 7f025d600640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f023c068380 0x7f023c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:23.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.790+0000 7f025d600640 1 -- 172.21.15.106:0/3258323039 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f0248086090 con 0x7f026015d530 2024-04-26T21:17:23.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.790+0000 7f0265000640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f023c068380 0x7f023c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:23.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.790+0000 7f0265000640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f023c068380 0x7f023c06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02500ad000 tx=0x7f0250008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:23.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.794+0000 7f025d600640 1 -- 172.21.15.106:0/3258323039 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0248055b60 con 0x7f026015d530 2024-04-26T21:17:23.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f026006f340 con 0x7f026015d530 2024-04-26T21:17:23.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f025d600640 1 -- 172.21.15.106:0/3258323039 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f0248059e60 con 0x7f026015d530 2024-04-26T21:17:23.953 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:23.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f023c068380 msgr2=0x7f023c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f023c068380 0x7f023c06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02500ad000 tx=0x7f0250008040 comp rx=0 tx=0).stop 2024-04-26T21:17:23.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 msgr2=0x7f0260159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:23.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 0x7f0260159c40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f024800c340 tx=0x7f024800c800 comp rx=0 tx=0).stop 2024-04-26T21:17:23.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 shutdown_connections 2024-04-26T21:17:23.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f023c068380 0x7f023c06a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f026015e020 0x7f0260145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026015d530 0x7f0260159c40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 --2- 172.21.15.106:0/3258323039 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02600b5260 0x7f0260073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:23.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 >> 172.21.15.106:0/3258323039 conn(0x7f02600b2910 msgr2=0x7f02600af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:23.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 shutdown_connections 2024-04-26T21:17:23.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:23.950+0000 7f0267a00640 1 -- 172.21.15.106:0/3258323039 wait complete. 2024-04-26T21:17:23.975 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:24.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0809000640 1 Processor -- start 2024-04-26T21:17:24.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0809000640 1 -- start start 2024-04-26T21:17:24.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0809000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f080415c4e0 0x7f080415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0809000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f080415d080 0x7f08040b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0809000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f080415ce00 con 0x7f080415fa20 2024-04-26T21:17:24.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0809000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f080415d5f0 con 0x7f080415d080 2024-04-26T21:17:24.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0809000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f08040b4f00 con 0x7f080415c4e0 2024-04-26T21:17:24.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0801400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f080415d080 0x7f08040b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0801400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f080415d080 0x7f08040b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49950/0 (socket says 172.21.15.106:49950) 2024-04-26T21:17:24.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0801400640 1 -- 172.21.15.106:0/3620568760 learned_addr learned my addr 172.21.15.106:0/3620568760 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:24.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0801e00640 1 --2- 172.21.15.106:0/3620568760 >> v2:172.21.15.112:3300/0 conn(0x7f080415c4e0 0x7f080415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0801400640 1 -- 172.21.15.106:0/3620568760 >> v2:172.21.15.112:3300/0 conn(0x7f080415c4e0 msgr2=0x7f080415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:24.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0801400640 1 --2- 172.21.15.106:0/3620568760 >> v2:172.21.15.112:3300/0 conn(0x7f080415c4e0 0x7f080415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0801400640 1 -- 172.21.15.106:0/3620568760 >> v1:172.21.15.112:6789/0 conn(0x7f080415fa20 legacy=0x7f080415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:24.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.110+0000 7f0801400640 1 -- 172.21.15.106:0/3620568760 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08040b51e0 con 0x7f080415d080 2024-04-26T21:17:24.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0801400640 1 --2- 172.21.15.106:0/3620568760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415d080 0x7f08040b4620 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0804070310 tx=0x7f07f001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e94b0380d2951dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:24.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0800a00640 1 -- 172.21.15.106:0/3620568760 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f00aa650 con 0x7f080415d080 2024-04-26T21:17:24.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0800a00640 1 -- 172.21.15.106:0/3620568760 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00af070 con 0x7f080415d080 2024-04-26T21:17:24.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0800a00640 1 -- 172.21.15.106:0/3620568760 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f00aaa10 con 0x7f080415d080 2024-04-26T21:17:24.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 -- 172.21.15.106:0/3620568760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415d080 msgr2=0x7f08040b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 --2- 172.21.15.106:0/3620568760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415d080 0x7f08040b4620 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0804070310 tx=0x7f07f001c4f0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 -- 172.21.15.106:0/3620568760 shutdown_connections 2024-04-26T21:17:24.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 --2- 172.21.15.106:0/3620568760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415d080 0x7f08040b4620 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 --2- 172.21.15.106:0/3620568760 >> v2:172.21.15.112:3300/0 conn(0x7f080415c4e0 0x7f080415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 -- 172.21.15.106:0/3620568760 >> 172.21.15.106:0/3620568760 conn(0x7f08040b2910 msgr2=0x7f08040b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:24.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 -- 172.21.15.106:0/3620568760 shutdown_connections 2024-04-26T21:17:24.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 -- 172.21.15.106:0/3620568760 wait complete. 2024-04-26T21:17:24.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 Processor -- start 2024-04-26T21:17:24.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.114+0000 7f0809000640 1 -- start start 2024-04-26T21:17:24.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0809000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415c4e0 0x7f08041f9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0809000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f080415d080 0x7f0804143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0809000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f080415fa20 0x7f0804164e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0809000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f08040b4ce0 con 0x7f080415c4e0 2024-04-26T21:17:24.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0809000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08040b4b60 con 0x7f080415fa20 2024-04-26T21:17:24.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0809000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f08041695d0 con 0x7f080415d080 2024-04-26T21:17:24.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415c4e0 0x7f08041f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415c4e0 0x7f08041f9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49960/0 (socket says 172.21.15.106:49960) 2024-04-26T21:17:24.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801e00640 1 -- 172.21.15.106:0/994382885 learned_addr learned my addr 172.21.15.106:0/994382885 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:24.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801400640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f080415d080 0x7f0804143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0802800640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f080415fa20 0x7f0804164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801e00640 1 -- 172.21.15.106:0/994382885 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f080415d080 msgr2=0x7f0804143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801e00640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f080415d080 0x7f0804143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801e00640 1 -- 172.21.15.106:0/994382885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f080415fa20 msgr2=0x7f0804164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801e00640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f080415fa20 0x7f0804164e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801e00640 1 -- 172.21.15.106:0/994382885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0804141a20 con 0x7f080415c4e0 2024-04-26T21:17:24.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0801e00640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415c4e0 0x7f08041f9110 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f07f4007f20 tx=0x7f07f400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:24.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f07fa000640 1 -- 172.21.15.106:0/994382885 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4014620 con 0x7f080415c4e0 2024-04-26T21:17:24.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f07fa000640 1 -- 172.21.15.106:0/994382885 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4019070 con 0x7f080415c4e0 2024-04-26T21:17:24.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0804144560 con 0x7f080415c4e0 2024-04-26T21:17:24.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f07fa000640 1 -- 172.21.15.106:0/994382885 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4014a00 con 0x7f080415c4e0 2024-04-26T21:17:24.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0804144b20 con 0x7f080415c4e0 2024-04-26T21:17:24.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0804069400 con 0x7f080415c4e0 2024-04-26T21:17:24.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.118+0000 7f07fa000640 1 -- 172.21.15.106:0/994382885 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f07f4014ba0 con 0x7f080415c4e0 2024-04-26T21:17:24.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.122+0000 7f07fa000640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07e4068380 0x7f07e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.122+0000 7f07fa000640 1 -- 172.21.15.106:0/994382885 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f07f40875d0 con 0x7f080415c4e0 2024-04-26T21:17:24.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.122+0000 7f0801400640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07e4068380 0x7f07e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.122+0000 7f0801400640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07e4068380 0x7f07e406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f07f00ae000 tx=0x7f07f00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:24.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.126+0000 7f07fa000640 1 -- 172.21.15.106:0/994382885 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f07f4057130 con 0x7f080415c4e0 2024-04-26T21:17:24.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f080406e2a0 con 0x7f080415c4e0 2024-04-26T21:17:24.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f07fa000640 1 -- 172.21.15.106:0/994382885 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f07f405b430 con 0x7f080415c4e0 2024-04-26T21:17:24.285 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07e4068380 msgr2=0x7f07e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07e4068380 0x7f07e406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f07f00ae000 tx=0x7f07f00a7000 comp rx=0 tx=0).stop 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415c4e0 msgr2=0x7f08041f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415c4e0 0x7f08041f9110 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f07f4007f20 tx=0x7f07f400e570 comp rx=0 tx=0).stop 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 shutdown_connections 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f080415fa20 0x7f0804164e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f07e4068380 0x7f07e406a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f080415d080 0x7f0804143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 --2- 172.21.15.106:0/994382885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f080415c4e0 0x7f08041f9110 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 >> 172.21.15.106:0/994382885 conn(0x7f08040b2910 msgr2=0x7f080415fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:24.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 shutdown_connections 2024-04-26T21:17:24.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.282+0000 7f0809000640 1 -- 172.21.15.106:0/994382885 wait complete. 2024-04-26T21:17:24.306 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.442+0000 7f5f8ae00640 1 Processor -- start 2024-04-26T21:17:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f8ae00640 1 -- start start 2024-04-26T21:17:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f8ae00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f8415d530 0x7f5f840cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f8ae00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f840b44a0 con 0x7f5f840b5260 2024-04-26T21:17:24.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f8ae00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f840b4780 con 0x7f5f8415e020 2024-04-26T21:17:24.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f8ae00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5f840b4a60 con 0x7f5f8415d530 2024-04-26T21:17:24.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f83400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5f840b5260 0x7f5f8415d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59024/0 (socket says 172.21.15.106:59024) 2024-04-26T21:17:24.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f83400640 1 -- 172.21.15.106:0/1549805107 learned_addr learned my addr 172.21.15.106:0/1549805107 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:24.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f83e00640 1 --2- 172.21.15.106:0/1549805107 >> v2:172.21.15.112:3300/0 conn(0x7f5f8415d530 0x7f5f840cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f82a00640 1 -- 172.21.15.106:0/1549805107 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864330012 0 0) 0x7f5f840b44a0 con 0x7f5f840b5260 2024-04-26T21:17:24.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f82a00640 1 -- 172.21.15.106:0/1549805107 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f68003530 con 0x7f5f840b5260 2024-04-26T21:17:24.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f83e00640 1 -- 172.21.15.106:0/1549805107 >> v1:172.21.15.112:6789/0 conn(0x7f5f8415e020 legacy=0x7f5f84166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f82a00640 1 -- 172.21.15.106:0/1549805107 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 536318524 0 0) 0x7f5f68003530 con 0x7f5f840b5260 2024-04-26T21:17:24.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f83e00640 1 -- 172.21.15.106:0/1549805107 >> v1:172.21.15.106:6789/0 conn(0x7f5f840b5260 legacy=0x7f5f8415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.446+0000 7f5f83e00640 1 -- 172.21.15.106:0/1549805107 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f840b4d40 con 0x7f5f8415d530 2024-04-26T21:17:24.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f83e00640 1 --2- 172.21.15.106:0/1549805107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415d530 0x7f5f840cfe20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5f740097c0 tx=0x7f5f7401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=539a323c124895b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:24.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f82a00640 1 -- 172.21.15.106:0/1549805107 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f740b0070 con 0x7f5f8415d530 2024-04-26T21:17:24.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f82a00640 1 -- 172.21.15.106:0/1549805107 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f740ab400 con 0x7f5f8415d530 2024-04-26T21:17:24.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f82a00640 1 -- 172.21.15.106:0/1549805107 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70001680 con 0x7f5f8415d530 2024-04-26T21:17:24.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f8ae00640 1 -- 172.21.15.106:0/1549805107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415d530 msgr2=0x7f5f840cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f8ae00640 1 --2- 172.21.15.106:0/1549805107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415d530 0x7f5f840cfe20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5f740097c0 tx=0x7f5f7401c3c0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f8ae00640 1 -- 172.21.15.106:0/1549805107 shutdown_connections 2024-04-26T21:17:24.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f8ae00640 1 --2- 172.21.15.106:0/1549805107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415d530 0x7f5f840cfe20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f8ae00640 1 -- 172.21.15.106:0/1549805107 >> 172.21.15.106:0/1549805107 conn(0x7f5f840b2910 msgr2=0x7f5f840b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:24.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f8ae00640 1 -- 172.21.15.106:0/1549805107 shutdown_connections 2024-04-26T21:17:24.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f8ae00640 1 -- 172.21.15.106:0/1549805107 wait complete. 2024-04-26T21:17:24.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f8ae00640 1 Processor -- start 2024-04-26T21:17:24.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.450+0000 7f5f8ae00640 1 -- start start 2024-04-26T21:17:24.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f8ae00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f840b5260 0x7f5f8413d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f8ae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f8415d530 0x7f5f8415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f8ae00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415e020 0x7f5f8415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f8ae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8416adb0 con 0x7f5f8415d530 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f8ae00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8416ac30 con 0x7f5f8415e020 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f8ae00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5f8416af30 con 0x7f5f840b5260 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f8415d530 0x7f5f8415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f8415d530 0x7f5f8415abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49968/0 (socket says 172.21.15.106:49968) 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83400640 1 -- 172.21.15.106:0/842141647 learned_addr learned my addr 172.21.15.106:0/842141647 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83e00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f840b5260 0x7f5f8413d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f88e00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415e020 0x7f5f8415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83400640 1 -- 172.21.15.106:0/842141647 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f840b5260 msgr2=0x7f5f8413d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83400640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f840b5260 0x7f5f8413d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83400640 1 -- 172.21.15.106:0/842141647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415e020 msgr2=0x7f5f8415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83400640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415e020 0x7f5f8415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83400640 1 -- 172.21.15.106:0/842141647 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8415b100 con 0x7f5f8415d530 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f88e00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415e020 0x7f5f8415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f83400640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f8415d530 0x7f5f8415abc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c700 tx=0x7f5f7000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f7be00640 1 -- 172.21.15.106:0/842141647 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70017070 con 0x7f5f8415d530 2024-04-26T21:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f7be00640 1 -- 172.21.15.106:0/842141647 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f70005ae0 con 0x7f5f8415d530 2024-04-26T21:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f7be00640 1 -- 172.21.15.106:0/842141647 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70007070 con 0x7f5f8415d530 2024-04-26T21:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f8415bb90 con 0x7f5f8415d530 2024-04-26T21:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f8413deb0 con 0x7f5f8415d530 2024-04-26T21:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.454+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f84069400 con 0x7f5f8415d530 2024-04-26T21:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.458+0000 7f5f7be00640 1 -- 172.21.15.106:0/842141647 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5f7001a070 con 0x7f5f8415d530 2024-04-26T21:17:24.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.458+0000 7f5f7be00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5f64068380 0x7f5f6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.458+0000 7f5f7be00640 1 -- 172.21.15.106:0/842141647 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f5f700861e0 con 0x7f5f8415d530 2024-04-26T21:17:24.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.458+0000 7f5f83e00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5f64068380 0x7f5f6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.458+0000 7f5f83e00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5f64068380 0x7f5f6406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f740ad000 tx=0x7f5f740a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:24.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.462+0000 7f5f7be00640 1 -- 172.21.15.106:0/842141647 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5f8415bb90 con 0x7f5f8415d530 2024-04-26T21:17:24.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.618+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5f8406c830 con 0x7f5f8415d530 2024-04-26T21:17:24.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.618+0000 7f5f7be00640 1 -- 172.21.15.106:0/842141647 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f5f70055cb0 con 0x7f5f8415d530 2024-04-26T21:17:24.622 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.618+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5f64068380 msgr2=0x7f5f6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.618+0000 7f5f8ae00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5f64068380 0x7f5f6406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f740ad000 tx=0x7f5f740a6000 comp rx=0 tx=0).stop 2024-04-26T21:17:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.618+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f8415d530 msgr2=0x7f5f8415abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.618+0000 7f5f8ae00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f8415d530 0x7f5f8415abc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c700 tx=0x7f5f7000cbc0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.622+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 shutdown_connections 2024-04-26T21:17:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.622+0000 7f5f8ae00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f8415e020 0x7f5f8415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.622+0000 7f5f8ae00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5f64068380 0x7f5f6406a840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.622+0000 7f5f8ae00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f8415d530 0x7f5f8415abc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.622+0000 7f5f8ae00640 1 --2- 172.21.15.106:0/842141647 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f840b5260 0x7f5f8413d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.622+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 >> 172.21.15.106:0/842141647 conn(0x7f5f840b2910 msgr2=0x7f5f840b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.622+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 shutdown_connections 2024-04-26T21:17:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.622+0000 7f5f8ae00640 1 -- 172.21.15.106:0/842141647 wait complete. 2024-04-26T21:17:24.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:17:24.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b78200640 1 Processor -- start 2024-04-26T21:17:24.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b78200640 1 -- start start 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b78200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b7015f0b0 0x7f3b7015f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b78200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b700d0550 con 0x7f3b70152710 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b78200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b700d0830 con 0x7f3b7006fff0 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b78200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3b700b3ac0 con 0x7f3b7015f0b0 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b75800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3b70152710 0x7f3b7006f5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59036/0 (socket says 172.21.15.106:59036) 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b75800640 1 -- 172.21.15.106:0/1761049790 learned_addr learned my addr 172.21.15.106:0/1761049790 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b76200640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b7015f0b0 0x7f3b7015f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 453473807 0 0) 0x7f3b700d0550 con 0x7f3b70152710 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b58003530 con 0x7f3b70152710 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2222983340 0 0) 0x7f3b58003530 con 0x7f3b70152710 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b7015f0b0 msgr2=0x7f3b7015f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b7015f0b0 0x7f3b7015f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 >> v1:172.21.15.112:6789/0 conn(0x7f3b7006fff0 legacy=0x7f3b70071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b700b3da0 con 0x7f3b70152710 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f3b64001680 con 0x7f3b70152710 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 >> v1:172.21.15.106:6789/0 conn(0x7f3b70152710 legacy=0x7f3b7006f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b580039f0 0x7f3b58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b7015f0b0 0x7f3b58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b58004d50 0x7f3b580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3b700b3ac0 con 0x7f3b58004d50 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5800ba00 con 0x7f3b580039f0 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5800de10 con 0x7f3b7015f0b0 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b76200640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b58004d50 0x7f3b580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b74e00640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b7015f0b0 0x7f3b58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b75800640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b580039f0 0x7f3b58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b76200640 1 -- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b7015f0b0 msgr2=0x7f3b58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b76200640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b7015f0b0 0x7f3b58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b76200640 1 -- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b580039f0 msgr2=0x7f3b58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:24.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b76200640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b580039f0 0x7f3b58003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b76200640 1 -- 172.21.15.106:0/1761049790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b58003530 con 0x7f3b58004d50 2024-04-26T21:17:24.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.778+0000 7f3b75800640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b580039f0 0x7f3b58003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:24.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b76200640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b58004d50 0x7f3b580051d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800a250 tx=0x7f3b6801ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18eee130724944bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:24.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b680ab070 con 0x7f3b58004d50 2024-04-26T21:17:24.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b680a5d20 con 0x7f3b58004d50 2024-04-26T21:17:24.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b6fe00640 1 -- 172.21.15.106:0/1761049790 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800adf0 con 0x7f3b58004d50 2024-04-26T21:17:24.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b78200640 1 -- 172.21.15.106:0/1761049790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b58004d50 msgr2=0x7f3b580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b78200640 1 --2- 172.21.15.106:0/1761049790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b58004d50 0x7f3b580051d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800a250 tx=0x7f3b6801ce10 comp rx=0 tx=0).stop 2024-04-26T21:17:24.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b76200640 1 -- 172.21.15.106:0/1761049790 reap_dead start 2024-04-26T21:17:24.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b78200640 1 -- 172.21.15.106:0/1761049790 shutdown_connections 2024-04-26T21:17:24.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b78200640 1 -- 172.21.15.106:0/1761049790 >> 172.21.15.106:0/1761049790 conn(0x7f3b70068340 msgr2=0x7f3b70068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:24.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b78200640 1 -- 172.21.15.106:0/1761049790 shutdown_connections 2024-04-26T21:17:24.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.782+0000 7f3b78200640 1 -- 172.21.15.106:0/1761049790 wait complete. 2024-04-26T21:17:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 Processor -- start 2024-04-26T21:17:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 -- start start 2024-04-26T21:17:24.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b58004d50 0x7f3b7013e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b7013ea10 0x7f3b700727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b70072d20 0x7f3b70156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7015f560 con 0x7f3b7013ea10 2024-04-26T21:17:24.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70072660 con 0x7f3b70072d20 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7015f6e0 con 0x7f3b58004d50 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b74e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b7013ea10 0x7f3b700727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b75800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b58004d50 0x7f3b7013e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b75800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b58004d50 0x7f3b7013e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:55196/0 (socket says 172.21.15.106:55196) 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b75800640 1 -- 172.21.15.106:0/2472991526 learned_addr learned my addr 172.21.15.106:0/2472991526 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b76200640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b70072d20 0x7f3b70156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b74e00640 1 -- 172.21.15.106:0/2472991526 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b58004d50 msgr2=0x7f3b7013e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b74e00640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b58004d50 0x7f3b7013e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b74e00640 1 -- 172.21.15.106:0/2472991526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b70072d20 msgr2=0x7f3b70156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b74e00640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b70072d20 0x7f3b70156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b74e00640 1 -- 172.21.15.106:0/2472991526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b70140bd0 con 0x7f3b7013ea10 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b74e00640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b7013ea10 0x7f3b700727e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3b70070430 tx=0x7f3b5c00fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b6d600640 1 -- 172.21.15.106:0/2472991526 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c01a070 con 0x7f3b7013ea10 2024-04-26T21:17:24.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b6d600640 1 -- 172.21.15.106:0/2472991526 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5c00fe40 con 0x7f3b7013ea10 2024-04-26T21:17:24.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b70140eb0 con 0x7f3b7013ea10 2024-04-26T21:17:24.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b6d600640 1 -- 172.21.15.106:0/2472991526 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c007050 con 0x7f3b7013ea10 2024-04-26T21:17:24.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.786+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b70141470 con 0x7f3b7013ea10 2024-04-26T21:17:24.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.790+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b70073130 con 0x7f3b7013ea10 2024-04-26T21:17:24.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.790+0000 7f3b6d600640 1 -- 172.21.15.106:0/2472991526 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3b5c01d070 con 0x7f3b7013ea10 2024-04-26T21:17:24.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.790+0000 7f3b6d600640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3b50068380 0x7f3b5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:24.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.790+0000 7f3b6d600640 1 -- 172.21.15.106:0/2472991526 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f3b5c0864b0 con 0x7f3b7013ea10 2024-04-26T21:17:24.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.790+0000 7f3b75800640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3b50068380 0x7f3b5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:24.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.790+0000 7f3b75800640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3b50068380 0x7f3b5006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b70072150 tx=0x7f3b64001440 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:24.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.794+0000 7f3b6d600640 1 -- 172.21.15.106:0/2472991526 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3b70073130 con 0x7f3b7013ea10 2024-04-26T21:17:24.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.962+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3b70069400 con 0x7f3b7013ea10 2024-04-26T21:17:24.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.962+0000 7f3b6d600640 1 -- 172.21.15.106:0/2472991526 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f3b5c0560b0 con 0x7f3b7013ea10 2024-04-26T21:17:24.967 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:17:24.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3b50068380 msgr2=0x7f3b5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3b50068380 0x7f3b5006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b70072150 tx=0x7f3b64001440 comp rx=0 tx=0).stop 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b7013ea10 msgr2=0x7f3b700727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b7013ea10 0x7f3b700727e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3b70070430 tx=0x7f3b5c00fc50 comp rx=0 tx=0).stop 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 shutdown_connections 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b70072d20 0x7f3b70156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3b50068380 0x7f3b5006a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b7013ea10 0x7f3b700727e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 --2- 172.21.15.106:0/2472991526 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3b58004d50 0x7f3b7013e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 >> 172.21.15.106:0/2472991526 conn(0x7f3b70068340 msgr2=0x7f3b700b4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 shutdown_connections 2024-04-26T21:17:24.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:24.966+0000 7f3b78200640 1 -- 172.21.15.106:0/2472991526 wait complete. 2024-04-26T21:17:24.988 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:17:24.988 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:17:24.998 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:25.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bfc200640 1 Processor -- start 2024-04-26T21:17:25.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bfc200640 1 -- start start 2024-04-26T21:17:25.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bfc200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8bf413ed60 0x7f8bf415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bfc200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8bf413f140 0x7f8bf40b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bfc200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bf40b3d10 con 0x7f8bf406eb70 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bfc200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf40b3ac0 con 0x7f8bf413f140 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bfc200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf40b4920 con 0x7f8bf413ed60 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bf8e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8bf413f140 0x7f8bf40b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bfa200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8bf406eb70 0x7f8bf40d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59046/0 (socket says 172.21.15.106:59046) 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bf8e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8bf413f140 0x7f8bf40b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49992/0 (socket says 172.21.15.106:49992) 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bfa200640 1 -- 172.21.15.106:0/1235078589 learned_addr learned my addr 172.21.15.106:0/1235078589 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bf9800640 1 --2- 172.21.15.106:0/1235078589 >> v2:172.21.15.112:3300/0 conn(0x7f8bf413ed60 0x7f8bf415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bf8e00640 1 -- 172.21.15.106:0/1235078589 >> v2:172.21.15.112:3300/0 conn(0x7f8bf413ed60 msgr2=0x7f8bf415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bf8e00640 1 --2- 172.21.15.106:0/1235078589 >> v2:172.21.15.112:3300/0 conn(0x7f8bf413ed60 0x7f8bf415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bf3e00640 1 -- 172.21.15.106:0/1235078589 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780843530 0 0) 0x7f8bf40b3d10 con 0x7f8bf406eb70 2024-04-26T21:17:25.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bf8e00640 1 -- 172.21.15.106:0/1235078589 >> v1:172.21.15.106:6789/0 conn(0x7f8bf406eb70 legacy=0x7f8bf40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.130+0000 7f8bf8e00640 1 -- 172.21.15.106:0/1235078589 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf40b3ff0 con 0x7f8bf413f140 2024-04-26T21:17:25.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bf8e00640 1 --2- 172.21.15.106:0/1235078589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413f140 0x7f8bf40b52e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4074400 tx=0x7f8be001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fbce85037a842d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:25.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bf3e00640 1 -- 172.21.15.106:0/1235078589 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be00b2070 con 0x7f8bf413f140 2024-04-26T21:17:25.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bf3e00640 1 -- 172.21.15.106:0/1235078589 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be00a9070 con 0x7f8bf413f140 2024-04-26T21:17:25.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bf3e00640 1 -- 172.21.15.106:0/1235078589 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be00ad880 con 0x7f8bf413f140 2024-04-26T21:17:25.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bfc200640 1 -- 172.21.15.106:0/1235078589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413f140 msgr2=0x7f8bf40b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bfc200640 1 --2- 172.21.15.106:0/1235078589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413f140 0x7f8bf40b52e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4074400 tx=0x7f8be001c360 comp rx=0 tx=0).stop 2024-04-26T21:17:25.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bfc200640 1 -- 172.21.15.106:0/1235078589 shutdown_connections 2024-04-26T21:17:25.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bfc200640 1 --2- 172.21.15.106:0/1235078589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413f140 0x7f8bf40b52e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bfc200640 1 --2- 172.21.15.106:0/1235078589 >> v2:172.21.15.112:3300/0 conn(0x7f8bf413ed60 0x7f8bf415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bfc200640 1 -- 172.21.15.106:0/1235078589 >> 172.21.15.106:0/1235078589 conn(0x7f8bf4068340 msgr2=0x7f8bf4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:25.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bfc200640 1 -- 172.21.15.106:0/1235078589 shutdown_connections 2024-04-26T21:17:25.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bfc200640 1 -- 172.21.15.106:0/1235078589 wait complete. 2024-04-26T21:17:25.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.134+0000 7f8bfc200640 1 Processor -- start 2024-04-26T21:17:25.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 -- start start 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413ed60 0x7f8bf41450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bf4153cf0 0x7f8bf40ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bf4143d10 0x7f8bf4144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf40d1680 con 0x7f8bf413ed60 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf40d1500 con 0x7f8bf4153cf0 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf4160400 con 0x7f8bf4143d10 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf9800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413ed60 0x7f8bf41450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf9800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413ed60 0x7f8bf41450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49998/0 (socket says 172.21.15.106:49998) 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf9800640 1 -- 172.21.15.106:0/1334615568 learned_addr learned my addr 172.21.15.106:0/1334615568 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf8e00640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bf4153cf0 0x7f8bf40ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfa200640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bf4143d10 0x7f8bf4144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf9800640 1 -- 172.21.15.106:0/1334615568 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bf4143d10 msgr2=0x7f8bf4144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf9800640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bf4143d10 0x7f8bf4144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf9800640 1 -- 172.21.15.106:0/1334615568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bf4153cf0 msgr2=0x7f8bf40ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf9800640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bf4153cf0 0x7f8bf40ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf9800640 1 -- 172.21.15.106:0/1334615568 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf41544d0 con 0x7f8bf413ed60 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf9800640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413ed60 0x7f8bf41450c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e960 tx=0x7f8be800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf1600640 1 -- 172.21.15.106:0/1334615568 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8017070 con 0x7f8bf413ed60 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf1600640 1 -- 172.21.15.106:0/1334615568 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be800ca00 con 0x7f8bf413ed60 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf41547b0 con 0x7f8bf413ed60 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bf1600640 1 -- 172.21.15.106:0/1334615568 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be800cdb0 con 0x7f8bf413ed60 2024-04-26T21:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf4154d70 con 0x7f8bf413ed60 2024-04-26T21:17:25.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.138+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf4167b60 con 0x7f8bf413ed60 2024-04-26T21:17:25.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.142+0000 7f8bf1600640 1 -- 172.21.15.106:0/1334615568 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8be801a070 con 0x7f8bf413ed60 2024-04-26T21:17:25.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.142+0000 7f8bf1600640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bd40683b0 0x7f8bd406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.142+0000 7f8bf1600640 1 -- 172.21.15.106:0/1334615568 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f8be80870b0 con 0x7f8bf413ed60 2024-04-26T21:17:25.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.142+0000 7f8bf8e00640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bd40683b0 0x7f8bd406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.142+0000 7f8bf8e00640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bd40683b0 0x7f8bd406a870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8be00af000 tx=0x7f8be0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.146+0000 7f8bf1600640 1 -- 172.21.15.106:0/1334615568 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8be8056c10 con 0x7f8bf413ed60 2024-04-26T21:17:25.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.302+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bf4073e30 con 0x7f8bf413ed60 2024-04-26T21:17:25.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bf1600640 1 -- 172.21.15.106:0/1334615568 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7f8be805af10 con 0x7f8bf413ed60 2024-04-26T21:17:25.309 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:25.309 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bd40683b0 msgr2=0x7f8bd406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bd40683b0 0x7f8bd406a870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8be00af000 tx=0x7f8be0008040 comp rx=0 tx=0).stop 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413ed60 msgr2=0x7f8bf41450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413ed60 0x7f8bf41450c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e960 tx=0x7f8be800ee20 comp rx=0 tx=0).stop 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 shutdown_connections 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bf4153cf0 0x7f8bf40ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bd40683b0 0x7f8bd406a870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8bf4143d10 0x7f8bf4144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 --2- 172.21.15.106:0/1334615568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bf413ed60 0x7f8bf41450c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 >> 172.21.15.106:0/1334615568 conn(0x7f8bf4068340 msgr2=0x7f8bf415d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:25.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 shutdown_connections 2024-04-26T21:17:25.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.306+0000 7f8bfc200640 1 -- 172.21.15.106:0/1334615568 wait complete. 2024-04-26T21:17:25.330 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:25.330 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:25.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.462+0000 7fd70d000640 1 Processor -- start 2024-04-26T21:17:25.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.462+0000 7fd70d000640 1 -- start start 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd70d000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708162bd0 0x7fd7080d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd70d000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd7080d1680 0x7fd70815f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd70d000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7080d1af0 con 0x7fd708159890 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd70d000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd708163030 con 0x7fd7080d1680 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd70d000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd708072770 con 0x7fd708162bd0 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd705e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd708159890 0x7fd70806ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59054/0 (socket says 172.21.15.106:59054) 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd705e00640 1 -- 172.21.15.106:0/197147486 learned_addr learned my addr 172.21.15.106:0/197147486 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd6fd400640 1 --2- 172.21.15.106:0/197147486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708162bd0 0x7fd7080d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd706800640 1 --2- 172.21.15.106:0/197147486 >> v2:172.21.15.112:3300/0 conn(0x7fd7080d1680 0x7fd70815f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd705400640 1 -- 172.21.15.106:0/197147486 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859896504 0 0) 0x7fd7080d1af0 con 0x7fd708159890 2024-04-26T21:17:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd705400640 1 -- 172.21.15.106:0/197147486 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6ec003530 con 0x7fd708159890 2024-04-26T21:17:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd705400640 1 -- 172.21.15.106:0/197147486 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3652959654 0 0) 0x7fd6ec003530 con 0x7fd708159890 2024-04-26T21:17:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd6fd400640 1 -- 172.21.15.106:0/197147486 >> v2:172.21.15.112:3300/0 conn(0x7fd7080d1680 msgr2=0x7fd70815f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd6fd400640 1 --2- 172.21.15.106:0/197147486 >> v2:172.21.15.112:3300/0 conn(0x7fd7080d1680 0x7fd70815f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd6fd400640 1 -- 172.21.15.106:0/197147486 >> v1:172.21.15.106:6789/0 conn(0x7fd708159890 legacy=0x7fd70806ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd6fd400640 1 -- 172.21.15.106:0/197147486 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7080729c0 con 0x7fd708162bd0 2024-04-26T21:17:25.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.466+0000 7fd706800640 1 --2- 172.21.15.106:0/197147486 >> v2:172.21.15.112:3300/0 conn(0x7fd7080d1680 0x7fd70815f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:25.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd6fd400640 1 --2- 172.21.15.106:0/197147486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708162bd0 0x7fd7080d1140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00097c0 tx=0x7fd6f001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae1c659bdc36f2e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd705400640 1 -- 172.21.15.106:0/197147486 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00b0070 con 0x7fd708162bd0 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd705400640 1 -- 172.21.15.106:0/197147486 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f00ab400 con 0x7fd708162bd0 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd705400640 1 -- 172.21.15.106:0/197147486 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8001680 con 0x7fd708162bd0 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 -- 172.21.15.106:0/197147486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708162bd0 msgr2=0x7fd7080d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 --2- 172.21.15.106:0/197147486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708162bd0 0x7fd7080d1140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00097c0 tx=0x7fd6f001c3c0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 -- 172.21.15.106:0/197147486 shutdown_connections 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 --2- 172.21.15.106:0/197147486 >> v2:172.21.15.112:3300/0 conn(0x7fd7080d1680 0x7fd70815f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 --2- 172.21.15.106:0/197147486 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708162bd0 0x7fd7080d1140 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 -- 172.21.15.106:0/197147486 >> 172.21.15.106:0/197147486 conn(0x7fd70806c400 msgr2=0x7fd70806c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 -- 172.21.15.106:0/197147486 shutdown_connections 2024-04-26T21:17:25.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 -- 172.21.15.106:0/197147486 wait complete. 2024-04-26T21:17:25.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 Processor -- start 2024-04-26T21:17:25.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.470+0000 7fd70d000640 1 -- start start 2024-04-26T21:17:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd70d000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7080d1680 0x7fd7080d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd70d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708162bd0 0x7fd7081519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd70d000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708158fd0 0x7fd708159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd70d000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd708075e30 con 0x7fd708162bd0 2024-04-26T21:17:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd70d000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd708073540 con 0x7fd7080d1680 2024-04-26T21:17:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd70d000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd70816bf70 con 0x7fd708158fd0 2024-04-26T21:17:25.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fd400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708162bd0 0x7fd7081519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fd400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708162bd0 0x7fd7081519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50000/0 (socket says 172.21.15.106:50000) 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fd400640 1 -- 172.21.15.106:0/2459596495 learned_addr learned my addr 172.21.15.106:0/2459596495 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd705e00640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7080d1680 0x7fd7080d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd706800640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708158fd0 0x7fd708159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fd400640 1 -- 172.21.15.106:0/2459596495 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708158fd0 msgr2=0x7fd708159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fd400640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708158fd0 0x7fd708159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fd400640 1 -- 172.21.15.106:0/2459596495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7080d1680 msgr2=0x7fd7080d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fd400640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7080d1680 0x7fd7080d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fd400640 1 -- 172.21.15.106:0/2459596495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7080d05d0 con 0x7fd708162bd0 2024-04-26T21:17:25.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fd400640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708162bd0 0x7fd7081519e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00097c0 tx=0x7fd6f001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fea00640 1 -- 172.21.15.106:0/2459596495 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00b0050 con 0x7fd708162bd0 2024-04-26T21:17:25.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fea00640 1 -- 172.21.15.106:0/2459596495 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f00bc070 con 0x7fd708162bd0 2024-04-26T21:17:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70815aab0 con 0x7fd708162bd0 2024-04-26T21:17:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fea00640 1 -- 172.21.15.106:0/2459596495 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0006e20 con 0x7fd708162bd0 2024-04-26T21:17:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd708151f20 con 0x7fd708162bd0 2024-04-26T21:17:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd708069400 con 0x7fd708162bd0 2024-04-26T21:17:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.474+0000 7fd6fea00640 1 -- 172.21.15.106:0/2459596495 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd6f00b78b0 con 0x7fd708162bd0 2024-04-26T21:17:25.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.478+0000 7fd6fea00640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd6e4068380 0x7fd6e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.478+0000 7fd6fea00640 1 -- 172.21.15.106:0/2459596495 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fd6f01214b0 con 0x7fd708162bd0 2024-04-26T21:17:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.478+0000 7fd705e00640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd6e4068380 0x7fd6e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.478+0000 7fd705e00640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd6e4068380 0x7fd6e406a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80013d0 tx=0x7fd6f8001360 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:25.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.482+0000 7fd6fea00640 1 -- 172.21.15.106:0/2459596495 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd6f0015fb0 con 0x7fd708162bd0 2024-04-26T21:17:25.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd7080d2170 con 0x7fd708162bd0 2024-04-26T21:17:25.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd6fea00640 1 -- 172.21.15.106:0/2459596495 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fd6f00f15d0 con 0x7fd708162bd0 2024-04-26T21:17:25.645 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:25.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd6e4068380 msgr2=0x7fd6e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd6e4068380 0x7fd6e406a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80013d0 tx=0x7fd6f8001360 comp rx=0 tx=0).stop 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708162bd0 msgr2=0x7fd7081519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708162bd0 0x7fd7081519e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00097c0 tx=0x7fd6f001ac00 comp rx=0 tx=0).stop 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 shutdown_connections 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd6e4068380 0x7fd6e406a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd708158fd0 0x7fd708159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708162bd0 0x7fd7081519e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 --2- 172.21.15.106:0/2459596495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7080d1680 0x7fd7080d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 >> 172.21.15.106:0/2459596495 conn(0x7fd70806c400 msgr2=0x7fd7080b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 shutdown_connections 2024-04-26T21:17:25.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.642+0000 7fd70d000640 1 -- 172.21.15.106:0/2459596495 wait complete. 2024-04-26T21:17:25.667 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:25.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67bce00640 1 Processor -- start 2024-04-26T21:17:25.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67bce00640 1 -- start start 2024-04-26T21:17:25.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67bce00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b815cd30 0x7f67b80d3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67bce00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f67b815d110 0x7f67b80cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67bce00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b80af780 con 0x7f67b80d1010 2024-04-26T21:17:25.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67bce00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f67b806fe00 con 0x7f67b815d110 2024-04-26T21:17:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67bce00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f67b80706a0 con 0x7f67b815cd30 2024-04-26T21:17:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b7e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f67b80d1010 0x7f67b80cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59070/0 (socket says 172.21.15.106:59070) 2024-04-26T21:17:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b7e00640 1 -- 172.21.15.106:0/133754933 learned_addr learned my addr 172.21.15.106:0/133754933 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b7400640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b815cd30 0x7f67b80d3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6a00640 1 --2- 172.21.15.106:0/133754933 >> v2:172.21.15.112:3300/0 conn(0x7f67b815d110 0x7f67b80cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1612634356 0 0) 0x7f67b00014a0 con 0x7f67b80d1010 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f679c003530 con 0x7f67b80d1010 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 796588125 0 0) 0x7f679c003530 con 0x7f67b80d1010 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b815cd30 msgr2=0x7f67b80d3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b815cd30 0x7f67b80d3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 >> v2:172.21.15.112:3300/0 conn(0x7f67b815d110 msgr2=0x7f67b80cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 --2- 172.21.15.106:0/133754933 >> v2:172.21.15.112:3300/0 conn(0x7f67b815d110 0x7f67b80cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b80d01c0 con 0x7f67b80d1010 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f67b0001bd0 con 0x7f67b80d1010 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b7400640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b815cd30 0x7f67b80d3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 >> v1:172.21.15.106:6789/0 conn(0x7f67b80d1010 legacy=0x7f67b80cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c003a30 0x7f679c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b815cd30 0x7f679c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f679c004d50 0x7f679c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f67b806fe00 con 0x7f679c004d50 2024-04-26T21:17:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f67b80706a0 con 0x7f679c003a30 2024-04-26T21:17:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f679c00ba00 con 0x7f67b815cd30 2024-04-26T21:17:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b7e00640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f679c004d50 0x7f679c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b6a00640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b815cd30 0x7f679c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b7400640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c003a30 0x7f679c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.802+0000 7f67b7e00640 1 -- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b815cd30 msgr2=0x7f679c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67b7e00640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b815cd30 0x7f679c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67b7e00640 1 -- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c003a30 msgr2=0x7f679c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67b7e00640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f679c003a30 0x7f679c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67b7e00640 1 -- 172.21.15.106:0/133754933 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c003530 con 0x7f679c004d50 2024-04-26T21:17:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67b7e00640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f679c004d50 0x7f679c0051d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f67b000aa70 tx=0x7f67b001fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9ed650d997c026 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b000a690 con 0x7f679c004d50 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b00ad070 con 0x7f679c004d50 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67b6000640 1 -- 172.21.15.106:0/133754933 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b00a99a0 con 0x7f679c004d50 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67bce00640 1 -- 172.21.15.106:0/133754933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f679c004d50 msgr2=0x7f679c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67bce00640 1 --2- 172.21.15.106:0/133754933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f679c004d50 0x7f679c0051d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f67b000aa70 tx=0x7f67b001fb20 comp rx=0 tx=0).stop 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67b7e00640 1 -- 172.21.15.106:0/133754933 reap_dead start 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67bce00640 1 -- 172.21.15.106:0/133754933 shutdown_connections 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67bce00640 1 -- 172.21.15.106:0/133754933 >> 172.21.15.106:0/133754933 conn(0x7f67b80d2a30 msgr2=0x7f67b80d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67bce00640 1 -- 172.21.15.106:0/133754933 shutdown_connections 2024-04-26T21:17:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.806+0000 7f67bce00640 1 -- 172.21.15.106:0/133754933 wait complete. 2024-04-26T21:17:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 Processor -- start 2024-04-26T21:17:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 -- start start 2024-04-26T21:17:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b81f2130 0x7f67b80c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b80cbee0 0x7f67b81f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b81f8530 0x7f67b81f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f67b8070330 con 0x7f67b81f2130 2024-04-26T21:17:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f67b80cff60 con 0x7f67b81f8530 2024-04-26T21:17:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f67b8071b40 con 0x7f67b80cbee0 2024-04-26T21:17:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b81f2130 0x7f67b80c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b81f2130 0x7f67b80c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50012/0 (socket says 172.21.15.106:50012) 2024-04-26T21:17:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7400640 1 -- 172.21.15.106:0/3149528449 learned_addr learned my addr 172.21.15.106:0/3149528449 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b6a00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b80cbee0 0x7f67b81f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7e00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b81f8530 0x7f67b81f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7400640 1 -- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b80cbee0 msgr2=0x7f67b81f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7400640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b80cbee0 0x7f67b81f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7400640 1 -- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b81f8530 msgr2=0x7f67b81f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7400640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b81f8530 0x7f67b81f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7400640 1 -- 172.21.15.106:0/3149528449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b815daa0 con 0x7f67b81f2130 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b6a00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b80cbee0 0x7f67b81f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7e00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b81f8530 0x7f67b81f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67b7400640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b81f2130 0x7f67b80c9b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f67a8011910 tx=0x7f67a8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67af400640 1 -- 172.21.15.106:0/3149528449 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a800faf0 con 0x7f67b81f2130 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67af400640 1 -- 172.21.15.106:0/3149528449 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a800fc90 con 0x7f67b81f2130 2024-04-26T21:17:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67af400640 1 -- 172.21.15.106:0/3149528449 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8004030 con 0x7f67b81f2130 2024-04-26T21:17:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b80b68d0 con 0x7f67b81f2130 2024-04-26T21:17:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.810+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b80cc760 con 0x7f67b81f2130 2024-04-26T21:17:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.814+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b80506d0 con 0x7f67b81f2130 2024-04-26T21:17:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.814+0000 7f67af400640 1 -- 172.21.15.106:0/3149528449 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f67a8012040 con 0x7f67b81f2130 2024-04-26T21:17:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.814+0000 7f67af400640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f67980683b0 0x7f679806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.814+0000 7f67af400640 1 -- 172.21.15.106:0/3149528449 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f67a80870f0 con 0x7f67b81f2130 2024-04-26T21:17:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.814+0000 7f67b6a00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f67980683b0 0x7f679806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.814+0000 7f67b6a00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f67980683b0 0x7f679806a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f67b81f7f50 tx=0x7f67a4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.818+0000 7f67af400640 1 -- 172.21.15.106:0/3149528449 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f67a8019070 con 0x7f67b81f2130 2024-04-26T21:17:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.974+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f67b81f8910 con 0x7f67b81f2130 2024-04-26T21:17:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.974+0000 7f67af400640 1 -- 172.21.15.106:0/3149528449 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f67a80572a0 con 0x7f67b81f2130 2024-04-26T21:17:25.979 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f67980683b0 msgr2=0x7f679806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f67980683b0 0x7f679806a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f67b81f7f50 tx=0x7f67a4008040 comp rx=0 tx=0).stop 2024-04-26T21:17:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b81f2130 msgr2=0x7f67b80c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b81f2130 0x7f67b80c9b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f67a8011910 tx=0x7f67a8011dd0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 shutdown_connections 2024-04-26T21:17:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67b81f8530 0x7f67b81f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f67980683b0 0x7f679806a870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f67b80cbee0 0x7f67b81f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 --2- 172.21.15.106:0/3149528449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b81f2130 0x7f67b80c9b00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 >> 172.21.15.106:0/3149528449 conn(0x7f67b80d2a30 msgr2=0x7f67b80b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 shutdown_connections 2024-04-26T21:17:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:25.978+0000 7f67bce00640 1 -- 172.21.15.106:0/3149528449 wait complete. 2024-04-26T21:17:26.001 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe30b800640 1 Processor -- start 2024-04-26T21:17:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe30b800640 1 -- start start 2024-04-26T21:17:26.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe30b800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3040cfb70 0x7fe3040d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe30b800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3040cdab0 con 0x7fe3040cee30 2024-04-26T21:17:26.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe30b800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3040cdd90 con 0x7fe304160440 2024-04-26T21:17:26.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe30b800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe3040ce070 con 0x7fe3040cfb70 2024-04-26T21:17:26.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe303e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3040cfb70 0x7fe3040d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe309800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe3040cee30 0x7fe3040b5aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59076/0 (socket says 172.21.15.106:59076) 2024-04-26T21:17:26.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe309800640 1 -- 172.21.15.106:0/3050999435 learned_addr learned my addr 172.21.15.106:0/3050999435 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:26.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe303e00640 1 -- 172.21.15.106:0/3050999435 >> v1:172.21.15.112:6789/0 conn(0x7fe304160440 legacy=0x7fe3040cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe303e00640 1 -- 172.21.15.106:0/3050999435 >> v1:172.21.15.106:6789/0 conn(0x7fe3040cee30 legacy=0x7fe3040b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.134+0000 7fe303e00640 1 -- 172.21.15.106:0/3050999435 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3040ce350 con 0x7fe3040cfb70 2024-04-26T21:17:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe303e00640 1 --2- 172.21.15.106:0/3050999435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 0x7fe3040d14d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00097c0 tx=0x7fe3040b69c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6957351213a4c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe303400640 1 -- 172.21.15.106:0/3050999435 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00a7070 con 0x7fe3040cfb70 2024-04-26T21:17:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe303400640 1 -- 172.21.15.106:0/3050999435 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f00b0070 con 0x7fe3040cfb70 2024-04-26T21:17:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe303400640 1 -- 172.21.15.106:0/3050999435 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00ab890 con 0x7fe3040cfb70 2024-04-26T21:17:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe30b800640 1 -- 172.21.15.106:0/3050999435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 msgr2=0x7fe3040d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe30b800640 1 --2- 172.21.15.106:0/3050999435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 0x7fe3040d14d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00097c0 tx=0x7fe3040b69c0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe30b800640 1 -- 172.21.15.106:0/3050999435 shutdown_connections 2024-04-26T21:17:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe30b800640 1 --2- 172.21.15.106:0/3050999435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 0x7fe3040d14d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe30b800640 1 -- 172.21.15.106:0/3050999435 >> 172.21.15.106:0/3050999435 conn(0x7fe3040d2c50 msgr2=0x7fe3040d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe30b800640 1 -- 172.21.15.106:0/3050999435 shutdown_connections 2024-04-26T21:17:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.138+0000 7fe30b800640 1 -- 172.21.15.106:0/3050999435 wait complete. 2024-04-26T21:17:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 Processor -- start 2024-04-26T21:17:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 -- start start 2024-04-26T21:17:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3040cee30 0x7fe3041f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 0x7fe304154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe304160440 0x7fe3040c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe30416aec0 con 0x7fe3040cfb70 2024-04-26T21:17:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe304160820 con 0x7fe3040cee30 2024-04-26T21:17:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe30416b040 con 0x7fe304160440 2024-04-26T21:17:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe303e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 0x7fe304154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe303e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 0x7fe304154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50026/0 (socket says 172.21.15.106:50026) 2024-04-26T21:17:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe303e00640 1 -- 172.21.15.106:0/3363834288 learned_addr learned my addr 172.21.15.106:0/3363834288 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe308e00640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3040cee30 0x7fe3041f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe309800640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe304160440 0x7fe3040c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe303e00640 1 -- 172.21.15.106:0/3363834288 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe304160440 msgr2=0x7fe3040c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe303e00640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe304160440 0x7fe3040c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe303e00640 1 -- 172.21.15.106:0/3363834288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3040cee30 msgr2=0x7fe3041f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe303e00640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3040cee30 0x7fe3041f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe303e00640 1 -- 172.21.15.106:0/3363834288 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30415b5b0 con 0x7fe3040cfb70 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe309800640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe304160440 0x7fe3040c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe303e00640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 0x7fe304154140 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00ad040 tx=0x7fe2f001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe300c00640 1 -- 172.21.15.106:0/3363834288 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00bf610 con 0x7fe3040cfb70 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe300c00640 1 -- 172.21.15.106:0/3363834288 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f00bf7b0 con 0x7fe3040cfb70 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe300c00640 1 -- 172.21.15.106:0/3363834288 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00bfba0 con 0x7fe3040cfb70 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3040c7e10 con 0x7fe3040cfb70 2024-04-26T21:17:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.142+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3040c83d0 con 0x7fe3040cfb70 2024-04-26T21:17:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.146+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe304069400 con 0x7fe3040cfb70 2024-04-26T21:17:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.146+0000 7fe300c00640 1 -- 172.21.15.106:0/3363834288 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe2f00bd020 con 0x7fe3040cfb70 2024-04-26T21:17:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.146+0000 7fe300c00640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2e4068380 0x7fe2e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.146+0000 7fe300c00640 1 -- 172.21.15.106:0/3363834288 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe2f0121360 con 0x7fe3040cfb70 2024-04-26T21:17:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.146+0000 7fe308e00640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2e4068380 0x7fe2e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.146+0000 7fe308e00640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2e4068380 0x7fe2e406a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80015b0 tx=0x7fe2f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.150+0000 7fe300c00640 1 -- 172.21.15.106:0/3363834288 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe2f00c6030 con 0x7fe3040cfb70 2024-04-26T21:17:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.306+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe304068e30 con 0x7fe3040cfb70 2024-04-26T21:17:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe300c00640 1 -- 172.21.15.106:0/3363834288 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fe2f0016090 con 0x7fe3040cfb70 2024-04-26T21:17:26.313 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2e4068380 msgr2=0x7fe2e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2e4068380 0x7fe2e406a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80015b0 tx=0x7fe2f8009040 comp rx=0 tx=0).stop 2024-04-26T21:17:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 msgr2=0x7fe304154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 0x7fe304154140 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00ad040 tx=0x7fe2f001acb0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 shutdown_connections 2024-04-26T21:17:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe2e4068380 0x7fe2e406a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe304160440 0x7fe3040c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3040cfb70 0x7fe304154140 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 --2- 172.21.15.106:0/3363834288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3040cee30 0x7fe3041f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 >> 172.21.15.106:0/3363834288 conn(0x7fe3040d2c50 msgr2=0x7fe304074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 shutdown_connections 2024-04-26T21:17:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.310+0000 7fe30b800640 1 -- 172.21.15.106:0/3363834288 wait complete. 2024-04-26T21:17:26.334 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:26.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.466+0000 7f1ceec00640 1 Processor -- start 2024-04-26T21:17:26.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.466+0000 7f1ceec00640 1 -- start start 2024-04-26T21:17:26.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ceec00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce80afec0 0x7f1ce806dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ceec00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce806e210 con 0x7f1ce815a640 2024-04-26T21:17:26.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ceec00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce806e4f0 con 0x7f1ce815dc50 2024-04-26T21:17:26.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ceec00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce80b3870 con 0x7f1ce80afec0 2024-04-26T21:17:26.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ced800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1ce815a640 0x7f1ce80af7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59084/0 (socket says 172.21.15.106:59084) 2024-04-26T21:17:26.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ced800640 1 -- 172.21.15.106:0/515163395 learned_addr learned my addr 172.21.15.106:0/515163395 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:26.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1cece00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce80afec0 0x7f1ce806dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435420821 0 0) 0x7f1ce806e210 con 0x7f1ce815a640 2024-04-26T21:17:26.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cd0003530 con 0x7f1ce815a640 2024-04-26T21:17:26.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 152195933 0 0) 0x7f1cd0003530 con 0x7f1ce815a640 2024-04-26T21:17:26.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce80afec0 msgr2=0x7f1ce806dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:26.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce80afec0 0x7f1ce806dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 >> v1:172.21.15.112:6789/0 conn(0x7f1ce815dc50 legacy=0x7f1ce80b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:26.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce806e7d0 con 0x7f1ce815a640 2024-04-26T21:17:26.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f1cdc001a00 con 0x7f1ce815a640 2024-04-26T21:17:26.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 >> v1:172.21.15.106:6789/0 conn(0x7f1ce815a640 legacy=0x7f1ce80af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce80afec0 0x7f1cd0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd0003fe0 0x7f1cd0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cd0004d50 0x7f1cd00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce80b3870 con 0x7f1cd0003fe0 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd000bb30 con 0x7f1cd0004d50 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd000bd30 con 0x7f1ce80afec0 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1cece00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd0003fe0 0x7f1cd0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1ced800640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce80afec0 0x7f1cd0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1cee200640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cd0004d50 0x7f1cd00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1cece00640 1 -- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce80afec0 msgr2=0x7f1cd0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1cece00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce80afec0 0x7f1cd0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1cece00640 1 -- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cd0004d50 msgr2=0x7f1cd00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1cece00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cd0004d50 0x7f1cd00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.470+0000 7f1cece00640 1 -- 172.21.15.106:0/515163395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd0003530 con 0x7f1cd0003fe0 2024-04-26T21:17:26.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1cece00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd0003fe0 0x7f1cd0004810 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009ae0 tx=0x7f1cd401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff306de98c78fab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:26.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40b2070 con 0x7f1cd0003fe0 2024-04-26T21:17:26.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd40a55a0 con 0x7f1cd0003fe0 2024-04-26T21:17:26.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ce7e00640 1 -- 172.21.15.106:0/515163395 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40096b0 con 0x7f1cd0003fe0 2024-04-26T21:17:26.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ceec00640 1 -- 172.21.15.106:0/515163395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd0003fe0 msgr2=0x7f1cd0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ceec00640 1 --2- 172.21.15.106:0/515163395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd0003fe0 0x7f1cd0004810 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009ae0 tx=0x7f1cd401c9b0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1cee200640 1 -- 172.21.15.106:0/515163395 reap_dead start 2024-04-26T21:17:26.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ceec00640 1 -- 172.21.15.106:0/515163395 shutdown_connections 2024-04-26T21:17:26.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ceec00640 1 -- 172.21.15.106:0/515163395 >> 172.21.15.106:0/515163395 conn(0x7f1ce8068140 msgr2=0x7f1ce8068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:26.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ceec00640 1 -- 172.21.15.106:0/515163395 shutdown_connections 2024-04-26T21:17:26.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ceec00640 1 -- 172.21.15.106:0/515163395 wait complete. 2024-04-26T21:17:26.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ceec00640 1 Processor -- start 2024-04-26T21:17:26.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.474+0000 7f1ceec00640 1 -- start start 2024-04-26T21:17:26.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ceec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cd0003fe0 0x7f1ce8073630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ceec00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce815aa20 0x7f1ce815aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ceec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ce81ea550 0x7f1ce81ea9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ceec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce815e390 con 0x7f1ce81ea550 2024-04-26T21:17:26.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ceec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce815e0a0 con 0x7f1cd0003fe0 2024-04-26T21:17:26.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ceec00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce815e510 con 0x7f1ce815aa20 2024-04-26T21:17:26.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cee200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ce81ea550 0x7f1ce81ea9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cee200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ce81ea550 0x7f1ce81ea9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50040/0 (socket says 172.21.15.106:50040) 2024-04-26T21:17:26.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cee200640 1 -- 172.21.15.106:0/1134795297 learned_addr learned my addr 172.21.15.106:0/1134795297 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:26.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cece00640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce815aa20 0x7f1ce815aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ced800640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cd0003fe0 0x7f1ce8073630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cee200640 1 -- 172.21.15.106:0/1134795297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce815aa20 msgr2=0x7f1ce815aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cee200640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce815aa20 0x7f1ce815aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cee200640 1 -- 172.21.15.106:0/1134795297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cd0003fe0 msgr2=0x7f1ce8073630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cee200640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cd0003fe0 0x7f1ce8073630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cee200640 1 -- 172.21.15.106:0/1134795297 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce815d2a0 con 0x7f1ce81ea550 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1cee200640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ce81ea550 0x7f1ce81ea9d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0007fd0 tx=0x7f1ce000f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ce5600640 1 -- 172.21.15.106:0/1134795297 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0003a80 con 0x7f1ce81ea550 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ce5600640 1 -- 172.21.15.106:0/1134795297 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce0018070 con 0x7f1ce81ea550 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce815b4e0 con 0x7f1ce81ea550 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ce5600640 1 -- 172.21.15.106:0/1134795297 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0004030 con 0x7f1ce81ea550 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce815baa0 con 0x7f1ce81ea550 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.478+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce80506d0 con 0x7f1ce81ea550 2024-04-26T21:17:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.482+0000 7f1ce5600640 1 -- 172.21.15.106:0/1134795297 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ce00041d0 con 0x7f1ce81ea550 2024-04-26T21:17:26.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.482+0000 7f1ce5600640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1cc8068380 0x7f1cc806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.482+0000 7f1ce5600640 1 -- 172.21.15.106:0/1134795297 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f1ce00867a0 con 0x7f1ce81ea550 2024-04-26T21:17:26.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.482+0000 7f1ced800640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1cc8068380 0x7f1cc806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.482+0000 7f1ced800640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1cc8068380 0x7f1cc806a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc000f90 tx=0x7f1cdc00a060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:26.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.486+0000 7f1ce5600640 1 -- 172.21.15.106:0/1134795297 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1ce00568c0 con 0x7f1ce81ea550 2024-04-26T21:17:26.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.642+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1ce80b5d40 con 0x7f1ce81ea550 2024-04-26T21:17:26.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.642+0000 7f1ce5600640 1 -- 172.21.15.106:0/1134795297 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f1ce00561c0 con 0x7f1ce81ea550 2024-04-26T21:17:26.647 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1cc8068380 msgr2=0x7f1cc806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1cc8068380 0x7f1cc806a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc000f90 tx=0x7f1cdc00a060 comp rx=0 tx=0).stop 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ce81ea550 msgr2=0x7f1ce81ea9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ce81ea550 0x7f1ce81ea9d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0007fd0 tx=0x7f1ce000f910 comp rx=0 tx=0).stop 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 shutdown_connections 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1cc8068380 0x7f1cc806a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ce81ea550 0x7f1ce81ea9d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ce815aa20 0x7f1ce815aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 --2- 172.21.15.106:0/1134795297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1cd0003fe0 0x7f1ce8073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 >> 172.21.15.106:0/1134795297 conn(0x7f1ce8068140 msgr2=0x7f1ce80af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 shutdown_connections 2024-04-26T21:17:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.646+0000 7f1ceec00640 1 -- 172.21.15.106:0/1134795297 wait complete. 2024-04-26T21:17:26.667 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:17:26.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f2765e00640 1 Processor -- start 2024-04-26T21:17:26.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f2765e00640 1 -- start start 2024-04-26T21:17:26.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f2765e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f276013f140 0x7f276015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f2765e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27600b3d10 con 0x7f276006eb70 2024-04-26T21:17:26.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f2765e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27600b3ff0 con 0x7f276013ed60 2024-04-26T21:17:26.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f2765e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f27600b3ac0 con 0x7f276013f140 2024-04-26T21:17:26.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f276006eb70 0x7f27600d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59098/0 (socket says 172.21.15.106:59098) 2024-04-26T21:17:26.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275f400640 1 -- 172.21.15.106:0/936974272 learned_addr learned my addr 172.21.15.106:0/936974272 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:26.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275e000640 1 --2- 172.21.15.106:0/936974272 >> v2:172.21.15.112:3300/0 conn(0x7f276013f140 0x7f276015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2879832899 0 0) 0x7f27600b3d10 con 0x7f276006eb70 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2744003530 con 0x7f276006eb70 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3375042693 0 0) 0x7f2744003530 con 0x7f276006eb70 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 >> v2:172.21.15.112:3300/0 conn(0x7f276013f140 msgr2=0x7f276015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275d600640 1 --2- 172.21.15.106:0/936974272 >> v2:172.21.15.112:3300/0 conn(0x7f276013f140 0x7f276015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 >> v1:172.21.15.112:6789/0 conn(0x7f276013ed60 legacy=0x7f27600b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27600b42d0 con 0x7f276006eb70 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f2758001680 con 0x7f276006eb70 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.802+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 >> v1:172.21.15.106:6789/0 conn(0x7f276006eb70 legacy=0x7f27600d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275d600640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440039c0 0x7f2744003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275d600640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2744004810 0x7f2744004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275d600640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27440052f0 0x7f274400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f27600b3ac0 con 0x7f27440052f0 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f274400c1c0 con 0x7f2744004810 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f274400c3c0 con 0x7f27440039c0 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275f400640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27440052f0 0x7f274400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275e000640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2744004810 0x7f2744004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275ea00640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440039c0 0x7f2744003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275f400640 1 -- 172.21.15.106:0/936974272 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440039c0 msgr2=0x7f2744003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275f400640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440039c0 0x7f2744003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275f400640 1 -- 172.21.15.106:0/936974272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2744004810 msgr2=0x7f2744004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275f400640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2744004810 0x7f2744004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275f400640 1 -- 172.21.15.106:0/936974272 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2744003530 con 0x7f27440052f0 2024-04-26T21:17:26.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275ea00640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440039c0 0x7f2744003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:26.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275f400640 1 -- 172.21.15.106:0/936974272 reap_dead start 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275f400640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27440052f0 0x7f274400b9d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f275800c190 tx=0x7f275801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcef397c0794e76d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758007d00 con 0x7f27440052f0 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27580a9070 con 0x7f27440052f0 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.806+0000 7f275d600640 1 -- 172.21.15.106:0/936974272 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758005d40 con 0x7f27440052f0 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 -- 172.21.15.106:0/936974272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27440052f0 msgr2=0x7f274400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27440052f0 0x7f274400b9d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f275800c190 tx=0x7f275801cc40 comp rx=0 tx=0).stop 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 -- 172.21.15.106:0/936974272 shutdown_connections 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 --2- 172.21.15.106:0/936974272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27440052f0 0x7f274400b9d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 -- 172.21.15.106:0/936974272 >> 172.21.15.106:0/936974272 conn(0x7f2760068340 msgr2=0x7f2760068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 -- 172.21.15.106:0/936974272 shutdown_connections 2024-04-26T21:17:26.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 -- 172.21.15.106:0/936974272 wait complete. 2024-04-26T21:17:26.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 Processor -- start 2024-04-26T21:17:26.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 -- start start 2024-04-26T21:17:26.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440052f0 0x7f27600b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f276015b5e0 0x7f276015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276015b090 0x7f276015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f276015c770 con 0x7f276015b5e0 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f276015c5f0 con 0x7f276015b090 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f2765e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2760160400 con 0x7f27440052f0 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f276015b5e0 0x7f276015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f276015b5e0 0x7f276015a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50050/0 (socket says 172.21.15.106:50050) 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275e000640 1 -- 172.21.15.106:0/2371986292 learned_addr learned my addr 172.21.15.106:0/2371986292 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275f400640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276015b090 0x7f276015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275ea00640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440052f0 0x7f27600b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275e000640 1 -- 172.21.15.106:0/2371986292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440052f0 msgr2=0x7f27600b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275e000640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440052f0 0x7f27600b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275e000640 1 -- 172.21.15.106:0/2371986292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276015b090 msgr2=0x7f276015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275e000640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276015b090 0x7f276015a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275e000640 1 -- 172.21.15.106:0/2371986292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276013e5e0 con 0x7f276015b5e0 2024-04-26T21:17:26.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.810+0000 7f275e000640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f276015b5e0 0x7f276015a450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f274c011990 tx=0x7f274c011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:26.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f2757400640 1 -- 172.21.15.106:0/2371986292 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c00fa30 con 0x7f276015b5e0 2024-04-26T21:17:26.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f2757400640 1 -- 172.21.15.106:0/2371986292 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c00fbd0 con 0x7f276015b5e0 2024-04-26T21:17:26.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2760144f90 con 0x7f276015b5e0 2024-04-26T21:17:26.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f2757400640 1 -- 172.21.15.106:0/2371986292 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c014440 con 0x7f276015b5e0 2024-04-26T21:17:26.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276013f780 con 0x7f276015b5e0 2024-04-26T21:17:26.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2760069400 con 0x7f276015b5e0 2024-04-26T21:17:26.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f2757400640 1 -- 172.21.15.106:0/2371986292 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f274c012040 con 0x7f276015b5e0 2024-04-26T21:17:26.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f2757400640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2740068380 0x7f274006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:26.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f2757400640 1 -- 172.21.15.106:0/2371986292 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f274c0873b0 con 0x7f276015b5e0 2024-04-26T21:17:26.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.814+0000 7f275ea00640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2740068380 0x7f274006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:26.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.818+0000 7f275ea00640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2740068380 0x7f274006a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2750000f90 tx=0x7f2750009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:26.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.818+0000 7f2757400640 1 -- 172.21.15.106:0/2371986292 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f274c019030 con 0x7f276015b5e0 2024-04-26T21:17:26.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.986+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f27600b0130 con 0x7f276015b5e0 2024-04-26T21:17:26.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.986+0000 7f2757400640 1 -- 172.21.15.106:0/2371986292 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f274c057440 con 0x7f276015b5e0 2024-04-26T21:17:26.992 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2024-04-26T21:17:26.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2740068380 msgr2=0x7f274006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2740068380 0x7f274006a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2750000f90 tx=0x7f2750009040 comp rx=0 tx=0).stop 2024-04-26T21:17:26.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f276015b5e0 msgr2=0x7f276015a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:26.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f276015b5e0 0x7f276015a450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f274c011990 tx=0x7f274c011d90 comp rx=0 tx=0).stop 2024-04-26T21:17:26.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 shutdown_connections 2024-04-26T21:17:26.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276015b090 0x7f276015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2740068380 0x7f274006a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f276015b5e0 0x7f276015a450 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 --2- 172.21.15.106:0/2371986292 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f27440052f0 0x7f27600b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:26.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 >> 172.21.15.106:0/2371986292 conn(0x7f2760068340 msgr2=0x7f27600ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:26.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 shutdown_connections 2024-04-26T21:17:26.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:26.990+0000 7f2765e00640 1 -- 172.21.15.106:0/2371986292 wait complete. 2024-04-26T21:17:27.014 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-04-26T21:17:27.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:27.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-26T21:17:27.037 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:17:27.037 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:17:27.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:27.037 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-26T21:17:27.091 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T21:17:27.091 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:17:27.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.222+0000 7f9912c00640 1 Processor -- start 2024-04-26T21:17:27.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.222+0000 7f9912c00640 1 -- start start 2024-04-26T21:17:27.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.222+0000 7f9912c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c148a90 0x7f990c0724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.222+0000 7f9912c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f990c0af640 0x7f990c0afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.222+0000 7f9912c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990c072b00 con 0x7f990c070120 2024-04-26T21:17:27.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.222+0000 7f9912c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f990c0af1b0 con 0x7f990c0af640 2024-04-26T21:17:27.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.222+0000 7f9912c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f990c148e70 con 0x7f990c148a90 2024-04-26T21:17:27.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f990be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c148a90 0x7f990c0724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f9910c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f990c0af640 0x7f990c0afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f990be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c148a90 0x7f990c0724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:40150/0 (socket says 172.21.15.106:40150) 2024-04-26T21:17:27.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f9910c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f990c0af640 0x7f990c0afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:54214/0 (socket says 172.21.15.106:54214) 2024-04-26T21:17:27.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f990be00640 1 -- 172.21.15.106:0/3974078383 learned_addr learned my addr 172.21.15.106:0/3974078383 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:27.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f990b400640 1 --1- 172.21.15.106:0/3974078383 >> v1:172.21.15.112:6789/0 conn(0x7f990c070120 0x7f990c0b3ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:34146/0 (socket says 172.21.15.106:34146) 2024-04-26T21:17:27.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f990be00640 1 -- 172.21.15.106:0/3974078383 >> v2:172.21.15.112:3300/0 conn(0x7f990c0af640 msgr2=0x7f990c0afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:27.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f990be00640 1 --2- 172.21.15.106:0/3974078383 >> v2:172.21.15.112:3300/0 conn(0x7f990c0af640 0x7f990c0afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f990be00640 1 -- 172.21.15.106:0/3974078383 >> v1:172.21.15.112:6789/0 conn(0x7f990c070120 legacy=0x7f990c0b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f990be00640 1 -- 172.21.15.106:0/3974078383 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c072de0 con 0x7f990c148a90 2024-04-26T21:17:27.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f9910c00640 1 --2- 172.21.15.106:0/3974078383 >> v2:172.21.15.112:3300/0 conn(0x7f990c0af640 0x7f990c0afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:27.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.226+0000 7f990be00640 1 --2- 172.21.15.106:0/3974078383 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c148a90 0x7f990c0724d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009870 tx=0x7f98fc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1e0c886d19d566 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:27.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f990aa00640 1 -- 172.21.15.106:0/3974078383 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0aa620 con 0x7f990c148a90 2024-04-26T21:17:27.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f990aa00640 1 -- 172.21.15.106:0/3974078383 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc0af070 con 0x7f990c148a90 2024-04-26T21:17:27.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f990aa00640 1 -- 172.21.15.106:0/3974078383 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0aa9e0 con 0x7f990c148a90 2024-04-26T21:17:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 -- 172.21.15.106:0/3974078383 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c148a90 msgr2=0x7f990c0724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 --2- 172.21.15.106:0/3974078383 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c148a90 0x7f990c0724d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009870 tx=0x7f98fc01c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 -- 172.21.15.106:0/3974078383 shutdown_connections 2024-04-26T21:17:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 --2- 172.21.15.106:0/3974078383 >> v2:172.21.15.112:3300/0 conn(0x7f990c0af640 0x7f990c0afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 --2- 172.21.15.106:0/3974078383 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c148a90 0x7f990c0724d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 -- 172.21.15.106:0/3974078383 >> 172.21.15.106:0/3974078383 conn(0x7f990c06e440 msgr2=0x7f990c06e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 -- 172.21.15.106:0/3974078383 shutdown_connections 2024-04-26T21:17:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 -- 172.21.15.106:0/3974078383 wait complete. 2024-04-26T21:17:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 Processor -- start 2024-04-26T21:17:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 -- start start 2024-04-26T21:17:27.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c070120 0x7f990c160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f990c0af640 0x7f990c157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c148a90 0x7f990c13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f990c0b45f0 con 0x7f990c0af640 2024-04-26T21:17:27.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f990c16bfa0 con 0x7f990c148a90 2024-04-26T21:17:27.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f9912c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f990c15e900 con 0x7f990c070120 2024-04-26T21:17:27.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f990b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f990c0af640 0x7f990c157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f990b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f990c0af640 0x7f990c157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55644/0 (socket says 172.21.15.106:55644) 2024-04-26T21:17:27.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f990b400640 1 -- 172.21.15.106:0/4182799496 learned_addr learned my addr 172.21.15.106:0/4182799496 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:27.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.230+0000 7f990b400640 1 -- 172.21.15.106:0/4182799496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c070120 msgr2=0x7f990c160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f990b400640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c070120 0x7f990c160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f990b400640 1 -- 172.21.15.106:0/4182799496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c148a90 msgr2=0x7f990c13e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f990b400640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c148a90 0x7f990c13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f990b400640 1 -- 172.21.15.106:0/4182799496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c13d370 con 0x7f990c0af640 2024-04-26T21:17:27.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f990b400640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f990c0af640 0x7f990c157430 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c450 tx=0x7f98f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:27.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f9903e00640 1 -- 172.21.15.106:0/4182799496 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f80074e0 con 0x7f990c0af640 2024-04-26T21:17:27.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f9903e00640 1 -- 172.21.15.106:0/4182799496 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f8007680 con 0x7f990c0af640 2024-04-26T21:17:27.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f9903e00640 1 -- 172.21.15.106:0/4182799496 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8004a30 con 0x7f990c0af640 2024-04-26T21:17:27.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990c13d650 con 0x7f990c0af640 2024-04-26T21:17:27.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990c13dc10 con 0x7f990c0af640 2024-04-26T21:17:27.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990c069400 con 0x7f990c0af640 2024-04-26T21:17:27.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f9903e00640 1 -- 172.21.15.106:0/4182799496 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98f801a020 con 0x7f990c0af640 2024-04-26T21:17:27.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f9903e00640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068380 0x7f98ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f9903e00640 1 -- 172.21.15.106:0/4182799496 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f98f8086650 con 0x7f990c0af640 2024-04-26T21:17:27.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.234+0000 7f990be00640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068380 0x7f98ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.238+0000 7f990be00640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068380 0x7f98ec06a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0ae000 tx=0x7f98fc004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.238+0000 7f9903e00640 1 -- 172.21.15.106:0/4182799496 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f98f8056770 con 0x7f990c0af640 2024-04-26T21:17:27.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f990c162140 con 0x7f990c0af640 2024-04-26T21:17:27.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9903e00640 1 -- 172.21.15.106:0/4182799496 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f98f8056070 con 0x7f990c0af640 2024-04-26T21:17:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:27.434 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:37.854892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:17:27.435 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 9 2024-04-26T21:17:27.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068380 msgr2=0x7f98ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068380 0x7f98ec06a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0ae000 tx=0x7f98fc004740 comp rx=0 tx=0).stop 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f990c0af640 msgr2=0x7f990c157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f990c0af640 0x7f990c157430 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c450 tx=0x7f98f800c910 comp rx=0 tx=0).stop 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 shutdown_connections 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c148a90 0x7f990c13e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f98ec068380 0x7f98ec06a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f990c0af640 0x7f990c157430 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 --2- 172.21.15.106:0/4182799496 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f990c070120 0x7f990c160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.430+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 >> 172.21.15.106:0/4182799496 conn(0x7f990c06e440 msgr2=0x7f990c145310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.434+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 shutdown_connections 2024-04-26T21:17:27.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.434+0000 7f9912c00640 1 -- 172.21.15.106:0/4182799496 wait complete. 2024-04-26T21:17:27.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63d3600640 1 Processor -- start 2024-04-26T21:17:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63d3600640 1 -- start start 2024-04-26T21:17:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63d3600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f63cc0cc310 0x7f63cc073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63d3600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63cc15c220 con 0x7f63cc072e30 2024-04-26T21:17:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63d3600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63cc073750 con 0x7f63cc0d0f00 2024-04-26T21:17:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63d3600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f63cc0d0a70 con 0x7f63cc0cc310 2024-04-26T21:17:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63d0c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f63cc072e30 0x7f63cc0cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41540/0 (socket says 172.21.15.106:41540) 2024-04-26T21:17:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63d0c00640 1 -- 172.21.15.106:0/3513588387 learned_addr learned my addr 172.21.15.106:0/3513588387 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63cbe00640 1 --2- 172.21.15.106:0/3513588387 >> v2:172.21.15.106:3300/0 conn(0x7f63cc0cc310 0x7f63cc073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63cb400640 1 -- 172.21.15.106:0/3513588387 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530281416 0 0) 0x7f63cc15c220 con 0x7f63cc072e30 2024-04-26T21:17:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63cb400640 1 -- 172.21.15.106:0/3513588387 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b0005740 con 0x7f63cc072e30 2024-04-26T21:17:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63cbe00640 1 -- 172.21.15.106:0/3513588387 >> v1:172.21.15.112:6789/0 conn(0x7f63cc0d0f00 legacy=0x7f63cc06f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63cbe00640 1 -- 172.21.15.106:0/3513588387 >> v1:172.21.15.106:6789/0 conn(0x7f63cc072e30 legacy=0x7f63cc0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.586+0000 7f63cbe00640 1 -- 172.21.15.106:0/3513588387 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc0cfe60 con 0x7f63cc0cc310 2024-04-26T21:17:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63cbe00640 1 --2- 172.21.15.106:0/3513588387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0cc310 0x7f63cc073210 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f63b80097c0 tx=0x7f63b801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793a13fd4306445f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63cb400640 1 -- 172.21.15.106:0/3513588387 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b80b0070 con 0x7f63cc0cc310 2024-04-26T21:17:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63cb400640 1 -- 172.21.15.106:0/3513588387 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b80ab600 con 0x7f63cc0cc310 2024-04-26T21:17:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63cb400640 1 -- 172.21.15.106:0/3513588387 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b80ab9d0 con 0x7f63cc0cc310 2024-04-26T21:17:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63d3600640 1 -- 172.21.15.106:0/3513588387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0cc310 msgr2=0x7f63cc073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63d3600640 1 --2- 172.21.15.106:0/3513588387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0cc310 0x7f63cc073210 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f63b80097c0 tx=0x7f63b801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63d3600640 1 -- 172.21.15.106:0/3513588387 shutdown_connections 2024-04-26T21:17:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63d3600640 1 --2- 172.21.15.106:0/3513588387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0cc310 0x7f63cc073210 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63d3600640 1 -- 172.21.15.106:0/3513588387 >> 172.21.15.106:0/3513588387 conn(0x7f63cc0d1ab0 msgr2=0x7f63cc0d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63d3600640 1 -- 172.21.15.106:0/3513588387 shutdown_connections 2024-04-26T21:17:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.590+0000 7f63d3600640 1 -- 172.21.15.106:0/3513588387 wait complete. 2024-04-26T21:17:27.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 Processor -- start 2024-04-26T21:17:27.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 -- start start 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63cc072e30 0x7f63cc15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63cc0cc310 0x7f63cc155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0d0f00 0x7f63cc15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc0d1310 con 0x7f63cc0d0f00 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc06fd30 con 0x7f63cc072e30 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f63cc0d1490 con 0x7f63cc0cc310 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d1600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0d0f00 0x7f63cc15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d1600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0d0f00 0x7f63cc15ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55664/0 (socket says 172.21.15.106:55664) 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d1600640 1 -- 172.21.15.106:0/3573002360 learned_addr learned my addr 172.21.15.106:0/3573002360 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d0c00640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63cc072e30 0x7f63cc15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63cbe00640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63cc0cc310 0x7f63cc155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d1600640 1 -- 172.21.15.106:0/3573002360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63cc0cc310 msgr2=0x7f63cc155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d1600640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63cc0cc310 0x7f63cc155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d1600640 1 -- 172.21.15.106:0/3573002360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63cc072e30 msgr2=0x7f63cc15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d1600640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63cc072e30 0x7f63cc15e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d1600640 1 -- 172.21.15.106:0/3573002360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc0b6de0 con 0x7f63cc0d0f00 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d0c00640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63cc072e30 0x7f63cc15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d1600640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0d0f00 0x7f63cc15ba20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c760 tx=0x7f63c400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63c8c00640 1 -- 172.21.15.106:0/3573002360 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4003b80 con 0x7f63cc0d0f00 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63c8c00640 1 -- 172.21.15.106:0/3573002360 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c4003d20 con 0x7f63cc0d0f00 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc0b70c0 con 0x7f63cc0d0f00 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63c8c00640 1 -- 172.21.15.106:0/3573002360 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c400aa30 con 0x7f63cc0d0f00 2024-04-26T21:17:27.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.594+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc0c9630 con 0x7f63cc0d0f00 2024-04-26T21:17:27.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.598+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc069400 con 0x7f63cc0d0f00 2024-04-26T21:17:27.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.598+0000 7f63c8c00640 1 -- 172.21.15.106:0/3573002360 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63c400abd0 con 0x7f63cc0d0f00 2024-04-26T21:17:27.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.598+0000 7f63c8c00640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f63ac068380 0x7f63ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.598+0000 7f63c8c00640 1 -- 172.21.15.106:0/3573002360 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f63c4086cd0 con 0x7f63cc0d0f00 2024-04-26T21:17:27.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.598+0000 7f63d0c00640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f63ac068380 0x7f63ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.598+0000 7f63d0c00640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f63ac068380 0x7f63ac06a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0011f0 tx=0x7f63bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:27.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.602+0000 7f63c8c00640 1 -- 172.21.15.106:0/3573002360 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f63c4056df0 con 0x7f63cc0d0f00 2024-04-26T21:17:27.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.762+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63cc0a2fa0 con 0x7f63cc0d0f00 2024-04-26T21:17:27.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63c8c00640 1 -- 172.21.15.106:0/3573002360 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7f63c40566f0 con 0x7f63cc0d0f00 2024-04-26T21:17:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:27.769 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:27.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f63ac068380 msgr2=0x7f63ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f63ac068380 0x7f63ac06a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0011f0 tx=0x7f63bc009040 comp rx=0 tx=0).stop 2024-04-26T21:17:27.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0d0f00 msgr2=0x7f63cc15ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0d0f00 0x7f63cc15ba20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c760 tx=0x7f63c400cc20 comp rx=0 tx=0).stop 2024-04-26T21:17:27.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 shutdown_connections 2024-04-26T21:17:27.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f63ac068380 0x7f63ac06a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63cc0d0f00 0x7f63cc15ba20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f63cc0cc310 0x7f63cc155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 --2- 172.21.15.106:0/3573002360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63cc072e30 0x7f63cc15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 >> 172.21.15.106:0/3573002360 conn(0x7f63cc0d1ab0 msgr2=0x7f63cc15e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:27.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 shutdown_connections 2024-04-26T21:17:27.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.766+0000 7f63d3600640 1 -- 172.21.15.106:0/3573002360 wait complete. 2024-04-26T21:17:27.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:16:18.259956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:16:18.727152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T21:16:22.419818+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T21:17:27.792 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:27.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedfc00640 1 Processor -- start 2024-04-26T21:17:27.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedfc00640 1 -- start start 2024-04-26T21:17:27.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedfc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efed815d530 0x7efed80cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedfc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efed80b5260 0x7efed80d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedfc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed80b44a0 con 0x7efed815d910 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedfc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7efed80b4780 con 0x7efed815d530 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedfc00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efed80b4a60 con 0x7efed80b5260 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedd200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efed815d530 0x7efed80cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedd200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efed815d530 0x7efed80cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55668/0 (socket says 172.21.15.106:55668) 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.926+0000 7efedd200640 1 -- 172.21.15.106:0/1231036265 learned_addr learned my addr 172.21.15.106:0/1231036265 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efed7e00640 1 --2- 172.21.15.106:0/1231036265 >> v2:172.21.15.112:3300/0 conn(0x7efed80b5260 0x7efed80d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efedd200640 1 -- 172.21.15.106:0/1231036265 >> v2:172.21.15.112:3300/0 conn(0x7efed80b5260 msgr2=0x7efed80d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efedd200640 1 --2- 172.21.15.106:0/1231036265 >> v2:172.21.15.112:3300/0 conn(0x7efed80b5260 0x7efed80d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efedd200640 1 -- 172.21.15.106:0/1231036265 >> v1:172.21.15.112:6789/0 conn(0x7efed815d910 legacy=0x7efed815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:27.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efedd200640 1 -- 172.21.15.106:0/1231036265 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed80b4d40 con 0x7efed815d530 2024-04-26T21:17:27.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efedd200640 1 --2- 172.21.15.106:0/1231036265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d530 0x7efed80cfe20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efed80b0820 tx=0x7efec001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beace346164996a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:27.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efed7400640 1 -- 172.21.15.106:0/1231036265 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec00ab660 con 0x7efed815d530 2024-04-26T21:17:27.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efed7400640 1 -- 172.21.15.106:0/1231036265 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec00b0070 con 0x7efed815d530 2024-04-26T21:17:27.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efed7400640 1 -- 172.21.15.106:0/1231036265 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec00aba20 con 0x7efed815d530 2024-04-26T21:17:27.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efedfc00640 1 -- 172.21.15.106:0/1231036265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d530 msgr2=0x7efed80cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efedfc00640 1 --2- 172.21.15.106:0/1231036265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d530 0x7efed80cfe20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efed80b0820 tx=0x7efec001c4e0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efedfc00640 1 -- 172.21.15.106:0/1231036265 shutdown_connections 2024-04-26T21:17:27.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.930+0000 7efedfc00640 1 --2- 172.21.15.106:0/1231036265 >> v2:172.21.15.112:3300/0 conn(0x7efed80b5260 0x7efed80d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 --2- 172.21.15.106:0/1231036265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d530 0x7efed80cfe20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 -- 172.21.15.106:0/1231036265 >> 172.21.15.106:0/1231036265 conn(0x7efed80b2910 msgr2=0x7efed80b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:27.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 -- 172.21.15.106:0/1231036265 shutdown_connections 2024-04-26T21:17:27.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 -- 172.21.15.106:0/1231036265 wait complete. 2024-04-26T21:17:27.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 Processor -- start 2024-04-26T21:17:27.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 -- start start 2024-04-26T21:17:27.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed80b5260 0x7efed813b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efed815d530 0x7efed8144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d910 0x7efed81451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efed8169690 con 0x7efed815d910 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efed8169510 con 0x7efed80b5260 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efed8169810 con 0x7efed815d530 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efeddc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d910 0x7efed81451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efeddc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d910 0x7efed81451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55676/0 (socket says 172.21.15.106:55676) 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efeddc00640 1 -- 172.21.15.106:0/3716376563 learned_addr learned my addr 172.21.15.106:0/3716376563 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedd200640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed80b5260 0x7efed813b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efed7e00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efed815d530 0x7efed8144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efeddc00640 1 -- 172.21.15.106:0/3716376563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efed815d530 msgr2=0x7efed8144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efeddc00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efed815d530 0x7efed8144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efeddc00640 1 -- 172.21.15.106:0/3716376563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed80b5260 msgr2=0x7efed813b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efeddc00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed80b5260 0x7efed813b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efeddc00640 1 -- 172.21.15.106:0/3716376563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed8160b70 con 0x7efed815d910 2024-04-26T21:17:27.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efeddc00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d910 0x7efed81451a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efed000b970 tx=0x7efed000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:27.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efed4c00640 1 -- 172.21.15.106:0/3716376563 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0019070 con 0x7efed815d910 2024-04-26T21:17:27.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efed4c00640 1 -- 172.21.15.106:0/3716376563 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed000cb40 con 0x7efed815d910 2024-04-26T21:17:27.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed8160e50 con 0x7efed815d910 2024-04-26T21:17:27.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.934+0000 7efed4c00640 1 -- 172.21.15.106:0/3716376563 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0014440 con 0x7efed815d910 2024-04-26T21:17:27.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.938+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed8161410 con 0x7efed815d910 2024-04-26T21:17:27.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.938+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed8069400 con 0x7efed815d910 2024-04-26T21:17:27.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.938+0000 7efed4c00640 1 -- 172.21.15.106:0/3716376563 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efed001c070 con 0x7efed815d910 2024-04-26T21:17:27.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.938+0000 7efed4c00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efeb40683b0 0x7efeb406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:27.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.938+0000 7efed4c00640 1 -- 172.21.15.106:0/3716376563 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7efed0086940 con 0x7efed815d910 2024-04-26T21:17:27.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.938+0000 7efedd200640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efeb40683b0 0x7efeb406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:27.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.938+0000 7efedd200640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efeb40683b0 0x7efeb406a870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efec00af000 tx=0x7efec00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:27.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:27.942+0000 7efed4c00640 1 -- 172.21.15.106:0/3716376563 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efed00564a0 con 0x7efed815d910 2024-04-26T21:17:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efed80ce950 con 0x7efed815d910 2024-04-26T21:17:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efed4c00640 1 -- 172.21.15.106:0/3716376563 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7efed005a7a0 con 0x7efed815d910 2024-04-26T21:17:28.102 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efeb40683b0 msgr2=0x7efeb406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efeb40683b0 0x7efeb406a870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efec00af000 tx=0x7efec00a7000 comp rx=0 tx=0).stop 2024-04-26T21:17:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d910 msgr2=0x7efed81451a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d910 0x7efed81451a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efed000b970 tx=0x7efed000be30 comp rx=0 tx=0).stop 2024-04-26T21:17:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 shutdown_connections 2024-04-26T21:17:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efeb40683b0 0x7efeb406a870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efed815d910 0x7efed81451a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efed815d530 0x7efed8144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 --2- 172.21.15.106:0/3716376563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed80b5260 0x7efed813b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.098+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 >> 172.21.15.106:0/3716376563 conn(0x7efed80b2910 msgr2=0x7efed815faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.102+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 shutdown_connections 2024-04-26T21:17:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.102+0000 7efedfc00640 1 -- 172.21.15.106:0/3716376563 wait complete. 2024-04-26T21:17:28.122 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:17:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6d6800640 1 Processor -- start 2024-04-26T21:17:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6d6800640 1 -- start start 2024-04-26T21:17:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6d6800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 0x7fc6d015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6d6800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc6d015da80 0x7fc6d015df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6d6800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d015ce00 con 0x7fc6d015d080 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6d6800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc6d015d5f0 con 0x7fc6d015da80 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6d6800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d00b4f00 con 0x7fc6d015c4e0 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6cfe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc6d015da80 0x7fc6d015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6cfe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc6d015da80 0x7fc6d015df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55680/0 (socket says 172.21.15.106:55680) 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6cfe00640 1 -- 172.21.15.106:0/1430097229 learned_addr learned my addr 172.21.15.106:0/1430097229 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6cfe00640 1 -- 172.21.15.106:0/1430097229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 msgr2=0x7fc6d015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6cf400640 1 --2- 172.21.15.106:0/1430097229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 0x7fc6d015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6cfe00640 1 --2- 172.21.15.106:0/1430097229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 0x7fc6d015c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6cfe00640 1 -- 172.21.15.106:0/1430097229 >> v1:172.21.15.112:6789/0 conn(0x7fc6d015d080 legacy=0x7fc6d00b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.258+0000 7fc6cfe00640 1 -- 172.21.15.106:0/1430097229 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d00b51e0 con 0x7fc6d015da80 2024-04-26T21:17:28.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6cfe00640 1 --2- 172.21.15.106:0/1430097229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015da80 0x7fc6d015df10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009e50 tx=0x7fc6c801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3feca18c913a9fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:28.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6ce000640 1 -- 172.21.15.106:0/1430097229 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80a5760 con 0x7fc6d015da80 2024-04-26T21:17:28.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6ce000640 1 -- 172.21.15.106:0/1430097229 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c80a5900 con 0x7fc6d015da80 2024-04-26T21:17:28.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6ce000640 1 -- 172.21.15.106:0/1430097229 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80a5cd0 con 0x7fc6d015da80 2024-04-26T21:17:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6d6800640 1 -- 172.21.15.106:0/1430097229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015da80 msgr2=0x7fc6d015df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6d6800640 1 --2- 172.21.15.106:0/1430097229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015da80 0x7fc6d015df10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009e50 tx=0x7fc6c801c9f0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6d6800640 1 -- 172.21.15.106:0/1430097229 shutdown_connections 2024-04-26T21:17:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6d6800640 1 --2- 172.21.15.106:0/1430097229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015da80 0x7fc6d015df10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6d6800640 1 --2- 172.21.15.106:0/1430097229 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 0x7fc6d015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6d6800640 1 -- 172.21.15.106:0/1430097229 >> 172.21.15.106:0/1430097229 conn(0x7fc6d00b2910 msgr2=0x7fc6d00b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6d6800640 1 -- 172.21.15.106:0/1430097229 shutdown_connections 2024-04-26T21:17:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6d6800640 1 -- 172.21.15.106:0/1430097229 wait complete. 2024-04-26T21:17:28.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.262+0000 7fc6d6800640 1 Processor -- start 2024-04-26T21:17:28.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 -- start start 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 0x7fc6d00732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015d080 0x7fc6d015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6d015da80 0x7fc6d0071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d0168f40 con 0x7fc6d015d080 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d0168dc0 con 0x7fc6d015da80 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d01690c0 con 0x7fc6d015c4e0 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015d080 0x7fc6d015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015d080 0x7fc6d015b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55684/0 (socket says 172.21.15.106:55684) 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cea00640 1 -- 172.21.15.106:0/1954843003 learned_addr learned my addr 172.21.15.106:0/1954843003 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cfe00640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6d015da80 0x7fc6d0071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cf400640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 0x7fc6d00732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cea00640 1 -- 172.21.15.106:0/1954843003 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 msgr2=0x7fc6d00732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cea00640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 0x7fc6d00732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cea00640 1 -- 172.21.15.106:0/1954843003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6d015da80 msgr2=0x7fc6d0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cea00640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6d015da80 0x7fc6d0071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cea00640 1 -- 172.21.15.106:0/1954843003 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d013d470 con 0x7fc6d015d080 2024-04-26T21:17:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6cea00640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015d080 0x7fc6d015b3d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c440 tx=0x7fc6bc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6c7400640 1 -- 172.21.15.106:0/1954843003 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc016020 con 0x7fc6d015d080 2024-04-26T21:17:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6c7400640 1 -- 172.21.15.106:0/1954843003 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6bc012830 con 0x7fc6d015d080 2024-04-26T21:17:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6c7400640 1 -- 172.21.15.106:0/1954843003 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc012c20 con 0x7fc6d015d080 2024-04-26T21:17:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d013d750 con 0x7fc6d015d080 2024-04-26T21:17:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d0072af0 con 0x7fc6d015d080 2024-04-26T21:17:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.266+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d0069400 con 0x7fc6d015d080 2024-04-26T21:17:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.270+0000 7fc6c7400640 1 -- 172.21.15.106:0/1954843003 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc6bc019020 con 0x7fc6d015d080 2024-04-26T21:17:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.270+0000 7fc6c7400640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc6b0068380 0x7fc6b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.270+0000 7fc6c7400640 1 -- 172.21.15.106:0/1954843003 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc6bc086c00 con 0x7fc6d015d080 2024-04-26T21:17:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.270+0000 7fc6cf400640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc6b0068380 0x7fc6b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.270+0000 7fc6cf400640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc6b0068380 0x7fc6b006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000aae0 tx=0x7fc6c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:28.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.274+0000 7fc6c7400640 1 -- 172.21.15.106:0/1954843003 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc6bc020020 con 0x7fc6d015d080 2024-04-26T21:17:28.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc6d006e2a0 con 0x7fc6d015d080 2024-04-26T21:17:28.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6c7400640 1 -- 172.21.15.106:0/1954843003 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fc6bc003810 con 0x7fc6d015d080 2024-04-26T21:17:28.433 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc6b0068380 msgr2=0x7fc6b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc6b0068380 0x7fc6b006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000aae0 tx=0x7fc6c0008040 comp rx=0 tx=0).stop 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015d080 msgr2=0x7fc6d015b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015d080 0x7fc6d015b3d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c440 tx=0x7fc6bc00c900 comp rx=0 tx=0).stop 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 shutdown_connections 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6d015da80 0x7fc6d0071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc6b0068380 0x7fc6b006a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6d015d080 0x7fc6d015b3d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 --2- 172.21.15.106:0/1954843003 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc6d015c4e0 0x7fc6d00732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 >> 172.21.15.106:0/1954843003 conn(0x7fc6d00b2910 msgr2=0x7fc6d013fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 shutdown_connections 2024-04-26T21:17:28.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.430+0000 7fc6d6800640 1 -- 172.21.15.106:0/1954843003 wait complete. 2024-04-26T21:17:28.456 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:17:28.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.590+0000 7f4a24a00640 1 Processor -- start 2024-04-26T21:17:28.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.590+0000 7f4a24a00640 1 -- start start 2024-04-26T21:17:28.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a24a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cfa80 0x7f4a200d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a24a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a200d1360 con 0x7f4a200b40e0 2024-04-26T21:17:28.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a24a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a200d1640 con 0x7f4a2006e720 2024-04-26T21:17:28.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a24a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4a200d1f70 con 0x7f4a200cfa80 2024-04-26T21:17:28.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1e800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4a200b40e0 0x7f4a200cf370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41542/0 (socket says 172.21.15.106:41542) 2024-04-26T21:17:28.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1e800640 1 -- 172.21.15.106:0/2219711291 learned_addr learned my addr 172.21.15.106:0/2219711291 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:28.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1de00640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cfa80 0x7f4a200d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651062046 0 0) 0x7f4a200d1360 con 0x7f4a200b40e0 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a04003530 con 0x7f4a200b40e0 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 845713225 0 0) 0x7f4a04003530 con 0x7f4a200b40e0 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cfa80 msgr2=0x7f4a200d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cfa80 0x7f4a200d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 >> v1:172.21.15.112:6789/0 conn(0x7f4a2006e720 legacy=0x7f4a2015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a200d1920 con 0x7f4a200b40e0 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f4a10001680 con 0x7f4a200b40e0 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 >> v1:172.21.15.106:6789/0 conn(0x7f4a200b40e0 legacy=0x7f4a200cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cfa80 0x7f4a04003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a04004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04004d50 0x7f4a040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4a200d1f70 con 0x7f4a04003fe0 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0400bb30 con 0x7f4a04004d50 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0400bd30 con 0x7f4a200cfa80 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1e800640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cfa80 0x7f4a04003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1de00640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a04004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1f200640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04004d50 0x7f4a040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1de00640 1 -- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cfa80 msgr2=0x7f4a04003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1de00640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cfa80 0x7f4a04003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1de00640 1 -- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04004d50 msgr2=0x7f4a040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1de00640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a04004d50 0x7f4a040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.594+0000 7f4a1de00640 1 -- 172.21.15.106:0/2219711291 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a04003530 con 0x7f4a04003fe0 2024-04-26T21:17:28.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a1de00640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a04004810 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009ae0 tx=0x7f4a0c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4fcb8b703ba2a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:28.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0096b0 con 0x7f4a04003fe0 2024-04-26T21:17:28.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0a64a0 con 0x7f4a04003fe0 2024-04-26T21:17:28.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a1d400640 1 -- 172.21.15.106:0/2219711291 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0a6890 con 0x7f4a04003fe0 2024-04-26T21:17:28.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a24a00640 1 -- 172.21.15.106:0/2219711291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 msgr2=0x7f4a04004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a24a00640 1 --2- 172.21.15.106:0/2219711291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a04004810 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009ae0 tx=0x7f4a0c01c9b0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a1f200640 1 -- 172.21.15.106:0/2219711291 reap_dead start 2024-04-26T21:17:28.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a24a00640 1 -- 172.21.15.106:0/2219711291 shutdown_connections 2024-04-26T21:17:28.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a24a00640 1 -- 172.21.15.106:0/2219711291 >> 172.21.15.106:0/2219711291 conn(0x7f4a200d29f0 msgr2=0x7f4a200d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:28.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a24a00640 1 -- 172.21.15.106:0/2219711291 shutdown_connections 2024-04-26T21:17:28.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a24a00640 1 -- 172.21.15.106:0/2219711291 wait complete. 2024-04-26T21:17:28.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.598+0000 7f4a24a00640 1 Processor -- start 2024-04-26T21:17:28.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 -- start start 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a200b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cc440 0x7f4a200cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a201e7750 0x7f4a201e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4a200ce260 con 0x7f4a04003fe0 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4a200ce0e0 con 0x7f4a201e7750 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4a200ce3e0 con 0x7f4a200cc440 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a200b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a200b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55692/0 (socket says 172.21.15.106:55692) 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1e800640 1 -- 172.21.15.106:0/66566134 learned_addr learned my addr 172.21.15.106:0/66566134 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1f200640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a201e7750 0x7f4a201e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1de00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cc440 0x7f4a200cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1e800640 1 -- 172.21.15.106:0/66566134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cc440 msgr2=0x7f4a200cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1e800640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cc440 0x7f4a200cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1e800640 1 -- 172.21.15.106:0/66566134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a201e7750 msgr2=0x7f4a201e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1e800640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a201e7750 0x7f4a201e7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1e800640 1 -- 172.21.15.106:0/66566134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a201e94b0 con 0x7f4a04003fe0 2024-04-26T21:17:28.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a1e800640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a200b2d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4a10001060 tx=0x7f4a10012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:28.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a16a00640 1 -- 172.21.15.106:0/66566134 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1001c070 con 0x7f4a04003fe0 2024-04-26T21:17:28.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a16a00640 1 -- 172.21.15.106:0/66566134 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a10014770 con 0x7f4a04003fe0 2024-04-26T21:17:28.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a16a00640 1 -- 172.21.15.106:0/66566134 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a10014b60 con 0x7f4a04003fe0 2024-04-26T21:17:28.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a201e8410 con 0x7f4a04003fe0 2024-04-26T21:17:28.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a201e89d0 con 0x7f4a04003fe0 2024-04-26T21:17:28.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.602+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a200506d0 con 0x7f4a04003fe0 2024-04-26T21:17:28.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.606+0000 7f4a16a00640 1 -- 172.21.15.106:0/66566134 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a10014d00 con 0x7f4a04003fe0 2024-04-26T21:17:28.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.606+0000 7f4a16a00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4a000683b0 0x7f4a0006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.606+0000 7f4a16a00640 1 -- 172.21.15.106:0/66566134 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f4a10089650 con 0x7f4a04003fe0 2024-04-26T21:17:28.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.606+0000 7f4a1de00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4a000683b0 0x7f4a0006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.606+0000 7f4a1de00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4a000683b0 0x7f4a0006a870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0ad000 tx=0x7f4a0c0b2040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:28.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.610+0000 7f4a16a00640 1 -- 172.21.15.106:0/66566134 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4a10059120 con 0x7f4a04003fe0 2024-04-26T21:17:28.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.766+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4a20162680 con 0x7f4a04003fe0 2024-04-26T21:17:28.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.766+0000 7f4a16a00640 1 -- 172.21.15.106:0/66566134 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f4a1005d420 con 0x7f4a04003fe0 2024-04-26T21:17:28.771 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:17:28.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4a000683b0 msgr2=0x7f4a0006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4a000683b0 0x7f4a0006a870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0ad000 tx=0x7f4a0c0b2040 comp rx=0 tx=0).stop 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 msgr2=0x7f4a200b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a200b2d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4a10001060 tx=0x7f4a10012920 comp rx=0 tx=0).stop 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 shutdown_connections 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a201e7750 0x7f4a201e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4a000683b0 0x7f4a0006a870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4a200cc440 0x7f4a200cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 --2- 172.21.15.106:0/66566134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a04003fe0 0x7f4a200b2d90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 >> 172.21.15.106:0/66566134 conn(0x7f4a200d29f0 msgr2=0x7f4a2006d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 shutdown_connections 2024-04-26T21:17:28.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.770+0000 7f4a24a00640 1 -- 172.21.15.106:0/66566134 wait complete. 2024-04-26T21:17:28.792 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T21:17:28.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe694000640 1 Processor -- start 2024-04-26T21:17:28.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe694000640 1 -- start start 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe694000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe68c0ae8d0 0x7fe68c0b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe694000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe68c0aed30 0x7fe68c0b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe694000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe68c0726a0 con 0x7fe68c159890 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe694000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe68c0b3e20 con 0x7fe68c0aed30 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe694000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe68c0b43c0 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe692000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe68c0aed30 0x7fe68c0b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe692000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe68c0aed30 0x7fe68c0b5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55696/0 (socket says 172.21.15.106:55696) 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe692000640 1 -- 172.21.15.106:0/4289399635 learned_addr learned my addr 172.21.15.106:0/4289399635 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe690c00640 1 --2- 172.21.15.106:0/4289399635 >> v2:172.21.15.112:3300/0 conn(0x7fe68c0ae8d0 0x7fe68c0b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe692000640 1 -- 172.21.15.106:0/4289399635 >> v2:172.21.15.112:3300/0 conn(0x7fe68c0ae8d0 msgr2=0x7fe68c0b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:28.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe692000640 1 --2- 172.21.15.106:0/4289399635 >> v2:172.21.15.112:3300/0 conn(0x7fe68c0ae8d0 0x7fe68c0b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe692000640 1 -- 172.21.15.106:0/4289399635 >> v1:172.21.15.112:6789/0 conn(0x7fe68c159890 legacy=0x7fe68c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:28.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.926+0000 7fe692000640 1 -- 172.21.15.106:0/4289399635 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68c072af0 con 0x7fe68c0aed30 2024-04-26T21:17:28.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe692000640 1 --2- 172.21.15.106:0/4289399635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0aed30 0x7fe68c0b5bd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe68c070020 tx=0x7fe68401f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d442c90d88d334 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:28.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe68be00640 1 -- 172.21.15.106:0/4289399635 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6840b4070 con 0x7fe68c0aed30 2024-04-26T21:17:28.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe68be00640 1 -- 172.21.15.106:0/4289399635 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6840af400 con 0x7fe68c0aed30 2024-04-26T21:17:28.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe68be00640 1 -- 172.21.15.106:0/4289399635 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6840af7d0 con 0x7fe68c0aed30 2024-04-26T21:17:28.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe694000640 1 -- 172.21.15.106:0/4289399635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0aed30 msgr2=0x7fe68c0b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe694000640 1 --2- 172.21.15.106:0/4289399635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0aed30 0x7fe68c0b5bd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe68c070020 tx=0x7fe68401f1a0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe694000640 1 -- 172.21.15.106:0/4289399635 shutdown_connections 2024-04-26T21:17:28.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe694000640 1 --2- 172.21.15.106:0/4289399635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0aed30 0x7fe68c0b5bd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe694000640 1 --2- 172.21.15.106:0/4289399635 >> v2:172.21.15.112:3300/0 conn(0x7fe68c0ae8d0 0x7fe68c0b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe694000640 1 -- 172.21.15.106:0/4289399635 >> 172.21.15.106:0/4289399635 conn(0x7fe68c0b2910 msgr2=0x7fe68c0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:28.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe694000640 1 -- 172.21.15.106:0/4289399635 shutdown_connections 2024-04-26T21:17:28.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.930+0000 7fe694000640 1 -- 172.21.15.106:0/4289399635 wait complete. 2024-04-26T21:17:28.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 Processor -- start 2024-04-26T21:17:28.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 -- start start 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0ae8d0 0x7fe68c13dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe68c0aed30 0x7fe68c152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe68c159890 0x7fe68c1f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c160580 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c0b4050 con 0x7fe68c159890 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe68c0730b0 con 0x7fe68c0aed30 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe691600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0ae8d0 0x7fe68c13dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe691600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0ae8d0 0x7fe68c13dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55710/0 (socket says 172.21.15.106:55710) 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe691600640 1 -- 172.21.15.106:0/1918461168 learned_addr learned my addr 172.21.15.106:0/1918461168 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe692000640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe68c159890 0x7fe68c1f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe690c00640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe68c0aed30 0x7fe68c152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe691600640 1 -- 172.21.15.106:0/1918461168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe68c0aed30 msgr2=0x7fe68c152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe691600640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe68c0aed30 0x7fe68c152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe691600640 1 -- 172.21.15.106:0/1918461168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe68c159890 msgr2=0x7fe68c1f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe691600640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe68c159890 0x7fe68c1f83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe691600640 1 -- 172.21.15.106:0/1918461168 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68c13e530 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe692000640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe68c159890 0x7fe68c1f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe691600640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0ae8d0 0x7fe68c13dff0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe68000b440 tx=0x7fe68000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe689600640 1 -- 172.21.15.106:0/1918461168 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680015020 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe689600640 1 -- 172.21.15.106:0/1918461168 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe680011890 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe689600640 1 -- 172.21.15.106:0/1918461168 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680011c80 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68c155600 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe68c155bc0 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.934+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe68c069400 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.938+0000 7fe689600640 1 -- 172.21.15.106:0/1918461168 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe680018020 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.938+0000 7fe689600640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe66c068380 0x7fe66c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:28.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.938+0000 7fe689600640 1 -- 172.21.15.106:0/1918461168 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe680086c00 con 0x7fe68c0ae8d0 2024-04-26T21:17:28.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.938+0000 7fe690c00640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe66c068380 0x7fe66c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:28.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.938+0000 7fe690c00640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe66c068380 0x7fe66c06a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0b1d80 tx=0x7fe678008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:28.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:28.942+0000 7fe689600640 1 -- 172.21.15.106:0/1918461168 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe68001f030 con 0x7fe68c0ae8d0 2024-04-26T21:17:29.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.094+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe68c0b1db0 con 0x7fe68c0ae8d0 2024-04-26T21:17:29.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.094+0000 7fe689600640 1 -- 172.21.15.106:0/1918461168 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fe68000d040 con 0x7fe68c0ae8d0 2024-04-26T21:17:29.100 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:17:29.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe66c068380 msgr2=0x7fe66c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe66c068380 0x7fe66c06a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0b1d80 tx=0x7fe678008040 comp rx=0 tx=0).stop 2024-04-26T21:17:29.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0ae8d0 msgr2=0x7fe68c13dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0ae8d0 0x7fe68c13dff0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe68000b440 tx=0x7fe68000b900 comp rx=0 tx=0).stop 2024-04-26T21:17:29.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 shutdown_connections 2024-04-26T21:17:29.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe68c159890 0x7fe68c1f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe66c068380 0x7fe66c06a840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe68c0aed30 0x7fe68c152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 --2- 172.21.15.106:0/1918461168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68c0ae8d0 0x7fe68c13dff0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 >> 172.21.15.106:0/1918461168 conn(0x7fe68c0b2910 msgr2=0x7fe68c0d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:29.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 shutdown_connections 2024-04-26T21:17:29.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.098+0000 7fe694000640 1 -- 172.21.15.106:0/1918461168 wait complete. 2024-04-26T21:17:29.122 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:17:29.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258fe00640 1 Processor -- start 2024-04-26T21:17:29.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258fe00640 1 -- start start 2024-04-26T21:17:29.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25880d37f0 0x7f25880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258fe00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25880d1d70 con 0x7f25880cdc50 2024-04-26T21:17:29.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258fe00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25880d2050 con 0x7f258815f3d0 2024-04-26T21:17:29.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f25880cd450 con 0x7f25880d37f0 2024-04-26T21:17:29.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258de00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f25880cdc50 0x7f25880ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41550/0 (socket says 172.21.15.106:41550) 2024-04-26T21:17:29.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258de00640 1 -- 172.21.15.106:0/3770993372 learned_addr learned my addr 172.21.15.106:0/3770993372 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:29.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258ca00640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25880d37f0 0x7f25880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1765359371 0 0) 0x7f25880d1d70 con 0x7f25880cdc50 2024-04-26T21:17:29.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2570003530 con 0x7f25880cdc50 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871666642 0 0) 0x7f25880d2050 con 0x7f258815f3d0 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25880d1d70 con 0x7f258815f3d0 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 703728261 0 0) 0x7f2570003530 con 0x7f25880cdc50 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25880d37f0 msgr2=0x7f25880cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25880d37f0 0x7f25880cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 >> v1:172.21.15.112:6789/0 conn(0x7f258815f3d0 legacy=0x7f25880cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25880cd730 con 0x7f25880cdc50 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f2580001a00 con 0x7f25880cdc50 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258ca00640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25880d37f0 0x7f25880cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:29.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 >> v1:172.21.15.106:6789/0 conn(0x7f25880cdc50 legacy=0x7f25880ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2570003b80 0x7f2570003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25880d37f0 0x7f2570004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570004d50 0x7f25700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f25880cd450 con 0x7f2570003b80 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f257000ba80 con 0x7f2570004d50 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f257000bc00 con 0x7f25880d37f0 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258d400640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2570003b80 0x7f2570003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258ca00640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25880d37f0 0x7f2570004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.254+0000 7f258de00640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570004d50 0x7f25700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258d400640 1 -- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25880d37f0 msgr2=0x7f2570004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258d400640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25880d37f0 0x7f2570004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258d400640 1 -- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570004d50 msgr2=0x7f25700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258d400640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2570004d50 0x7f25700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258d400640 1 -- 172.21.15.106:0/3770993372 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2570003530 con 0x7f2570003b80 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258d400640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2570003b80 0x7f2570003f80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f257c001900 tx=0x7f257c01c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23cebdf9253474e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c001520 con 0x7f2570003b80 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c0a4e50 con 0x7f2570003b80 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f2587e00640 1 -- 172.21.15.106:0/3770993372 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c003600 con 0x7f2570003b80 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258fe00640 1 -- 172.21.15.106:0/3770993372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2570003b80 msgr2=0x7f2570003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258fe00640 1 --2- 172.21.15.106:0/3770993372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2570003b80 0x7f2570003f80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f257c001900 tx=0x7f257c01c580 comp rx=0 tx=0).stop 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258de00640 1 -- 172.21.15.106:0/3770993372 reap_dead start 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258fe00640 1 -- 172.21.15.106:0/3770993372 shutdown_connections 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258fe00640 1 -- 172.21.15.106:0/3770993372 >> 172.21.15.106:0/3770993372 conn(0x7f25880d2c60 msgr2=0x7f25880d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258fe00640 1 -- 172.21.15.106:0/3770993372 shutdown_connections 2024-04-26T21:17:29.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.258+0000 7f258fe00640 1 -- 172.21.15.106:0/3770993372 wait complete. 2024-04-26T21:17:29.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 Processor -- start 2024-04-26T21:17:29.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 -- start start 2024-04-26T21:17:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2570003b80 0x7f2588162d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2588165260 0x7f258806ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25881656e0 0x7f2588070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f258816b190 con 0x7f25881656e0 2024-04-26T21:17:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f258816b010 con 0x7f2588165260 2024-04-26T21:17:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f258816b310 con 0x7f2570003b80 2024-04-26T21:17:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25881656e0 0x7f2588070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25881656e0 0x7f2588070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55730/0 (socket says 172.21.15.106:55730) 2024-04-26T21:17:29.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258de00640 1 -- 172.21.15.106:0/669505641 learned_addr learned my addr 172.21.15.106:0/669505641 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258d400640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2570003b80 0x7f2588162d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258ca00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2588165260 0x7f258806ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258de00640 1 -- 172.21.15.106:0/669505641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2570003b80 msgr2=0x7f2588162d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258de00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2570003b80 0x7f2588162d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258de00640 1 -- 172.21.15.106:0/669505641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2588165260 msgr2=0x7f258806ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258de00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2588165260 0x7f258806ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258de00640 1 -- 172.21.15.106:0/669505641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258815c6d0 con 0x7f25881656e0 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258de00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25881656e0 0x7f2588070510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2580000f90 tx=0x7f258000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f2585600640 1 -- 172.21.15.106:0/669505641 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25800019a0 con 0x7f25881656e0 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f2585600640 1 -- 172.21.15.106:0/669505641 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2580018070 con 0x7f25881656e0 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f2585600640 1 -- 172.21.15.106:0/669505641 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580013420 con 0x7f25881656e0 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25881633d0 con 0x7f25881656e0 2024-04-26T21:17:29.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.262+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2588163990 con 0x7f25881656e0 2024-04-26T21:17:29.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.266+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2588069400 con 0x7f25881656e0 2024-04-26T21:17:29.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.266+0000 7f2585600640 1 -- 172.21.15.106:0/669505641 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f25800135c0 con 0x7f25881656e0 2024-04-26T21:17:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.266+0000 7f2585600640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2568068380 0x7f256806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.266+0000 7f2585600640 1 -- 172.21.15.106:0/669505641 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f25800870b0 con 0x7f25881656e0 2024-04-26T21:17:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.266+0000 7f258d400640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2568068380 0x7f256806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.266+0000 7f258d400640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2568068380 0x7f256806a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f257c0ac000 tx=0x7f257c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:29.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.270+0000 7f2585600640 1 -- 172.21.15.106:0/669505641 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2580056b80 con 0x7f25881656e0 2024-04-26T21:17:29.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.458+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f258815d720 con 0x7f25881656e0 2024-04-26T21:17:29.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f2585600640 1 -- 172.21.15.106:0/669505641 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f258005ae80 con 0x7f25881656e0 2024-04-26T21:17:29.464 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:29.464 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:37.854892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:17:29.465 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 9 2024-04-26T21:17:29.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2568068380 msgr2=0x7f256806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2568068380 0x7f256806a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f257c0ac000 tx=0x7f257c0a6000 comp rx=0 tx=0).stop 2024-04-26T21:17:29.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25881656e0 msgr2=0x7f2588070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25881656e0 0x7f2588070510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2580000f90 tx=0x7f258000e530 comp rx=0 tx=0).stop 2024-04-26T21:17:29.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 shutdown_connections 2024-04-26T21:17:29.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2588165260 0x7f258806ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2568068380 0x7f256806a840 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25881656e0 0x7f2588070510 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 --2- 172.21.15.106:0/669505641 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2570003b80 0x7f2588162d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 >> 172.21.15.106:0/669505641 conn(0x7f25880d2c60 msgr2=0x7f2588169f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:29.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 shutdown_connections 2024-04-26T21:17:29.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.462+0000 7f258fe00640 1 -- 172.21.15.106:0/669505641 wait complete. 2024-04-26T21:17:29.486 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee78a00640 1 Processor -- start 2024-04-26T21:17:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee78a00640 1 -- start start 2024-04-26T21:17:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee78a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fee74160ac0 0x7fee7415df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee78a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146870 0x7fee740d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee78a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee740b3da0 con 0x7fee74146490 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee78a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fee74160fa0 con 0x7fee74160ac0 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee78a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fee74161280 con 0x7fee74146870 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee71e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fee74146490 0x7fee740cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41558/0 (socket says 172.21.15.106:41558) 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee71e00640 1 -- 172.21.15.106:0/840600084 learned_addr learned my addr 172.21.15.106:0/840600084 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee71400640 1 --2- 172.21.15.106:0/840600084 >> v2:172.21.15.112:3300/0 conn(0x7fee74160ac0 0x7fee7415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee72800640 1 --2- 172.21.15.106:0/840600084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146870 0x7fee740d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee70a00640 1 -- 172.21.15.106:0/840600084 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1091286533 0 0) 0x7fee740b3da0 con 0x7fee74146490 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee70a00640 1 -- 172.21.15.106:0/840600084 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee58003530 con 0x7fee74146490 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee71400640 1 -- 172.21.15.106:0/840600084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146870 msgr2=0x7fee740d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee71400640 1 --2- 172.21.15.106:0/840600084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146870 0x7fee740d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee71400640 1 -- 172.21.15.106:0/840600084 >> v1:172.21.15.106:6789/0 conn(0x7fee74146490 legacy=0x7fee740cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.618+0000 7fee71400640 1 -- 172.21.15.106:0/840600084 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee74161560 con 0x7fee74160ac0 2024-04-26T21:17:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee71400640 1 --2- 172.21.15.106:0/840600084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74160ac0 0x7fee7415df50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee600097c0 tx=0x7fee6001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea26ba7980a1d5f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee70a00640 1 -- 172.21.15.106:0/840600084 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee600b0070 con 0x7fee74160ac0 2024-04-26T21:17:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee70a00640 1 -- 172.21.15.106:0/840600084 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee600ab600 con 0x7fee74160ac0 2024-04-26T21:17:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee70a00640 1 -- 172.21.15.106:0/840600084 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee600ab9d0 con 0x7fee74160ac0 2024-04-26T21:17:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee78a00640 1 -- 172.21.15.106:0/840600084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74160ac0 msgr2=0x7fee7415df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee78a00640 1 --2- 172.21.15.106:0/840600084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74160ac0 0x7fee7415df50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee600097c0 tx=0x7fee6001c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee78a00640 1 -- 172.21.15.106:0/840600084 shutdown_connections 2024-04-26T21:17:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee78a00640 1 --2- 172.21.15.106:0/840600084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146870 0x7fee740d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee78a00640 1 --2- 172.21.15.106:0/840600084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74160ac0 0x7fee7415df50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee78a00640 1 -- 172.21.15.106:0/840600084 >> 172.21.15.106:0/840600084 conn(0x7fee74068340 msgr2=0x7fee74068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee78a00640 1 -- 172.21.15.106:0/840600084 shutdown_connections 2024-04-26T21:17:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.622+0000 7fee78a00640 1 -- 172.21.15.106:0/840600084 wait complete. 2024-04-26T21:17:29.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 Processor -- start 2024-04-26T21:17:29.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 -- start start 2024-04-26T21:17:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146490 0x7fee74145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74146870 0x7fee74142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee74160ac0 0x7fee7413ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fee740b5150 con 0x7fee74160ac0 2024-04-26T21:17:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fee740b4fd0 con 0x7fee74146870 2024-04-26T21:17:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fee7406ff90 con 0x7fee74146490 2024-04-26T21:17:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee72800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee74160ac0 0x7fee7413ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee72800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee74160ac0 0x7fee7413ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55746/0 (socket says 172.21.15.106:55746) 2024-04-26T21:17:29.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee72800640 1 -- 172.21.15.106:0/3189276951 learned_addr learned my addr 172.21.15.106:0/3189276951 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee71e00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146490 0x7fee74145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee71400640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74146870 0x7fee74142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee72800640 1 -- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146490 msgr2=0x7fee74145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee72800640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146490 0x7fee74145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee72800640 1 -- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74146870 msgr2=0x7fee74142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee72800640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74146870 0x7fee74142860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee72800640 1 -- 172.21.15.106:0/3189276951 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7413a720 con 0x7fee74160ac0 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee71400640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74146870 0x7fee74142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee71e00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146490 0x7fee74145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee72800640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee74160ac0 0x7fee7413ee80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00efc0 tx=0x7fee6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee6a000640 1 -- 172.21.15.106:0/3189276951 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c018020 con 0x7fee74160ac0 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee6a000640 1 -- 172.21.15.106:0/3189276951 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6c014480 con 0x7fee74160ac0 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee74143330 con 0x7fee74160ac0 2024-04-26T21:17:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee6a000640 1 -- 172.21.15.106:0/3189276951 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c009e60 con 0x7fee74160ac0 2024-04-26T21:17:29.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee74138ec0 con 0x7fee74160ac0 2024-04-26T21:17:29.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.626+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee74069400 con 0x7fee74160ac0 2024-04-26T21:17:29.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.630+0000 7fee6a000640 1 -- 172.21.15.106:0/3189276951 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fee6c01b020 con 0x7fee74160ac0 2024-04-26T21:17:29.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.630+0000 7fee6a000640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fee54068380 0x7fee5406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.630+0000 7fee6a000640 1 -- 172.21.15.106:0/3189276951 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fee6c087ab0 con 0x7fee74160ac0 2024-04-26T21:17:29.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.630+0000 7fee71e00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fee54068380 0x7fee5406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.630+0000 7fee71e00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fee54068380 0x7fee5406a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee64000f70 tx=0x7fee64009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:29.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.634+0000 7fee6a000640 1 -- 172.21.15.106:0/3189276951 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fee6c022030 con 0x7fee74160ac0 2024-04-26T21:17:29.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.794+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee74167c30 con 0x7fee74160ac0 2024-04-26T21:17:29.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.794+0000 7fee6a000640 1 -- 172.21.15.106:0/3189276951 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7fee6c010040 con 0x7fee74160ac0 2024-04-26T21:17:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:29.799 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:29.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fee54068380 msgr2=0x7fee5406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fee54068380 0x7fee5406a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee64000f70 tx=0x7fee64009040 comp rx=0 tx=0).stop 2024-04-26T21:17:29.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee74160ac0 msgr2=0x7fee7413ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee74160ac0 0x7fee7413ee80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00efc0 tx=0x7fee6c00c490 comp rx=0 tx=0).stop 2024-04-26T21:17:29.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 shutdown_connections 2024-04-26T21:17:29.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74146870 0x7fee74142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fee54068380 0x7fee5406a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee74160ac0 0x7fee7413ee80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 --2- 172.21.15.106:0/3189276951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fee74146490 0x7fee74145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 >> 172.21.15.106:0/3189276951 conn(0x7fee74068340 msgr2=0x7fee740d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:29.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 shutdown_connections 2024-04-26T21:17:29.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.798+0000 7fee78a00640 1 -- 172.21.15.106:0/3189276951 wait complete. 2024-04-26T21:17:29.820 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T21:17:29.820 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:17:29.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.950+0000 7fb1d1200640 1 Processor -- start 2024-04-26T21:17:29.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.950+0000 7fb1d1200640 1 -- start start 2024-04-26T21:17:29.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1d1200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb1cc13ed60 0x7fb1cc15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1d1200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1cc13f140 0x7fb1cc0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1d1200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc0b3d10 con 0x7fb1cc06eb70 2024-04-26T21:17:29.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1d1200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb1cc0b3ac0 con 0x7fb1cc13ed60 2024-04-26T21:17:29.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1d1200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc0b4920 con 0x7fb1cc13f140 2024-04-26T21:17:29.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1ca800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb1cc06eb70 0x7fb1cc0d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41568/0 (socket says 172.21.15.106:41568) 2024-04-26T21:17:29.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1ca800640 1 -- 172.21.15.106:0/3477713406 learned_addr learned my addr 172.21.15.106:0/3477713406 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:29.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c9400640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1cc13f140 0x7fb1cc0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c9e00640 1 --2- 172.21.15.106:0/3477713406 >> v2:172.21.15.112:3300/0 conn(0x7fb1cc13ed60 0x7fb1cc15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 607069547 0 0) 0x7fb1cc0b3d10 con 0x7fb1cc06eb70 2024-04-26T21:17:29.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1b0003530 con 0x7fb1cc06eb70 2024-04-26T21:17:29.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1660122553 0 0) 0x7fb1b0003530 con 0x7fb1cc06eb70 2024-04-26T21:17:29.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1cc13f140 msgr2=0x7fb1cc0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1cc13f140 0x7fb1cc0b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 >> v2:172.21.15.112:3300/0 conn(0x7fb1cc13ed60 msgr2=0x7fb1cc15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 --2- 172.21.15.106:0/3477713406 >> v2:172.21.15.112:3300/0 conn(0x7fb1cc13ed60 0x7fb1cc15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc0b3ff0 con 0x7fb1cc06eb70 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7fb1c4001a00 con 0x7fb1cc06eb70 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 >> v1:172.21.15.106:6789/0 conn(0x7fb1cc06eb70 legacy=0x7fb1cc0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1b00039c0 0x7fb1b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b0004810 0x7fb1b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b0005190 0x7fb1b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc0b3ac0 con 0x7fb1b00039c0 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc0b4920 con 0x7fb1b0005190 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b000bf10 con 0x7fb1b0004810 2024-04-26T21:17:29.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c9e00640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1b00039c0 0x7fb1b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1ca800640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b0005190 0x7fb1b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c9400640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b0004810 0x7fb1b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c9e00640 1 -- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b0004810 msgr2=0x7fb1b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:29.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c9e00640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b0004810 0x7fb1b0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c9e00640 1 -- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b0005190 msgr2=0x7fb1b000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:29.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c9e00640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1b0005190 0x7fb1b000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.954+0000 7fb1c9e00640 1 -- 172.21.15.106:0/3477713406 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b0003530 con 0x7fb1b00039c0 2024-04-26T21:17:29.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1c9e00640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1b00039c0 0x7fb1b0003de0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009ae0 tx=0x7fb1bc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74eba996641d9cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:29.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0b2070 con 0x7fb1b00039c0 2024-04-26T21:17:29.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0a5590 con 0x7fb1b00039c0 2024-04-26T21:17:29.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1c8a00640 1 -- 172.21.15.106:0/3477713406 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0096b0 con 0x7fb1b00039c0 2024-04-26T21:17:29.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1d1200640 1 -- 172.21.15.106:0/3477713406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1b00039c0 msgr2=0x7fb1b0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1d1200640 1 --2- 172.21.15.106:0/3477713406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1b00039c0 0x7fb1b0003de0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009ae0 tx=0x7fb1bc01cab0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1ca800640 1 -- 172.21.15.106:0/3477713406 reap_dead start 2024-04-26T21:17:29.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1d1200640 1 -- 172.21.15.106:0/3477713406 shutdown_connections 2024-04-26T21:17:29.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1d1200640 1 -- 172.21.15.106:0/3477713406 >> 172.21.15.106:0/3477713406 conn(0x7fb1cc068340 msgr2=0x7fb1cc068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:29.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1d1200640 1 -- 172.21.15.106:0/3477713406 shutdown_connections 2024-04-26T21:17:29.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1d1200640 1 -- 172.21.15.106:0/3477713406 wait complete. 2024-04-26T21:17:29.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.958+0000 7fb1d1200640 1 Processor -- start 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 -- start start 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b00039c0 0x7fb1cc159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1cc1f67f0 0x7fb1cc156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc161da0 0x7fb1cc162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc160400 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc0d1710 con 0x7fb1cc161da0 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc160580 con 0x7fb1b00039c0 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1cc1f67f0 0x7fb1cc156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1cc1f67f0 0x7fb1cc156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55764/0 (socket says 172.21.15.106:55764) 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9400640 1 -- 172.21.15.106:0/1492107508 learned_addr learned my addr 172.21.15.106:0/1492107508 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:29.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1ca800640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc161da0 0x7fb1cc162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9e00640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b00039c0 0x7fb1cc159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9400640 1 -- 172.21.15.106:0/1492107508 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b00039c0 msgr2=0x7fb1cc159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9400640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b00039c0 0x7fb1cc159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9400640 1 -- 172.21.15.106:0/1492107508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc161da0 msgr2=0x7fb1cc162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:29.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9400640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc161da0 0x7fb1cc162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:29.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9400640 1 -- 172.21.15.106:0/1492107508 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc1f6f60 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c9400640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1cc1f67f0 0x7fb1cc156e10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8011560 tx=0x7fb1b8011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:29.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c2000640 1 -- 172.21.15.106:0/1492107508 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8015930 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c2000640 1 -- 172.21.15.106:0/1492107508 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b8015ad0 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1c2000640 1 -- 172.21.15.106:0/1492107508 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b801d400 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1cc1f7240 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1cc0b1fb0 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.962+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1cc069400 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.966+0000 7fb1c2000640 1 -- 172.21.15.106:0/1492107508 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb1b801d5a0 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.966+0000 7fb1c2000640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb1ac0683b0 0x7fb1ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:29.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.966+0000 7fb1c2000640 1 -- 172.21.15.106:0/1492107508 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fb1b8087500 con 0x7fb1cc1f67f0 2024-04-26T21:17:29.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.966+0000 7fb1c9e00640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb1ac0683b0 0x7fb1ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:29.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.966+0000 7fb1c9e00640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb1ac0683b0 0x7fb1ac06a870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0af000 tx=0x7fb1bc0046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:29.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:29.970+0000 7fb1c2000640 1 -- 172.21.15.106:0/1492107508 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb1b8019030 con 0x7fb1cc1f67f0 2024-04-26T21:17:30.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1cc161310 con 0x7fb1cc1f67f0 2024-04-26T21:17:30.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1c2000640 1 -- 172.21.15.106:0/1492107508 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7fb1b80576b0 con 0x7fb1cc1f67f0 2024-04-26T21:17:30.166 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:30.166 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:37.854892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:17:30.166 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 9 2024-04-26T21:17:30.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb1ac0683b0 msgr2=0x7fb1ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb1ac0683b0 0x7fb1ac06a870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0af000 tx=0x7fb1bc0046d0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1cc1f67f0 msgr2=0x7fb1cc156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1cc1f67f0 0x7fb1cc156e10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8011560 tx=0x7fb1b8011960 comp rx=0 tx=0).stop 2024-04-26T21:17:30.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 shutdown_connections 2024-04-26T21:17:30.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1cc161da0 0x7fb1cc162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb1ac0683b0 0x7fb1ac06a870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1cc1f67f0 0x7fb1cc156e10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 --2- 172.21.15.106:0/1492107508 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb1b00039c0 0x7fb1cc159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 >> 172.21.15.106:0/1492107508 conn(0x7fb1cc068340 msgr2=0x7fb1cc072050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:30.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 shutdown_connections 2024-04-26T21:17:30.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.162+0000 7fb1d1200640 1 -- 172.21.15.106:0/1492107508 wait complete. 2024-04-26T21:17:30.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:17:30.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.322+0000 7f33f0600640 1 Processor -- start 2024-04-26T21:17:30.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.322+0000 7f33f0600640 1 -- start start 2024-04-26T21:17:30.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33f0600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33e813ed60 0x7f33e815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33f0600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e806eb70 0x7f33e80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33f0600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e80b3d10 con 0x7f33e813f140 2024-04-26T21:17:30.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33f0600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f33e80b3ac0 con 0x7f33e813ed60 2024-04-26T21:17:30.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33f0600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f33e80b4920 con 0x7f33e806eb70 2024-04-26T21:17:30.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33edc00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33e813ed60 0x7f33e815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33ee600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e806eb70 0x7f33e80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33ed200640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f33e813f140 0x7f33e80b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:34206/0 (socket says 172.21.15.106:34206) 2024-04-26T21:17:30.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33ed200640 1 -- 172.21.15.106:0/3388955650 learned_addr learned my addr 172.21.15.106:0/3388955650 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:30.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33edc00640 1 -- 172.21.15.106:0/3388955650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e806eb70 msgr2=0x7f33e80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:30.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33edc00640 1 --2- 172.21.15.106:0/3388955650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e806eb70 0x7f33e80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33edc00640 1 -- 172.21.15.106:0/3388955650 >> v1:172.21.15.112:6789/0 conn(0x7f33e813f140 legacy=0x7f33e80b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.326+0000 7f33edc00640 1 -- 172.21.15.106:0/3388955650 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e80b3ff0 con 0x7f33e813ed60 2024-04-26T21:17:30.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33edc00640 1 --2- 172.21.15.106:0/3388955650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813ed60 0x7f33e815c3e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f33e80b3c40 tx=0x7f33dc01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f4c57229ca87ae0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:30.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33e7e00640 1 -- 172.21.15.106:0/3388955650 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0b2070 con 0x7f33e813ed60 2024-04-26T21:17:30.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33e7e00640 1 -- 172.21.15.106:0/3388955650 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33dc0a5800 con 0x7f33e813ed60 2024-04-26T21:17:30.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33e7e00640 1 -- 172.21.15.106:0/3388955650 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0a5bd0 con 0x7f33e813ed60 2024-04-26T21:17:30.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 -- 172.21.15.106:0/3388955650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813ed60 msgr2=0x7f33e815c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 --2- 172.21.15.106:0/3388955650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813ed60 0x7f33e815c3e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f33e80b3c40 tx=0x7f33dc01c830 comp rx=0 tx=0).stop 2024-04-26T21:17:30.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 -- 172.21.15.106:0/3388955650 shutdown_connections 2024-04-26T21:17:30.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 --2- 172.21.15.106:0/3388955650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e806eb70 0x7f33e80d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 --2- 172.21.15.106:0/3388955650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813ed60 0x7f33e815c3e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 -- 172.21.15.106:0/3388955650 >> 172.21.15.106:0/3388955650 conn(0x7f33e8068340 msgr2=0x7f33e8068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:30.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 -- 172.21.15.106:0/3388955650 shutdown_connections 2024-04-26T21:17:30.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 -- 172.21.15.106:0/3388955650 wait complete. 2024-04-26T21:17:30.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 Processor -- start 2024-04-26T21:17:30.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 -- start start 2024-04-26T21:17:30.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33e813ed60 0x7f33e80b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813dec0 0x7f33e806f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e80b2ba0 0x7f33e806f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81607b0 con 0x7f33e813ed60 2024-04-26T21:17:30.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8160630 con 0x7f33e813dec0 2024-04-26T21:17:30.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33f0600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f33e8168b60 con 0x7f33e80b2ba0 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.330+0000 7f33edc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33e813ed60 0x7f33e80b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33edc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33e813ed60 0x7f33e80b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55778/0 (socket says 172.21.15.106:55778) 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33edc00640 1 -- 172.21.15.106:0/1194242061 learned_addr learned my addr 172.21.15.106:0/1194242061 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33ed200640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813dec0 0x7f33e806f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33ee600640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e80b2ba0 0x7f33e806f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33edc00640 1 -- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e80b2ba0 msgr2=0x7f33e806f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33edc00640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e80b2ba0 0x7f33e806f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33edc00640 1 -- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813dec0 msgr2=0x7f33e806f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33edc00640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813dec0 0x7f33e806f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33edc00640 1 -- 172.21.15.106:0/1194242061 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e80b25d0 con 0x7f33e813ed60 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33ed200640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813dec0 0x7f33e806f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33ee600640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e80b2ba0 0x7f33e806f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33edc00640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33e813ed60 0x7f33e80b2090 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0b0040 tx=0x7f33dc0195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:30.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33e5600640 1 -- 172.21.15.106:0/1194242061 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0bd020 con 0x7f33e813ed60 2024-04-26T21:17:30.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33e5600640 1 -- 172.21.15.106:0/1194242061 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33dc0b8670 con 0x7f33e813ed60 2024-04-26T21:17:30.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33e5600640 1 -- 172.21.15.106:0/1194242061 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0b2040 con 0x7f33e813ed60 2024-04-26T21:17:30.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e8154860 con 0x7f33e813ed60 2024-04-26T21:17:30.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e8154e20 con 0x7f33e813ed60 2024-04-26T21:17:30.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e8069400 con 0x7f33e813ed60 2024-04-26T21:17:30.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33e5600640 1 -- 172.21.15.106:0/1194242061 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33dc0c0020 con 0x7f33e813ed60 2024-04-26T21:17:30.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33e5600640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33c8068380 0x7f33c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.334+0000 7f33e5600640 1 -- 172.21.15.106:0/1194242061 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f33dc121c00 con 0x7f33e813ed60 2024-04-26T21:17:30.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.338+0000 7f33ed200640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33c8068380 0x7f33c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.338+0000 7f33ed200640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33c8068380 0x7f33c806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f33d4007fd0 tx=0x7f33d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:30.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.342+0000 7f33e5600640 1 -- 172.21.15.106:0/1194242061 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f33dc0c7070 con 0x7f33e813ed60 2024-04-26T21:17:30.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.530+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33e81596d0 con 0x7f33e813ed60 2024-04-26T21:17:30.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33e5600640 1 -- 172.21.15.106:0/1194242061 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f33e80b25d0 con 0x7f33e813ed60 2024-04-26T21:17:30.537 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:30.537 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1522470810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1522470810},{"type":"v1","addr":"172.21.15.106:6835","nonce":1522470810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/757960484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":757960484},{"type":"v1","addr":"172.21.15.106:6837","nonce":757960484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/2595928564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2595928564},{"type":"v1","addr":"172.21.15.112:6834","nonce":2595928564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:16:19.820202+0000","modified":"2024-04-26T21:16:37.854892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/3320582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":3320582993},{"type":"v1","addr":"172.21.15.112:6835","nonce":3320582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T21:17:30.537 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 9 2024-04-26T21:17:30.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33c8068380 msgr2=0x7f33c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33c8068380 0x7f33c806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f33d4007fd0 tx=0x7f33d4009040 comp rx=0 tx=0).stop 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33e813ed60 msgr2=0x7f33e80b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33e813ed60 0x7f33e80b2090 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0b0040 tx=0x7f33dc0195d0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 shutdown_connections 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33e813dec0 0x7f33e806f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33c8068380 0x7f33c806a840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33e80b2ba0 0x7f33e806f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 --2- 172.21.15.106:0/1194242061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33e813ed60 0x7f33e80b2090 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 >> 172.21.15.106:0/1194242061 conn(0x7f33e8068340 msgr2=0x7f33e80cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 shutdown_connections 2024-04-26T21:17:30.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.534+0000 7f33f0600640 1 -- 172.21.15.106:0/1194242061 wait complete. 2024-04-26T21:17:30.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:30.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff36be00640 1 Processor -- start 2024-04-26T21:17:30.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff36be00640 1 -- start start 2024-04-26T21:17:30.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff36be00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff36413f140 0x7ff36415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff36be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff36406eb70 0x7ff3640d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff36be00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3640b3d10 con 0x7ff36413ed60 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff36be00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff3640b3ac0 con 0x7ff36406eb70 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff36be00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff3640b4920 con 0x7ff36413f140 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff369e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff36406eb70 0x7ff3640d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff369e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff36406eb70 0x7ff3640d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55782/0 (socket says 172.21.15.106:55782) 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff369e00640 1 -- 172.21.15.106:0/1436621091 learned_addr learned my addr 172.21.15.106:0/1436621091 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff368a00640 1 --2- 172.21.15.106:0/1436621091 >> v2:172.21.15.112:3300/0 conn(0x7ff36413f140 0x7ff36415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff369e00640 1 -- 172.21.15.106:0/1436621091 >> v2:172.21.15.112:3300/0 conn(0x7ff36413f140 msgr2=0x7ff36415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff369e00640 1 --2- 172.21.15.106:0/1436621091 >> v2:172.21.15.112:3300/0 conn(0x7ff36413f140 0x7ff36415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff369e00640 1 -- 172.21.15.106:0/1436621091 >> v1:172.21.15.112:6789/0 conn(0x7ff36413ed60 legacy=0x7ff3640b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.690+0000 7ff369e00640 1 -- 172.21.15.106:0/1436621091 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3640b3ff0 con 0x7ff36406eb70 2024-04-26T21:17:30.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff369e00640 1 --2- 172.21.15.106:0/1436621091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36406eb70 0x7ff3640d0df0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff36415f930 tx=0x7ff35c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cad7ab10ff7e64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:30.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff363e00640 1 -- 172.21.15.106:0/1436621091 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0a56a0 con 0x7ff36406eb70 2024-04-26T21:17:30.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff363e00640 1 -- 172.21.15.106:0/1436621091 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35c0a5840 con 0x7ff36406eb70 2024-04-26T21:17:30.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff363e00640 1 -- 172.21.15.106:0/1436621091 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0a5c10 con 0x7ff36406eb70 2024-04-26T21:17:30.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff36be00640 1 -- 172.21.15.106:0/1436621091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36406eb70 msgr2=0x7ff3640d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff36be00640 1 --2- 172.21.15.106:0/1436621091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36406eb70 0x7ff3640d0df0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff36415f930 tx=0x7ff35c01c8d0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff36be00640 1 -- 172.21.15.106:0/1436621091 shutdown_connections 2024-04-26T21:17:30.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff36be00640 1 --2- 172.21.15.106:0/1436621091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36406eb70 0x7ff3640d0df0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff36be00640 1 --2- 172.21.15.106:0/1436621091 >> v2:172.21.15.112:3300/0 conn(0x7ff36413f140 0x7ff36415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff36be00640 1 -- 172.21.15.106:0/1436621091 >> 172.21.15.106:0/1436621091 conn(0x7ff364068340 msgr2=0x7ff364068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:30.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff36be00640 1 -- 172.21.15.106:0/1436621091 shutdown_connections 2024-04-26T21:17:30.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.694+0000 7ff36be00640 1 -- 172.21.15.106:0/1436621091 wait complete. 2024-04-26T21:17:30.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 Processor -- start 2024-04-26T21:17:30.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 -- start start 2024-04-26T21:17:30.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff36413ed60 0x7ff3640cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36415d450 0x7ff364165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3641fae40 0x7ff3641fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff364160790 con 0x7ff36415d450 2024-04-26T21:17:30.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff364160610 con 0x7ff3641fae40 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff364168b60 con 0x7ff36413ed60 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff368a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36415d450 0x7ff364165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff368a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36415d450 0x7ff364165170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55788/0 (socket says 172.21.15.106:55788) 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff368a00640 1 -- 172.21.15.106:0/3873208420 learned_addr learned my addr 172.21.15.106:0/3873208420 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff369e00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3641fae40 0x7ff3641fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff369400640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff36413ed60 0x7ff3640cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff368a00640 1 -- 172.21.15.106:0/3873208420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff36413ed60 msgr2=0x7ff3640cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff368a00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff36413ed60 0x7ff3640cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff368a00640 1 -- 172.21.15.106:0/3873208420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3641fae40 msgr2=0x7ff3641fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff368a00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3641fae40 0x7ff3641fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff368a00640 1 -- 172.21.15.106:0/3873208420 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36415d8d0 con 0x7ff36415d450 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff368a00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36415d450 0x7ff364165170 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff35000e870 tx=0x7ff35000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff361600640 1 -- 172.21.15.106:0/3873208420 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350017070 con 0x7ff36415d450 2024-04-26T21:17:30.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff361600640 1 -- 172.21.15.106:0/3873208420 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35000c940 con 0x7ff36415d450 2024-04-26T21:17:30.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff361600640 1 -- 172.21.15.106:0/3873208420 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35000ccf0 con 0x7ff36415d450 2024-04-26T21:17:30.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36415dba0 con 0x7ff36415d450 2024-04-26T21:17:30.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.698+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36415e160 con 0x7ff36415d450 2024-04-26T21:17:30.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.702+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff364069400 con 0x7ff36415d450 2024-04-26T21:17:30.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.702+0000 7ff361600640 1 -- 172.21.15.106:0/3873208420 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff35001a070 con 0x7ff36415d450 2024-04-26T21:17:30.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.702+0000 7ff361600640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff3440683b0 0x7ff34406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:30.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.702+0000 7ff361600640 1 -- 172.21.15.106:0/3873208420 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7ff350086be0 con 0x7ff36415d450 2024-04-26T21:17:30.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.702+0000 7ff369400640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff3440683b0 0x7ff34406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:30.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.702+0000 7ff369400640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff3440683b0 0x7ff34406a870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff358001810 tx=0x7ff358009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:30.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.706+0000 7ff361600640 1 -- 172.21.15.106:0/3873208420 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff3500566b0 con 0x7ff36415d450 2024-04-26T21:17:30.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.862+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff364068b10 con 0x7ff36415d450 2024-04-26T21:17:30.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff361600640 1 -- 172.21.15.106:0/3873208420 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18951 (secure 0 0 0) 0x7ff35005a9b0 con 0x7ff36415d450 2024-04-26T21:17:30.869 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:30.869 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:01.591487+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:16:18.259956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:16:18.727152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T21:16:22.419818+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:30.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff3440683b0 msgr2=0x7ff34406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff3440683b0 0x7ff34406a870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff358001810 tx=0x7ff358009040 comp rx=0 tx=0).stop 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36415d450 msgr2=0x7ff364165170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36415d450 0x7ff364165170 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff35000e870 tx=0x7ff35000ec70 comp rx=0 tx=0).stop 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 shutdown_connections 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3641fae40 0x7ff3641fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff3440683b0 0x7ff34406a870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff36415d450 0x7ff364165170 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 --2- 172.21.15.106:0/3873208420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff36413ed60 0x7ff3640cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 >> 172.21.15.106:0/3873208420 conn(0x7ff364068340 msgr2=0x7ff3640ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 shutdown_connections 2024-04-26T21:17:30.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:30.866+0000 7ff36be00640 1 -- 172.21.15.106:0/3873208420 wait complete. 2024-04-26T21:17:30.891 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T21:17:31.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.022+0000 7f8c21a00640 1 Processor -- start 2024-04-26T21:17:31.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.022+0000 7f8c21a00640 1 -- start start 2024-04-26T21:17:31.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.022+0000 7f8c21a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 0x7f8c1c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.022+0000 7f8c21a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c1c06eb70 0x7f8c1c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.022+0000 7f8c21a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c1c0b3d10 con 0x7f8c1c13f140 2024-04-26T21:17:31.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.022+0000 7f8c21a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f8c1c0b3ac0 con 0x7f8c1c06eb70 2024-04-26T21:17:31.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.022+0000 7f8c21a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c0b4920 con 0x7f8c1c13ed60 2024-04-26T21:17:31.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c1c06eb70 0x7f8c1c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c1c06eb70 0x7f8c1c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55798/0 (socket says 172.21.15.106:55798) 2024-04-26T21:17:31.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1b400640 1 -- 172.21.15.106:0/811746036 learned_addr learned my addr 172.21.15.106:0/811746036 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:31.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1a000640 1 --1- 172.21.15.106:0/811746036 >> v1:172.21.15.106:6789/0 conn(0x7f8c1c13f140 0x7f8c1c0b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41570/0 (socket says 172.21.15.106:41570) 2024-04-26T21:17:31.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1aa00640 1 --2- 172.21.15.106:0/811746036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 0x7f8c1c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1b400640 1 -- 172.21.15.106:0/811746036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 msgr2=0x7f8c1c15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:31.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1b400640 1 --2- 172.21.15.106:0/811746036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 0x7f8c1c15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1b400640 1 -- 172.21.15.106:0/811746036 >> v1:172.21.15.106:6789/0 conn(0x7f8c1c13f140 legacy=0x7f8c1c0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c19600640 1 -- 172.21.15.106:0/811746036 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754111043 0 0) 0x7f8c1c0b3d10 con 0x7f8c1c13f140 2024-04-26T21:17:31.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1b400640 1 -- 172.21.15.106:0/811746036 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c0b3ff0 con 0x7f8c1c06eb70 2024-04-26T21:17:31.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c1b400640 1 --2- 172.21.15.106:0/811746036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c06eb70 0x7f8c1c0d0df0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009e50 tx=0x7f8c1401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddd80ce3af4bdbb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:31.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c19600640 1 -- 172.21.15.106:0/811746036 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c140a56e0 con 0x7f8c1c06eb70 2024-04-26T21:17:31.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c19600640 1 -- 172.21.15.106:0/811746036 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c140a5880 con 0x7f8c1c06eb70 2024-04-26T21:17:31.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.026+0000 7f8c19600640 1 -- 172.21.15.106:0/811746036 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c140a5c50 con 0x7f8c1c06eb70 2024-04-26T21:17:31.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 -- 172.21.15.106:0/811746036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c06eb70 msgr2=0x7f8c1c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 --2- 172.21.15.106:0/811746036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c06eb70 0x7f8c1c0d0df0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009e50 tx=0x7f8c1401c910 comp rx=0 tx=0).stop 2024-04-26T21:17:31.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 -- 172.21.15.106:0/811746036 shutdown_connections 2024-04-26T21:17:31.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 --2- 172.21.15.106:0/811746036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c06eb70 0x7f8c1c0d0df0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 --2- 172.21.15.106:0/811746036 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 0x7f8c1c15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 -- 172.21.15.106:0/811746036 >> 172.21.15.106:0/811746036 conn(0x7f8c1c068340 msgr2=0x7f8c1c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:31.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 -- 172.21.15.106:0/811746036 shutdown_connections 2024-04-26T21:17:31.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 -- 172.21.15.106:0/811746036 wait complete. 2024-04-26T21:17:31.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 Processor -- start 2024-04-26T21:17:31.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 -- start start 2024-04-26T21:17:31.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 0x7f8c1c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c0b24c0 0x7f8c1c0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c072fa0 0x7f8c1c073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c1607d0 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c160650 con 0x7f8c1c072fa0 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c21a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c166b50 con 0x7f8c1c13ed60 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c0b24c0 0x7f8c1c0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c0b24c0 0x7f8c1c0b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55812/0 (socket says 172.21.15.106:55812) 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1a000640 1 -- 172.21.15.106:0/2683177424 learned_addr learned my addr 172.21.15.106:0/2683177424 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1aa00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 0x7f8c1c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1b400640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c072fa0 0x7f8c1c073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1a000640 1 -- 172.21.15.106:0/2683177424 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 msgr2=0x7f8c1c1598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1a000640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 0x7f8c1c1598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1a000640 1 -- 172.21.15.106:0/2683177424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c072fa0 msgr2=0x7f8c1c073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1a000640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c072fa0 0x7f8c1c073420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1a000640 1 -- 172.21.15.106:0/2683177424 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c13cb80 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.030+0000 7f8c1b400640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c072fa0 0x7f8c1c073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:31.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c1a000640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c0b24c0 0x7f8c1c0b2940 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800c450 tx=0x7f8c0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:31.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c12a00640 1 -- 172.21.15.106:0/2683177424 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c08018070 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c12a00640 1 -- 172.21.15.106:0/2683177424 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c080074a0 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c12a00640 1 -- 172.21.15.106:0/2683177424 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c08004a30 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c13ce60 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c13d420 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c069400 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c12a00640 1 -- 172.21.15.106:0/2683177424 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c08004bd0 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c12a00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bfc0683b0 0x7f8bfc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c12a00640 1 -- 172.21.15.106:0/2683177424 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f8c08085ec0 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.034+0000 7f8c1aa00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bfc0683b0 0x7f8bfc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.038+0000 7f8c1aa00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bfc0683b0 0x7f8bfc06a870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c1fb2e0 tx=0x7f8c0c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:31.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.038+0000 7f8c12a00640 1 -- 172.21.15.106:0/2683177424 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8c08055990 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.230+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8c1c0cfda0 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T21:17:31.230+0000 7fc9b4000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:17:31.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c12a00640 1 -- 172.21.15.106:0/2683177424 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f8c0805ae20 con 0x7f8c1c0b24c0 2024-04-26T21:17:31.240 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bfc0683b0 msgr2=0x7f8bfc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bfc0683b0 0x7f8bfc06a870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c1fb2e0 tx=0x7f8c0c009190 comp rx=0 tx=0).stop 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c0b24c0 msgr2=0x7f8c1c0b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c0b24c0 0x7f8c1c0b2940 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800c450 tx=0x7f8c0800c910 comp rx=0 tx=0).stop 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 shutdown_connections 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c1c072fa0 0x7f8c1c073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8bfc0683b0 0x7f8bfc06a870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c1c0b24c0 0x7f8c1c0b2940 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 --2- 172.21.15.106:0/2683177424 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8c1c13ed60 0x7f8c1c1598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 >> 172.21.15.106:0/2683177424 conn(0x7f8c1c068340 msgr2=0x7f8c1c0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:31.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 shutdown_connections 2024-04-26T21:17:31.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.238+0000 7f8c21a00640 1 -- 172.21.15.106:0/2683177424 wait complete. 2024-04-26T21:17:31.255 INFO:tasks.ceph.mds.d.smithi112.stderr: -4816> 2024-04-26T21:16:24.635+0000 7fb725400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:17:31.263 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T21:17:31.308 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2024-04-26T21:17:31.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f14a3600640 1 Processor -- start 2024-04-26T21:17:31.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f14a3600640 1 -- start start 2024-04-26T21:17:31.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f14a3600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f149c0d3c40 0x7f149c0d1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f14a3600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f149c0d1d80 0x7f149c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f14a3600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c0d2ba0 con 0x7f149c15f250 2024-04-26T21:17:31.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f14a3600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f149c0d21f0 con 0x7f149c0d3c40 2024-04-26T21:17:31.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f14a3600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f149c15f630 con 0x7f149c0d1d80 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f14a0c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f149c15f250 0x7f149c0d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41574/0 (socket says 172.21.15.106:41574) 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f14a0c00640 1 -- 172.21.15.106:0/2601475871 learned_addr learned my addr 172.21.15.106:0/2601475871 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.398+0000 7f149be00640 1 --2- 172.21.15.106:0/2601475871 >> v2:172.21.15.106:3300/0 conn(0x7f149c0d3c40 0x7f149c0d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f14a1600640 1 --2- 172.21.15.106:0/2601475871 >> v2:172.21.15.112:3300/0 conn(0x7f149c0d1d80 0x7f149c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f149be00640 1 -- 172.21.15.106:0/2601475871 >> v2:172.21.15.112:3300/0 conn(0x7f149c0d1d80 msgr2=0x7f149c0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f149be00640 1 --2- 172.21.15.106:0/2601475871 >> v2:172.21.15.112:3300/0 conn(0x7f149c0d1d80 0x7f149c0b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f149be00640 1 -- 172.21.15.106:0/2601475871 >> v1:172.21.15.106:6789/0 conn(0x7f149c15f250 legacy=0x7f149c0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f149be00640 1 -- 172.21.15.106:0/2601475871 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149c0d2e80 con 0x7f149c0d3c40 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f149b400640 1 -- 172.21.15.106:0/2601475871 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497375480 0 0) 0x7f149c0d2ba0 con 0x7f149c15f250 2024-04-26T21:17:31.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f14a1600640 1 --2- 172.21.15.106:0/2601475871 >> v2:172.21.15.112:3300/0 conn(0x7f149c0d1d80 0x7f149c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:31.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f149be00640 1 --2- 172.21.15.106:0/2601475871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d3c40 0x7f149c0d1840 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f14880097c0 tx=0x7f148801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9e60ecdd61fa86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:31.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f149b400640 1 -- 172.21.15.106:0/2601475871 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880b0070 con 0x7f149c0d3c40 2024-04-26T21:17:31.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f149b400640 1 -- 172.21.15.106:0/2601475871 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14880ab600 con 0x7f149c0d3c40 2024-04-26T21:17:31.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.402+0000 7f149b400640 1 -- 172.21.15.106:0/2601475871 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880ab9d0 con 0x7f149c0d3c40 2024-04-26T21:17:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 -- 172.21.15.106:0/2601475871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d3c40 msgr2=0x7f149c0d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 --2- 172.21.15.106:0/2601475871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d3c40 0x7f149c0d1840 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f14880097c0 tx=0x7f148801c460 comp rx=0 tx=0).stop 2024-04-26T21:17:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 -- 172.21.15.106:0/2601475871 shutdown_connections 2024-04-26T21:17:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 --2- 172.21.15.106:0/2601475871 >> v2:172.21.15.112:3300/0 conn(0x7f149c0d1d80 0x7f149c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 --2- 172.21.15.106:0/2601475871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d3c40 0x7f149c0d1840 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 -- 172.21.15.106:0/2601475871 >> 172.21.15.106:0/2601475871 conn(0x7f149c0d4e50 msgr2=0x7f149c0d5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 -- 172.21.15.106:0/2601475871 shutdown_connections 2024-04-26T21:17:31.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 -- 172.21.15.106:0/2601475871 wait complete. 2024-04-26T21:17:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 Processor -- start 2024-04-26T21:17:31.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 -- start start 2024-04-26T21:17:31.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d1d80 0x7f149c160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149c0d3c40 0x7f149c0b9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149c15f250 0x7f149c149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f149c0d0e90 con 0x7f149c0d1d80 2024-04-26T21:17:31.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f149c0d0d10 con 0x7f149c15f250 2024-04-26T21:17:31.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a3600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f149c16c040 con 0x7f149c0d3c40 2024-04-26T21:17:31.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a0c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d1d80 0x7f149c160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a0c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d1d80 0x7f149c160d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55816/0 (socket says 172.21.15.106:55816) 2024-04-26T21:17:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a0c00640 1 -- 172.21.15.106:0/859685907 learned_addr learned my addr 172.21.15.106:0/859685907 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f149be00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149c0d3c40 0x7f149c0b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.406+0000 7f14a1600640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149c15f250 0x7f149c149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f14a0c00640 1 -- 172.21.15.106:0/859685907 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149c0d3c40 msgr2=0x7f149c0b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f14a0c00640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149c0d3c40 0x7f149c0b9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f14a0c00640 1 -- 172.21.15.106:0/859685907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149c15f250 msgr2=0x7f149c149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f14a0c00640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149c15f250 0x7f149c149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f14a0c00640 1 -- 172.21.15.106:0/859685907 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149c0ba3d0 con 0x7f149c0d1d80 2024-04-26T21:17:31.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f14a0c00640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d1d80 0x7f149c160d10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f14900011f0 tx=0x7f149000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f1498c00640 1 -- 172.21.15.106:0/859685907 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490018070 con 0x7f149c0d1d80 2024-04-26T21:17:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f1498c00640 1 -- 172.21.15.106:0/859685907 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14900074e0 con 0x7f149c0d1d80 2024-04-26T21:17:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f149c15fa10 con 0x7f149c0d1d80 2024-04-26T21:17:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f1498c00640 1 -- 172.21.15.106:0/859685907 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490004a10 con 0x7f149c0d1d80 2024-04-26T21:17:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f149c15ffd0 con 0x7f149c0d1d80 2024-04-26T21:17:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f149c069400 con 0x7f149c0d1d80 2024-04-26T21:17:31.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.410+0000 7f1498c00640 1 -- 172.21.15.106:0/859685907 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f149001b070 con 0x7f149c0d1d80 2024-04-26T21:17:31.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.414+0000 7f1498c00640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f147c068400 0x7f147c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:31.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.414+0000 7f1498c00640 1 -- 172.21.15.106:0/859685907 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6821+0+0 (secure 0 0 0) 0x7f1490086200 con 0x7f149c0d1d80 2024-04-26T21:17:31.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.414+0000 7f149be00640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f147c068400 0x7f147c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:31.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.414+0000 7f149be00640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f147c068400 0x7f147c06a8c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f14880ad000 tx=0x7f14880a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:31.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.418+0000 7f1498c00640 1 -- 172.21.15.106:0/859685907 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1490055cf0 con 0x7f149c0d1d80 2024-04-26T21:17:31.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:31.610+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f149c169e10 con 0x7f149c0d1d80 2024-04-26T21:17:32.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.238+0000 7f1498c00640 1 -- 172.21.15.106:0/859685907 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f1490059ff0 con 0x7f149c0d1d80 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f147c068400 msgr2=0x7f147c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f147c068400 0x7f147c06a8c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f14880ad000 tx=0x7f14880a6000 comp rx=0 tx=0).stop 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d1d80 msgr2=0x7f149c160d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d1d80 0x7f149c160d10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f14900011f0 tx=0x7f149000c9b0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 shutdown_connections 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f149c15f250 0x7f149c149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f147c068400 0x7f147c06a8c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f149c0d3c40 0x7f149c0b9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 --2- 172.21.15.106:0/859685907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f149c0d1d80 0x7f149c160d10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 >> 172.21.15.106:0/859685907 conn(0x7f149c0d4e50 msgr2=0x7f149c06cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 shutdown_connections 2024-04-26T21:17:32.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.242+0000 7f14a3600640 1 -- 172.21.15.106:0/859685907 wait complete. 2024-04-26T21:17:32.269 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T21:17:32.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559f200640 1 Processor -- start 2024-04-26T21:17:32.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559f200640 1 -- start start 2024-04-26T21:17:32.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559f200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f55a0163130 0x7f55a0163510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b3e00 0x7f55a00cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559f200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a00b53c0 con 0x7f55a00b38b0 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559f200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f55a00d1690 con 0x7f55a0163130 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f55a00b5170 con 0x7f55a00b3e00 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f55a0163130 0x7f55a0163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f55a0163130 0x7f55a0163510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55824/0 (socket says 172.21.15.106:55824) 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.410+0000 7f559de00640 1 -- 172.21.15.106:0/1980244022 learned_addr learned my addr 172.21.15.106:0/1980244022 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559d400640 1 --2- 172.21.15.106:0/1980244022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b3e00 0x7f55a00cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559de00640 1 -- 172.21.15.106:0/1980244022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b3e00 msgr2=0x7f55a00cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559de00640 1 --2- 172.21.15.106:0/1980244022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b3e00 0x7f55a00cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559de00640 1 -- 172.21.15.106:0/1980244022 >> v1:172.21.15.112:6789/0 conn(0x7f55a00b38b0 legacy=0x7f55a00cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:32.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559de00640 1 -- 172.21.15.106:0/1980244022 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a0163ca0 con 0x7f55a0163130 2024-04-26T21:17:32.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559d400640 1 --2- 172.21.15.106:0/1980244022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b3e00 0x7f55a00cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:32.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559de00640 1 --2- 172.21.15.106:0/1980244022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 0x7f55a0163510 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5590009870 tx=0x7f559001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c423eb9813f43b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:32.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559ca00640 1 -- 172.21.15.106:0/1980244022 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55900a7070 con 0x7f55a0163130 2024-04-26T21:17:32.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559ca00640 1 -- 172.21.15.106:0/1980244022 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55900b0070 con 0x7f55a0163130 2024-04-26T21:17:32.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.414+0000 7f559ca00640 1 -- 172.21.15.106:0/1980244022 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55900ab890 con 0x7f55a0163130 2024-04-26T21:17:32.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 -- 172.21.15.106:0/1980244022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 msgr2=0x7f55a0163510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:32.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 --2- 172.21.15.106:0/1980244022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 0x7f55a0163510 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5590009870 tx=0x7f559001c560 comp rx=0 tx=0).stop 2024-04-26T21:17:32.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 -- 172.21.15.106:0/1980244022 shutdown_connections 2024-04-26T21:17:32.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 --2- 172.21.15.106:0/1980244022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b3e00 0x7f55a00cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 --2- 172.21.15.106:0/1980244022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 0x7f55a0163510 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 -- 172.21.15.106:0/1980244022 >> 172.21.15.106:0/1980244022 conn(0x7f55a00b4680 msgr2=0x7f55a00b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:32.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 -- 172.21.15.106:0/1980244022 shutdown_connections 2024-04-26T21:17:32.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 -- 172.21.15.106:0/1980244022 wait complete. 2024-04-26T21:17:32.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 Processor -- start 2024-04-26T21:17:32.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 -- start start 2024-04-26T21:17:32.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b38b0 0x7f55a00c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:32.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a00b3e00 0x7f55a00c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:32.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 0x7f55a00cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:32.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f55a006e670 con 0x7f55a0163130 2024-04-26T21:17:32.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f55a006e4f0 con 0x7f55a00b3e00 2024-04-26T21:17:32.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559f200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f55a006e7f0 con 0x7f55a00b38b0 2024-04-26T21:17:32.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 0x7f55a00cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:32.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 0x7f55a00cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55840/0 (socket says 172.21.15.106:55840) 2024-04-26T21:17:32.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559e800640 1 -- 172.21.15.106:0/3772887875 learned_addr learned my addr 172.21.15.106:0/3772887875 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:32.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559de00640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b38b0 0x7f55a00c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:32.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559d400640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a00b3e00 0x7f55a00c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:32.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559e800640 1 -- 172.21.15.106:0/3772887875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b38b0 msgr2=0x7f55a00c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:32.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559e800640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b38b0 0x7f55a00c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559e800640 1 -- 172.21.15.106:0/3772887875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a00b3e00 msgr2=0x7f55a00c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559e800640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a00b3e00 0x7f55a00c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.418+0000 7f559e800640 1 -- 172.21.15.106:0/3772887875 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a015d9e0 con 0x7f55a0163130 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.422+0000 7f559e800640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 0x7f55a00cb940 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f559800c760 tx=0x7f559800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.422+0000 7f5596000640 1 -- 172.21.15.106:0/3772887875 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598003b80 con 0x7f55a0163130 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.422+0000 7f5596000640 1 -- 172.21.15.106:0/3772887875 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598003d20 con 0x7f55a0163130 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.422+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a015dcc0 con 0x7f55a0163130 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.422+0000 7f5596000640 1 -- 172.21.15.106:0/3772887875 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559800aa90 con 0x7f55a0163130 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.422+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a015e280 con 0x7f55a0163130 2024-04-26T21:17:32.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.422+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a0069400 con 0x7f55a0163130 2024-04-26T21:17:32.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.422+0000 7f5596000640 1 -- 172.21.15.106:0/3772887875 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f559800ac30 con 0x7f55a0163130 2024-04-26T21:17:32.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.426+0000 7f5596000640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5580068380 0x7f558006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:32.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.426+0000 7f5596000640 1 -- 172.21.15.106:0/3772887875 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6821+0+0 (secure 0 0 0) 0x7f5598086bc0 con 0x7f55a0163130 2024-04-26T21:17:32.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.426+0000 7f559de00640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5580068380 0x7f558006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:32.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.426+0000 7f559de00640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5580068380 0x7f558006a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f55900af000 tx=0x7f55900a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:32.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.430+0000 7f5596000640 1 -- 172.21.15.106:0/3772887875 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5598056630 con 0x7f55a0163130 2024-04-26T21:17:32.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:32.590+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f55a015e450 con 0x7f55a0163130 2024-04-26T21:17:33.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.246+0000 7f5596000640 1 -- 172.21.15.106:0/3772887875 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7f55a015e450 con 0x7f55a0163130 2024-04-26T21:17:33.251 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' removed 2024-04-26T21:17:33.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5580068380 msgr2=0x7f558006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:33.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5580068380 0x7f558006a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f55900af000 tx=0x7f55900a7000 comp rx=0 tx=0).stop 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 msgr2=0x7f55a00cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 0x7f55a00cb940 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f559800c760 tx=0x7f559800cc20 comp rx=0 tx=0).stop 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 shutdown_connections 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55a00b3e00 0x7f55a00c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5580068380 0x7f558006a840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a0163130 0x7f55a00cb940 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 --2- 172.21.15.106:0/3772887875 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f55a00b38b0 0x7f55a00c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 >> 172.21.15.106:0/3772887875 conn(0x7f55a00b4680 msgr2=0x7f55a00b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 shutdown_connections 2024-04-26T21:17:33.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.250+0000 7f559f200640 1 -- 172.21.15.106:0/3772887875 wait complete. 2024-04-26T21:17:33.280 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T21:17:33.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.422+0000 7fe507800640 1 Processor -- start 2024-04-26T21:17:33.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.422+0000 7fe507800640 1 -- start start 2024-04-26T21:17:33.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe507800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe5000d13b0 0x7fe5000cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:33.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe507800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5000ce530 0x7fe5000b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:33.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe507800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5000d1910 con 0x7fe50015d140 2024-04-26T21:17:33.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe507800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fe50015d520 con 0x7fe5000d13b0 2024-04-26T21:17:33.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe507800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe5000b6270 con 0x7fe5000ce530 2024-04-26T21:17:33.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe504e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe50015d140 0x7fe5000cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41586/0 (socket says 172.21.15.106:41586) 2024-04-26T21:17:33.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe504e00640 1 -- 172.21.15.106:0/3225785554 learned_addr learned my addr 172.21.15.106:0/3225785554 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:33.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe4ffe00640 1 --2- 172.21.15.106:0/3225785554 >> v2:172.21.15.106:3300/0 conn(0x7fe5000d13b0 0x7fe5000cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:33.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe505800640 1 --2- 172.21.15.106:0/3225785554 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5000ce530 0x7fe5000b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:33.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe4ffe00640 1 -- 172.21.15.106:0/3225785554 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5000ce530 msgr2=0x7fe5000b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:33.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe4ffe00640 1 --2- 172.21.15.106:0/3225785554 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5000ce530 0x7fe5000b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:33.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe4ffe00640 1 -- 172.21.15.106:0/3225785554 >> v1:172.21.15.106:6789/0 conn(0x7fe50015d140 legacy=0x7fe5000cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:33.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe4ffe00640 1 -- 172.21.15.106:0/3225785554 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5000d1bf0 con 0x7fe5000d13b0 2024-04-26T21:17:33.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.426+0000 7fe4ff400640 1 -- 172.21.15.106:0/3225785554 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036861575 0 0) 0x7fe5000d1910 con 0x7fe50015d140 2024-04-26T21:17:33.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe4ffe00640 1 --2- 172.21.15.106:0/3225785554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000d13b0 0x7fe5000cdff0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0097c0 tx=0x7fe4ec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb919fc2bcdccb8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:33.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe4ff400640 1 -- 172.21.15.106:0/3225785554 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0a7070 con 0x7fe5000d13b0 2024-04-26T21:17:33.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe4ff400640 1 -- 172.21.15.106:0/3225785554 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0b0070 con 0x7fe5000d13b0 2024-04-26T21:17:33.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe4ff400640 1 -- 172.21.15.106:0/3225785554 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0ab890 con 0x7fe5000d13b0 2024-04-26T21:17:33.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 -- 172.21.15.106:0/3225785554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000d13b0 msgr2=0x7fe5000cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:33.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 --2- 172.21.15.106:0/3225785554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000d13b0 0x7fe5000cdff0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0097c0 tx=0x7fe4ec01c470 comp rx=0 tx=0).stop 2024-04-26T21:17:33.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 -- 172.21.15.106:0/3225785554 shutdown_connections 2024-04-26T21:17:33.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 --2- 172.21.15.106:0/3225785554 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5000ce530 0x7fe5000b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:33.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 --2- 172.21.15.106:0/3225785554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000d13b0 0x7fe5000cdff0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:33.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 -- 172.21.15.106:0/3225785554 >> 172.21.15.106:0/3225785554 conn(0x7fe5000d2dd0 msgr2=0x7fe5000d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:33.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 -- 172.21.15.106:0/3225785554 shutdown_connections 2024-04-26T21:17:33.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 -- 172.21.15.106:0/3225785554 wait complete. 2024-04-26T21:17:33.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 Processor -- start 2024-04-26T21:17:33.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.430+0000 7fe507800640 1 -- start start 2024-04-26T21:17:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe507800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000ce530 0x7fe50015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe507800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5000d13b0 0x7fe5001579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe507800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe50015d140 0x7fe500157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe507800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe5000b75d0 con 0x7fe5000ce530 2024-04-26T21:17:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe507800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe5000b7450 con 0x7fe50015d140 2024-04-26T21:17:33.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe507800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe5000b7750 con 0x7fe5000d13b0 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe504e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000ce530 0x7fe50015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe504e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000ce530 0x7fe50015ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55862/0 (socket says 172.21.15.106:55862) 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe504e00640 1 -- 172.21.15.106:0/3329877866 learned_addr learned my addr 172.21.15.106:0/3329877866 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe504e00640 1 -- 172.21.15.106:0/3329877866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5000d13b0 msgr2=0x7fe5001579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe504e00640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5000d13b0 0x7fe5001579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe504e00640 1 -- 172.21.15.106:0/3329877866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe50015d140 msgr2=0x7fe500157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe504e00640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe50015d140 0x7fe500157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe504e00640 1 -- 172.21.15.106:0/3329877866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5000ca440 con 0x7fe5000ce530 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe504e00640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000ce530 0x7fe50015ec90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000c7c0 tx=0x7fe4f000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe4fcc00640 1 -- 172.21.15.106:0/3329877866 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0018070 con 0x7fe5000ce530 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe4fcc00640 1 -- 172.21.15.106:0/3329877866 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f000a640 con 0x7fe5000ce530 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe4fcc00640 1 -- 172.21.15.106:0/3329877866 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000aa30 con 0x7fe5000ce530 2024-04-26T21:17:33.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5000c6a40 con 0x7fe5000ce530 2024-04-26T21:17:33.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5000c7000 con 0x7fe5000ce530 2024-04-26T21:17:33.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe500069400 con 0x7fe5000ce530 2024-04-26T21:17:33.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.434+0000 7fe4fcc00640 1 -- 172.21.15.106:0/3329877866 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4f000abd0 con 0x7fe5000ce530 2024-04-26T21:17:33.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.438+0000 7fe4fcc00640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe4e0068380 0x7fe4e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:33.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.438+0000 7fe4fcc00640 1 -- 172.21.15.106:0/3329877866 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6383+0+0 (secure 0 0 0) 0x7fe4f0086310 con 0x7fe5000ce530 2024-04-26T21:17:33.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.438+0000 7fe4ffe00640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe4e0068380 0x7fe4e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:33.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.438+0000 7fe4ffe00640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe4e0068380 0x7fe4e006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0af000 tx=0x7fe4ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:33.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.442+0000 7fe4fcc00640 1 -- 172.21.15.106:0/3329877866 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe4f0056630 con 0x7fe5000ce530 2024-04-26T21:17:33.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:33.598+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe50006f500 con 0x7fe5000ce530 2024-04-26T21:17:34.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.250+0000 7fe4fcc00640 1 -- 172.21.15.106:0/3329877866 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7fe4f0055f30 con 0x7fe5000ce530 2024-04-26T21:17:34.254 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' removed 2024-04-26T21:17:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.250+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe4e0068380 msgr2=0x7fe4e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.250+0000 7fe507800640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe4e0068380 0x7fe4e006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0af000 tx=0x7fe4ec008040 comp rx=0 tx=0).stop 2024-04-26T21:17:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.250+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000ce530 msgr2=0x7fe50015ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:34.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.250+0000 7fe507800640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000ce530 0x7fe50015ec90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000c7c0 tx=0x7fe4f000cc80 comp rx=0 tx=0).stop 2024-04-26T21:17:34.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.254+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 shutdown_connections 2024-04-26T21:17:34.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.254+0000 7fe507800640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe50015d140 0x7fe500157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:34.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.254+0000 7fe507800640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe4e0068380 0x7fe4e006a840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:34.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.254+0000 7fe507800640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe5000d13b0 0x7fe5001579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:34.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.254+0000 7fe507800640 1 --2- 172.21.15.106:0/3329877866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5000ce530 0x7fe50015ec90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:34.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.254+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 >> 172.21.15.106:0/3329877866 conn(0x7fe5000d2dd0 msgr2=0x7fe50015be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:34.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.254+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 shutdown_connections 2024-04-26T21:17:34.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.254+0000 7fe507800640 1 -- 172.21.15.106:0/3329877866 wait complete. 2024-04-26T21:17:34.280 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-26T21:17:34.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc9e400640 1 Processor -- start 2024-04-26T21:17:34.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc9e400640 1 -- start start 2024-04-26T21:17:34.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc9e400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcc9806e490 0x7fcc980d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:34.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc9e400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc980ce580 0x7fcc980d1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:34.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc9e400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc98162bd0 con 0x7fcc981627f0 2024-04-26T21:17:34.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc9e400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fcc9806dac0 con 0x7fcc9806e490 2024-04-26T21:17:34.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc9e400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcc980d01c0 con 0x7fcc980ce580 2024-04-26T21:17:34.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc8ea00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcc9806e490 0x7fcc980d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:34.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc8ea00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcc9806e490 0x7fcc980d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55864/0 (socket says 172.21.15.106:55864) 2024-04-26T21:17:34.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc8ea00640 1 -- 172.21.15.106:0/1672918412 learned_addr learned my addr 172.21.15.106:0/1672918412 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:34.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc97e00640 1 --2- 172.21.15.106:0/1672918412 >> v2:172.21.15.112:3300/0 conn(0x7fcc980ce580 0x7fcc980d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:34.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc8ea00640 1 -- 172.21.15.106:0/1672918412 >> v2:172.21.15.112:3300/0 conn(0x7fcc980ce580 msgr2=0x7fcc980d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:34.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc8ea00640 1 --2- 172.21.15.106:0/1672918412 >> v2:172.21.15.112:3300/0 conn(0x7fcc980ce580 0x7fcc980d1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:34.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc8ea00640 1 -- 172.21.15.106:0/1672918412 >> v1:172.21.15.112:6789/0 conn(0x7fcc981627f0 legacy=0x7fcc9806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:34.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.430+0000 7fcc8ea00640 1 -- 172.21.15.106:0/1672918412 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc980d04a0 con 0x7fcc9806e490 2024-04-26T21:17:34.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc8ea00640 1 --2- 172.21.15.106:0/1672918412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc9806e490 0x7fcc980d10d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcc98073340 tx=0x7fcc8001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9571194212a077e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:34.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc96a00640 1 -- 172.21.15.106:0/1672918412 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc800b5070 con 0x7fcc9806e490 2024-04-26T21:17:34.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc96a00640 1 -- 172.21.15.106:0/1672918412 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc800a8a10 con 0x7fcc9806e490 2024-04-26T21:17:34.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc96a00640 1 -- 172.21.15.106:0/1672918412 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc800a8de0 con 0x7fcc9806e490 2024-04-26T21:17:34.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc9e400640 1 -- 172.21.15.106:0/1672918412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc9806e490 msgr2=0x7fcc980d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:34.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc9e400640 1 --2- 172.21.15.106:0/1672918412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc9806e490 0x7fcc980d10d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcc98073340 tx=0x7fcc8001ed10 comp rx=0 tx=0).stop 2024-04-26T21:17:34.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc9e400640 1 -- 172.21.15.106:0/1672918412 shutdown_connections 2024-04-26T21:17:34.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc9e400640 1 --2- 172.21.15.106:0/1672918412 >> v2:172.21.15.112:3300/0 conn(0x7fcc980ce580 0x7fcc980d1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:34.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc9e400640 1 --2- 172.21.15.106:0/1672918412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc9806e490 0x7fcc980d10d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:34.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc9e400640 1 -- 172.21.15.106:0/1672918412 >> 172.21.15.106:0/1672918412 conn(0x7fcc980d2db0 msgr2=0x7fcc980d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:34.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc9e400640 1 -- 172.21.15.106:0/1672918412 shutdown_connections 2024-04-26T21:17:34.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.434+0000 7fcc9e400640 1 -- 172.21.15.106:0/1672918412 wait complete. 2024-04-26T21:17:34.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 Processor -- start 2024-04-26T21:17:34.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 -- start start 2024-04-26T21:17:34.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9806e490 0x7fcc980c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:34.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc980ce580 0x7fcc98155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:34.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc981627f0 0x7fcc9815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:34.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcc980b43a0 con 0x7fcc981627f0 2024-04-26T21:17:34.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9806d750 con 0x7fcc980ce580 2024-04-26T21:17:34.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcc980b4520 con 0x7fcc9806e490 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc981627f0 0x7fcc9815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc981627f0 0x7fcc9815c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55878/0 (socket says 172.21.15.106:55878) 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97e00640 1 -- 172.21.15.106:0/4090560022 learned_addr learned my addr 172.21.15.106:0/4090560022 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9806e490 0x7fcc980c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc8ea00640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc980ce580 0x7fcc98155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97e00640 1 -- 172.21.15.106:0/4090560022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9806e490 msgr2=0x7fcc980c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97e00640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9806e490 0x7fcc980c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97e00640 1 -- 172.21.15.106:0/4090560022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc980ce580 msgr2=0x7fcc98155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97e00640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc980ce580 0x7fcc98155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97e00640 1 -- 172.21.15.106:0/4090560022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc98069d20 con 0x7fcc981627f0 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9806e490 0x7fcc980c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:34.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc97e00640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc981627f0 0x7fcc9815c7f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcc90007e30 tx=0x7fcc9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:34.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc8fe00640 1 -- 172.21.15.106:0/4090560022 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90014620 con 0x7fcc981627f0 2024-04-26T21:17:34.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc8fe00640 1 -- 172.21.15.106:0/4090560022 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc90019070 con 0x7fcc981627f0 2024-04-26T21:17:34.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc980b8190 con 0x7fcc981627f0 2024-04-26T21:17:34.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc8fe00640 1 -- 172.21.15.106:0/4090560022 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90014a00 con 0x7fcc981627f0 2024-04-26T21:17:34.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.438+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc980b8750 con 0x7fcc981627f0 2024-04-26T21:17:34.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.442+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc98069400 con 0x7fcc981627f0 2024-04-26T21:17:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.442+0000 7fcc8fe00640 1 -- 172.21.15.106:0/4090560022 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc90014ba0 con 0x7fcc981627f0 2024-04-26T21:17:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.442+0000 7fcc8fe00640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc74068380 0x7fcc7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.442+0000 7fcc8fe00640 1 -- 172.21.15.106:0/4090560022 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5853+0+0 (secure 0 0 0) 0x7fcc90087270 con 0x7fcc981627f0 2024-04-26T21:17:34.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.442+0000 7fcc97400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc74068380 0x7fcc7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:34.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.442+0000 7fcc97400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc74068380 0x7fcc7406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcc88001670 tx=0x7fcc88009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:34.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.446+0000 7fcc8fe00640 1 -- 172.21.15.106:0/4090560022 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcc90057790 con 0x7fcc981627f0 2024-04-26T21:17:34.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:34.606+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcc980743e0 con 0x7fcc981627f0 2024-04-26T21:17:35.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.266+0000 7fcc8fe00640 1 -- 172.21.15.106:0/4090560022 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7fcc90057090 con 0x7fcc981627f0 2024-04-26T21:17:35.271 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data_ec' removed 2024-04-26T21:17:35.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.270+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc74068380 msgr2=0x7fcc7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:35.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.270+0000 7fcc9e400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc74068380 0x7fcc7406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcc88001670 tx=0x7fcc88009040 comp rx=0 tx=0).stop 2024-04-26T21:17:35.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.270+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc981627f0 msgr2=0x7fcc9815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:35.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.270+0000 7fcc9e400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc981627f0 0x7fcc9815c7f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcc90007e30 tx=0x7fcc9000e4b0 comp rx=0 tx=0).stop 2024-04-26T21:17:35.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.274+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 shutdown_connections 2024-04-26T21:17:35.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.274+0000 7fcc9e400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc980ce580 0x7fcc98155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:35.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.274+0000 7fcc9e400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcc74068380 0x7fcc7406a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:35.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.274+0000 7fcc9e400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc981627f0 0x7fcc9815c7f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:35.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.274+0000 7fcc9e400640 1 --2- 172.21.15.106:0/4090560022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcc9806e490 0x7fcc980c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:35.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.274+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 >> 172.21.15.106:0/4090560022 conn(0x7fcc980d2db0 msgr2=0x7fcc980d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:35.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.274+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 shutdown_connections 2024-04-26T21:17:35.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.274+0000 7fcc9e400640 1 -- 172.21.15.106:0/4090560022 wait complete. 2024-04-26T21:17:35.302 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T21:17:35.302 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T21:17:35.302 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T21:17:35.302 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:17:35.302 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T21:17:35.302 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T21:17:35.302 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T21:17:35.303 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:17:35.303 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T21:17:35.303 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T21:17:35.303 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T21:17:35.303 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:17:35.303 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T21:17:35.303 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T21:17:35.304 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T21:17:35.304 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:17:35.318 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T21:17:35.319 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T21:17:35.320 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T21:17:35.320 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T21:17:35.321 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T21:17:35.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T21:17:35.322 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T21:17:35.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T21:17:35.363 INFO:tasks.ceph.mds.a:Started 2024-04-26T21:17:35.363 DEBUG:teuthology.parallel:result is None 2024-04-26T21:17:35.364 INFO:tasks.ceph.mds.c:Started 2024-04-26T21:17:35.364 DEBUG:teuthology.parallel:result is None 2024-04-26T21:17:35.369 INFO:tasks.ceph.mds.d:Started 2024-04-26T21:17:35.369 DEBUG:teuthology.parallel:result is None 2024-04-26T21:17:35.371 INFO:tasks.ceph.mds.b:Started 2024-04-26T21:17:35.371 DEBUG:teuthology.parallel:result is None 2024-04-26T21:17:35.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T21:17:35.451 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2024-04-26T21:17:35.451 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2024-04-26T21:17:35.461 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2024-04-26T21:17:35.461 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-04-26T21:17:35.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1841c00640 1 Processor -- start 2024-04-26T21:17:35.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1841c00640 1 -- start start 2024-04-26T21:17:35.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1841c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f183c13f140 0x7f183c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:35.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1841c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c0b3d10 con 0x7f183c06eb70 2024-04-26T21:17:35.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1841c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c0b3ff0 con 0x7f183c13ed60 2024-04-26T21:17:35.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1841c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f183c0b3ac0 con 0x7f183c13f140 2024-04-26T21:17:35.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f183b400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f183c06eb70 0x7f183c0d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41598/0 (socket says 172.21.15.106:41598) 2024-04-26T21:17:35.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f183b400640 1 -- 172.21.15.106:0/3490314187 learned_addr learned my addr 172.21.15.106:0/3490314187 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f183a000640 1 --2- 172.21.15.106:0/3490314187 >> v2:172.21.15.112:3300/0 conn(0x7f183c13f140 0x7f183c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1839600640 1 -- 172.21.15.106:0/3490314187 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451141920 0 0) 0x7f183c0b3d10 con 0x7f183c06eb70 2024-04-26T21:17:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1839600640 1 -- 172.21.15.106:0/3490314187 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1820003530 con 0x7f183c06eb70 2024-04-26T21:17:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1839600640 1 -- 172.21.15.106:0/3490314187 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705592934 0 0) 0x7f183c0b3ff0 con 0x7f183c13ed60 2024-04-26T21:17:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1839600640 1 -- 172.21.15.106:0/3490314187 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f183c0b3d10 con 0x7f183c13ed60 2024-04-26T21:17:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f183a000640 1 -- 172.21.15.106:0/3490314187 >> v1:172.21.15.112:6789/0 conn(0x7f183c13ed60 legacy=0x7f183c0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f1839600640 1 -- 172.21.15.106:0/3490314187 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3535342320 0 0) 0x7f1820003530 con 0x7f183c06eb70 2024-04-26T21:17:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f183a000640 1 -- 172.21.15.106:0/3490314187 >> v1:172.21.15.106:6789/0 conn(0x7f183c06eb70 legacy=0x7f183c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.514+0000 7f183a000640 1 -- 172.21.15.106:0/3490314187 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c0b42d0 con 0x7f183c13f140 2024-04-26T21:17:35.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f183a000640 1 --2- 172.21.15.106:0/3490314187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c13f140 0x7f183c15c3e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f18280097c0 tx=0x7f182801c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b06c7f9984ab3107 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:35.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1839600640 1 -- 172.21.15.106:0/3490314187 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18280b0070 con 0x7f183c13f140 2024-04-26T21:17:35.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1839600640 1 -- 172.21.15.106:0/3490314187 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18280ab400 con 0x7f183c13f140 2024-04-26T21:17:35.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1839600640 1 -- 172.21.15.106:0/3490314187 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834001a00 con 0x7f183c13f140 2024-04-26T21:17:35.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1841c00640 1 -- 172.21.15.106:0/3490314187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c13f140 msgr2=0x7f183c15c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:35.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1841c00640 1 --2- 172.21.15.106:0/3490314187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c13f140 0x7f183c15c3e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f18280097c0 tx=0x7f182801c2a0 comp rx=0 tx=0).stop 2024-04-26T21:17:35.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1841c00640 1 -- 172.21.15.106:0/3490314187 shutdown_connections 2024-04-26T21:17:35.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1841c00640 1 --2- 172.21.15.106:0/3490314187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c13f140 0x7f183c15c3e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:35.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1841c00640 1 -- 172.21.15.106:0/3490314187 >> 172.21.15.106:0/3490314187 conn(0x7f183c068340 msgr2=0x7f183c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:35.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1841c00640 1 -- 172.21.15.106:0/3490314187 shutdown_connections 2024-04-26T21:17:35.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1841c00640 1 -- 172.21.15.106:0/3490314187 wait complete. 2024-04-26T21:17:35.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.518+0000 7f1841c00640 1 Processor -- start 2024-04-26T21:17:35.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 -- start start 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13ed60 0x7f183c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c140970 0x7f183c13f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13fa70 0x7f183c13ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f183c160400 con 0x7f183c13fa70 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f183c0d1710 con 0x7f183c140970 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f183c160580 con 0x7f183c13ed60 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13fa70 0x7f183c13ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c140970 0x7f183c13f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183aa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13ed60 0x7f183c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183a000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c140970 0x7f183c13f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:54504/0 (socket says 172.21.15.106:54504) 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183a000640 1 -- 172.21.15.106:0/3833661782 learned_addr learned my addr 172.21.15.106:0/3833661782 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:35.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183a000640 1 -- 172.21.15.106:0/3833661782 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13ed60 msgr2=0x7f183c15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183a000640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13ed60 0x7f183c15b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183a000640 1 -- 172.21.15.106:0/3833661782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13fa70 msgr2=0x7f183c13ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183a000640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13fa70 0x7f183c13ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183a000640 1 -- 172.21.15.106:0/3833661782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c142430 con 0x7f183c140970 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f183a000640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c140970 0x7f183c13f530 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18280097c0 tx=0x7f182801aae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1832a00640 1 -- 172.21.15.106:0/3833661782 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18280bb020 con 0x7f183c140970 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1832a00640 1 -- 172.21.15.106:0/3833661782 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18280b1040 con 0x7f183c140970 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c0b2230 con 0x7f183c140970 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1832a00640 1 -- 172.21.15.106:0/3833661782 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18280b0050 con 0x7f183c140970 2024-04-26T21:17:35.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c0b27f0 con 0x7f183c140970 2024-04-26T21:17:35.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.522+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183c069400 con 0x7f183c140970 2024-04-26T21:17:35.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.526+0000 7f1832a00640 1 -- 172.21.15.106:0/3833661782 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18280be070 con 0x7f183c140970 2024-04-26T21:17:35.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.526+0000 7f1832a00640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f181c068380 0x7f181c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:35.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.526+0000 7f1832a00640 1 -- 172.21.15.106:0/3833661782 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5335+0+0 (secure 0 0 0) 0x7f182811fd40 con 0x7f183c140970 2024-04-26T21:17:35.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.526+0000 7f183aa00640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f181c068380 0x7f181c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:35.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.526+0000 7f183aa00640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f181c068380 0x7f181c06a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f182c0011f0 tx=0x7f182c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:35.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.530+0000 7f1832a00640 1 -- 172.21.15.106:0/3833661782 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1828015fb0 con 0x7f183c140970 2024-04-26T21:17:35.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:35.698+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f183c06c830 con 0x7f183c140970 2024-04-26T21:17:36.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1832a00640 1 -- 172.21.15.106:0/3833661782 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7f18280efe90 con 0x7f183c140970 2024-04-26T21:17:36.293 INFO:teuthology.orchestra.run.smithi106.stderr: removed all blocklist entries 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f181c068380 msgr2=0x7f181c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f181c068380 0x7f181c06a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f182c0011f0 tx=0x7f182c009040 comp rx=0 tx=0).stop 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c140970 msgr2=0x7f183c13f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c140970 0x7f183c13f530 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18280097c0 tx=0x7f182801aae0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 shutdown_connections 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c140970 0x7f183c13f530 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f181c068380 0x7f181c06a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13fa70 0x7f183c13ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 --2- 172.21.15.106:0/3833661782 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13ed60 0x7f183c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 >> 172.21.15.106:0/3833661782 conn(0x7f183c068340 msgr2=0x7f183c0ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 shutdown_connections 2024-04-26T21:17:36.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.290+0000 7f1841c00640 1 -- 172.21.15.106:0/3833661782 wait complete. 2024-04-26T21:17:36.319 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T21:17:36.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff12d400640 1 Processor -- start 2024-04-26T21:17:36.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff12d400640 1 -- start start 2024-04-26T21:17:36.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff12d400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff128160870 0x7ff1280cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff12d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff1280d3850 0x7ff1280cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff12d400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff128160c50 con 0x7ff1280b3d80 2024-04-26T21:17:36.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff12d400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7ff1280b3960 con 0x7ff1280d3850 2024-04-26T21:17:36.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff12d400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff1280ce560 con 0x7ff128160870 2024-04-26T21:17:36.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff125e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff1280d3850 0x7ff1280cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff125e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff1280d3850 0x7ff1280cfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55946/0 (socket says 172.21.15.106:55946) 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff125e00640 1 -- 172.21.15.106:0/2578427654 learned_addr learned my addr 172.21.15.106:0/2578427654 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff126800640 1 --2- 172.21.15.106:0/2578427654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff128160870 0x7ff1280cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff125e00640 1 -- 172.21.15.106:0/2578427654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff128160870 msgr2=0x7ff1280cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff125e00640 1 --2- 172.21.15.106:0/2578427654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff128160870 0x7ff1280cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff125e00640 1 -- 172.21.15.106:0/2578427654 >> v1:172.21.15.112:6789/0 conn(0x7ff1280b3d80 legacy=0x7ff1280b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.458+0000 7ff125e00640 1 -- 172.21.15.106:0/2578427654 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1280ced60 con 0x7ff1280d3850 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff125e00640 1 --2- 172.21.15.106:0/2578427654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1280d3850 0x7ff1280cfbd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff114009870 tx=0x7ff11401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a629b92561d02b53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff125400640 1 -- 172.21.15.106:0/2578427654 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1140aa650 con 0x7ff1280d3850 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff125400640 1 -- 172.21.15.106:0/2578427654 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1140af070 con 0x7ff1280d3850 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff125400640 1 -- 172.21.15.106:0/2578427654 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1140aaa10 con 0x7ff1280d3850 2024-04-26T21:17:36.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff12d400640 1 -- 172.21.15.106:0/2578427654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1280d3850 msgr2=0x7ff1280cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff12d400640 1 --2- 172.21.15.106:0/2578427654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1280d3850 0x7ff1280cfbd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff114009870 tx=0x7ff11401c4d0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff12d400640 1 -- 172.21.15.106:0/2578427654 shutdown_connections 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff12d400640 1 --2- 172.21.15.106:0/2578427654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1280d3850 0x7ff1280cfbd0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff12d400640 1 --2- 172.21.15.106:0/2578427654 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff128160870 0x7ff1280cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff12d400640 1 -- 172.21.15.106:0/2578427654 >> 172.21.15.106:0/2578427654 conn(0x7ff1280d2d30 msgr2=0x7ff1280d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff12d400640 1 -- 172.21.15.106:0/2578427654 shutdown_connections 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.462+0000 7ff12d400640 1 -- 172.21.15.106:0/2578427654 wait complete. 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 Processor -- start 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 -- start start 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1280b3d80 0x7ff128150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1280d3850 0x7ff128159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff128160870 0x7ff12815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff12816a060 con 0x7ff128160870 2024-04-26T21:17:36.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff128169ee0 con 0x7ff1280d3850 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff12816a1e0 con 0x7ff1280b3d80 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff127200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff128160870 0x7ff12815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff127200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff128160870 0x7ff12815a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55956/0 (socket says 172.21.15.106:55956) 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff127200640 1 -- 172.21.15.106:0/3922556311 learned_addr learned my addr 172.21.15.106:0/3922556311 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff126800640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1280b3d80 0x7ff128150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff125e00640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1280d3850 0x7ff128159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff127200640 1 -- 172.21.15.106:0/3922556311 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1280b3d80 msgr2=0x7ff128150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff127200640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1280b3d80 0x7ff128150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff127200640 1 -- 172.21.15.106:0/3922556311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1280d3850 msgr2=0x7ff128159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff127200640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1280d3850 0x7ff128159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff127200640 1 -- 172.21.15.106:0/3922556311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12806e880 con 0x7ff128160870 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff127200640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff128160870 0x7ff12815a2c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c730 tx=0x7ff12000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:36.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff11ea00640 1 -- 172.21.15.106:0/3922556311 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120003b80 con 0x7ff128160870 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff11ea00640 1 -- 172.21.15.106:0/3922556311 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff120003d20 con 0x7ff128160870 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12806eb60 con 0x7ff128160870 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff11ea00640 1 -- 172.21.15.106:0/3922556311 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12000aa30 con 0x7ff128160870 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.466+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12806f120 con 0x7ff128160870 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.470+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff128150ae0 con 0x7ff128160870 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.470+0000 7ff11ea00640 1 -- 172.21.15.106:0/3922556311 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff12000abd0 con 0x7ff128160870 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.470+0000 7ff11ea00640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff108068380 0x7ff10806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.470+0000 7ff11ea00640 1 -- 172.21.15.106:0/3922556311 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7ff120086580 con 0x7ff128160870 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.470+0000 7ff126800640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff108068380 0x7ff10806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.470+0000 7ff126800640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff108068380 0x7ff10806a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff128154240 tx=0x7ff118009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:36.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.474+0000 7ff11ea00640 1 -- 172.21.15.106:0/3922556311 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff1200566a0 con 0x7ff128160870 2024-04-26T21:17:36.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.686+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff1280d3450 con 0x7ff128160870 2024-04-26T21:17:36.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff11ea00640 1 -- 172.21.15.106:0/3922556311 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7ff12005a9a0 con 0x7ff128160870 2024-04-26T21:17:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_dump": [ 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.a", 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBoGSxmnbpbNxAA6IhzZVttczJ4W9ZegusRwQ==", 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.b", 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBpGSxmqlzZBxAASIBcd9DmmH4bKcVx9oJQnA==", 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.c", 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBpGSxms2DKAhAAaYPDF5kr0yMcSmaaxTenZA==", 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-26T21:17:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.d", 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBpGSxmZkBsDxAA8RNfO768W8MptEyf0cNfig==", 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.0", 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBsGSxmhIAzFBAAA1H5RPuRhAa9unrw5v6JCA==", 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.1", 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBvGSxmMev4HRAAYhzGkK4NntrR6yYuI2Lcmg==", 2024-04-26T21:17:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.2", 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQByGSxmnBTBJxAA8tHpRJt1Uhf3zaURRbj3Iw==", 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.3", 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB1GSxmSyZpMhAAqZiGb8nu+njwjeOs8WXgBQ==", 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.4", 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB7GSxmB1LiKxAASugvjg0sVjd9vbVdVai3OA==", 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.5", 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB+GSxmSK/GNRAAxAHGFJYYoK1p/y4I80OCuQ==", 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.6", 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCCGSxmC1nkAxAA3TobMviF29A7UhoApCQhrA==", 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.7", 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCFGSxmWLqfDhAAKO37vykZrkZfsGhqx0q1RA==", 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.0", 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBpGSxm3sFdExAA7AIaf9qeEkhvJ9xnUUughQ==", 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.1", 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBpGSxmR1kkHRAAHoaB8Q0JDmCjiHbkvqaPJQ==", 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.2", 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBpGSxmNVKaGRAAbKbqflqQLfM3C8nCrieanQ==", 2024-04-26T21:17:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.3", 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBpGSxmtwYUIxAAfda0bVIXrlLN2eszizMxjg==", 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2024-04-26T21:17:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.admin", 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBoGSxmFD51GxAAte77seHNO9pfMFIwHqutMg==", 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mds", 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCLGSxm5oXODhAALnW6/7Q9RUwY+lb3+y+M3g==", 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mds" 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mgr", 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCLGSxmPJbODhAAKulIoEV0WOrdFFnwLdtqPw==", 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-osd", 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCLGSxmbKXODhAAHhiWPGEU8MrqlDq6dGVntA==", 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-osd" 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd", 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCLGSxm9LPODhAAMGADA1MgXO5UJlZ7UHkfog==", 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-26T21:17:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCLGSxmqcLODhAANxkWnWVW0FPongwJpJQo8w==", 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rgw", 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCLGSxmDMzODhAAzmAvBq3YG/H7gvADRdwCcA==", 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.x", 2024-04-26T21:17:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBoGSxm0GE8MxAAbIj4gFsieRfEpHtaP1m8pw==", 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.y", 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBoGSxmAJ1bLxAAyeY9mTV5xOUJ3pD75ezI1Q==", 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-04-26T21:17:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T21:17:36.709 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:17:36.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff108068380 msgr2=0x7ff10806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff108068380 0x7ff10806a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff128154240 tx=0x7ff118009190 comp rx=0 tx=0).stop 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff128160870 msgr2=0x7ff12815a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff128160870 0x7ff12815a2c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c730 tx=0x7ff12000cbf0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 shutdown_connections 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1280d3850 0x7ff128159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff108068380 0x7ff10806a840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff128160870 0x7ff12815a2c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 --2- 172.21.15.106:0/3922556311 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1280b3d80 0x7ff128150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 >> 172.21.15.106:0/3922556311 conn(0x7ff1280d2d30 msgr2=0x7ff12815ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 shutdown_connections 2024-04-26T21:17:36.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.690+0000 7ff12d400640 1 -- 172.21.15.106:0/3922556311 wait complete. 2024-04-26T21:17:36.713 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-26T21:17:36.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f347d400640 1 Processor -- start 2024-04-26T21:17:36.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f347d400640 1 -- start start 2024-04-26T21:17:36.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f347d400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f347813ed60 0x7f347815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f347d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f347813f140 0x7f34780b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f347d400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f347806eb70 0x7f34780d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f347d400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f34780b3ac0 con 0x7f347813f140 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f347d400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f34780b4920 con 0x7f347813ed60 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f347d400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f34780b3d10 con 0x7f347806eb70 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f346de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f347813f140 0x7f34780b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f346de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f347813f140 0x7f34780b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55960/0 (socket says 172.21.15.106:55960) 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.846+0000 7f346de00640 1 -- 172.21.15.106:0/358041430 learned_addr learned my addr 172.21.15.106:0/358041430 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f3477200640 1 --2- 172.21.15.106:0/358041430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f347806eb70 0x7f34780d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f3476800640 1 --2- 172.21.15.106:0/358041430 >> v2:172.21.15.112:3300/0 conn(0x7f347813ed60 0x7f347815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f346de00640 1 -- 172.21.15.106:0/358041430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f347806eb70 msgr2=0x7f34780d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f346de00640 1 --2- 172.21.15.106:0/358041430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f347806eb70 0x7f34780d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f346de00640 1 -- 172.21.15.106:0/358041430 >> v2:172.21.15.112:3300/0 conn(0x7f347813ed60 msgr2=0x7f347815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:36.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f346de00640 1 --2- 172.21.15.106:0/358041430 >> v2:172.21.15.112:3300/0 conn(0x7f347813ed60 0x7f347815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f346de00640 1 -- 172.21.15.106:0/358041430 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34780b3ff0 con 0x7f347813f140 2024-04-26T21:17:36.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f3476800640 1 --2- 172.21.15.106:0/358041430 >> v2:172.21.15.112:3300/0 conn(0x7f347813ed60 0x7f347815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:36.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f346de00640 1 --2- 172.21.15.106:0/358041430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813f140 0x7f34780b52e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3478074400 tx=0x7f346001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0df8e948697f70b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:36.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f3475e00640 1 -- 172.21.15.106:0/358041430 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600b0070 con 0x7f347813f140 2024-04-26T21:17:36.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f3475e00640 1 -- 172.21.15.106:0/358041430 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34600a4e50 con 0x7f347813f140 2024-04-26T21:17:36.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f3475e00640 1 -- 172.21.15.106:0/358041430 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600ab820 con 0x7f347813f140 2024-04-26T21:17:36.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f347d400640 1 -- 172.21.15.106:0/358041430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813f140 msgr2=0x7f34780b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.850+0000 7f347d400640 1 --2- 172.21.15.106:0/358041430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813f140 0x7f34780b52e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3478074400 tx=0x7f346001c400 comp rx=0 tx=0).stop 2024-04-26T21:17:36.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 -- 172.21.15.106:0/358041430 shutdown_connections 2024-04-26T21:17:36.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 --2- 172.21.15.106:0/358041430 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f347806eb70 0x7f34780d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 --2- 172.21.15.106:0/358041430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813f140 0x7f34780b52e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 --2- 172.21.15.106:0/358041430 >> v2:172.21.15.112:3300/0 conn(0x7f347813ed60 0x7f347815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 -- 172.21.15.106:0/358041430 >> 172.21.15.106:0/358041430 conn(0x7f3478068340 msgr2=0x7f3478068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:36.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 -- 172.21.15.106:0/358041430 shutdown_connections 2024-04-26T21:17:36.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 -- 172.21.15.106:0/358041430 wait complete. 2024-04-26T21:17:36.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 Processor -- start 2024-04-26T21:17:36.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 -- start start 2024-04-26T21:17:36.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813ed60 0x7f347813e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34781456b0 0x7f3478164c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34781f73c0 0x7f34781651d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3478160580 con 0x7f347813ed60 2024-04-26T21:17:36.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3478160400 con 0x7f34781f73c0 2024-04-26T21:17:36.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f347d400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3478160700 con 0x7f34781456b0 2024-04-26T21:17:36.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3476800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813ed60 0x7f347813e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3476800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813ed60 0x7f347813e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55968/0 (socket says 172.21.15.106:55968) 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3476800640 1 -- 172.21.15.106:0/1064821021 learned_addr learned my addr 172.21.15.106:0/1064821021 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f346de00640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34781456b0 0x7f3478164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3477200640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34781f73c0 0x7f34781651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3476800640 1 -- 172.21.15.106:0/1064821021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34781456b0 msgr2=0x7f3478164c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3476800640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34781456b0 0x7f3478164c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3476800640 1 -- 172.21.15.106:0/1064821021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34781f73c0 msgr2=0x7f34781651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3476800640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34781f73c0 0x7f34781651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3476800640 1 -- 172.21.15.106:0/1064821021 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34780d1130 con 0x7f347813ed60 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f3476800640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813ed60 0x7f347813e060 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f346800c7f0 tx=0x7f346800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f346f400640 1 -- 172.21.15.106:0/1064821021 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468007a30 con 0x7f347813ed60 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f346f400640 1 -- 172.21.15.106:0/1064821021 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3468007bd0 con 0x7f347813ed60 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.854+0000 7f346f400640 1 -- 172.21.15.106:0/1064821021 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34680113f0 con 0x7f347813ed60 2024-04-26T21:17:36.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.858+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34781f8380 con 0x7f347813ed60 2024-04-26T21:17:36.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.858+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34781f8940 con 0x7f347813ed60 2024-04-26T21:17:36.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.858+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3478069400 con 0x7f347813ed60 2024-04-26T21:17:36.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.858+0000 7f346f400640 1 -- 172.21.15.106:0/1064821021 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3468011590 con 0x7f347813ed60 2024-04-26T21:17:36.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.858+0000 7f346f400640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3454068380 0x7f345406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:36.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.858+0000 7f346f400640 1 -- 172.21.15.106:0/1064821021 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f3468086a30 con 0x7f347813ed60 2024-04-26T21:17:36.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.858+0000 7f346de00640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3454068380 0x7f345406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:36.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.858+0000 7f346de00640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3454068380 0x7f345406a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34600ad000 tx=0x7f34600a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:36.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:36.862+0000 7f346f400640 1 -- 172.21.15.106:0/1064821021 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3468015020 con 0x7f347813ed60 2024-04-26T21:17:37.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.074+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f3478068b40 con 0x7f347813ed60 2024-04-26T21:17:37.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.074+0000 7f346f400640 1 -- 172.21.15.106:0/1064821021 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f3468056a30 con 0x7f347813ed60 2024-04-26T21:17:37.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3454068380 msgr2=0x7f345406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3454068380 0x7f345406a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34600ad000 tx=0x7f34600a6000 comp rx=0 tx=0).stop 2024-04-26T21:17:37.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813ed60 msgr2=0x7f347813e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813ed60 0x7f347813e060 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f346800c7f0 tx=0x7f346800ccb0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 shutdown_connections 2024-04-26T21:17:37.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34781f73c0 0x7f34781651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3454068380 0x7f345406a840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34781456b0 0x7f3478164c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 --2- 172.21.15.106:0/1064821021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f347813ed60 0x7f347813e060 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 >> 172.21.15.106:0/1064821021 conn(0x7f3478068340 msgr2=0x7f347815eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:37.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 shutdown_connections 2024-04-26T21:17:37.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.078+0000 7f347d400640 1 -- 172.21.15.106:0/1064821021 wait complete. 2024-04-26T21:17:37.100 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-26T21:17:37.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa2ca00640 1 Processor -- start 2024-04-26T21:17:37.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa2ca00640 1 -- start start 2024-04-26T21:17:37.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa2ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faa2813ed60 0x7faa2815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa2ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2806eb70 0x7faa280d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa2ca00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa280b3d10 con 0x7faa2813f140 2024-04-26T21:17:37.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa2ca00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faa280b3ac0 con 0x7faa2813ed60 2024-04-26T21:17:37.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa2ca00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faa280b4920 con 0x7faa2806eb70 2024-04-26T21:17:37.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faa2813f140 0x7faa280b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43968/0 (socket says 172.21.15.106:43968) 2024-04-26T21:17:37.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25400640 1 -- 172.21.15.106:0/3895660022 learned_addr learned my addr 172.21.15.106:0/3895660022 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:37.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa26800640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2806eb70 0x7faa280d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25e00640 1 --2- 172.21.15.106:0/3895660022 >> v2:172.21.15.112:3300/0 conn(0x7faa2813ed60 0x7faa2815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 162225790 0 0) 0x7faa280b3d10 con 0x7faa2813f140 2024-04-26T21:17:37.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa0c005740 con 0x7faa2813f140 2024-04-26T21:17:37.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3351376234 0 0) 0x7faa0c005740 con 0x7faa2813f140 2024-04-26T21:17:37.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2806eb70 msgr2=0x7faa280d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:37.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2806eb70 0x7faa280d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 >> v2:172.21.15.112:3300/0 conn(0x7faa2813ed60 msgr2=0x7faa2815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 --2- 172.21.15.106:0/3895660022 >> v2:172.21.15.112:3300/0 conn(0x7faa2813ed60 0x7faa2815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa280b3ff0 con 0x7faa2813f140 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7faa14001680 con 0x7faa2813f140 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 >> v1:172.21.15.106:6789/0 conn(0x7faa2813f140 legacy=0x7faa280b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa0c005bd0 0x7faa0c006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa0c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa0c0073e0 0x7faa0c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faa280b3ac0 con 0x7faa0c006a20 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa280b4920 con 0x7faa0c005bd0 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c00e120 con 0x7faa0c0073e0 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25400640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa0c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25e00640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa0c005bd0 0x7faa0c006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa26800640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa0c0073e0 0x7faa0c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25400640 1 -- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa0c0073e0 msgr2=0x7faa0c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:37.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25400640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa0c0073e0 0x7faa0c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25400640 1 -- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa0c005bd0 msgr2=0x7faa0c006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:37.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25400640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa0c005bd0 0x7faa0c006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.234+0000 7faa25400640 1 -- 172.21.15.106:0/3895660022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c005740 con 0x7faa0c006a20 2024-04-26T21:17:37.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa25400640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa0c006ea0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faa1400c270 tx=0x7faa1401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b72ad90be12fbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:37.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14007d40 con 0x7faa0c006a20 2024-04-26T21:17:37.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa140a9020 con 0x7faa0c006a20 2024-04-26T21:17:37.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa24a00640 1 -- 172.21.15.106:0/3895660022 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140a5ba0 con 0x7faa0c006a20 2024-04-26T21:17:37.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa2ca00640 1 -- 172.21.15.106:0/3895660022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 msgr2=0x7faa0c006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa2ca00640 1 --2- 172.21.15.106:0/3895660022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa0c006ea0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faa1400c270 tx=0x7faa1401cca0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa26800640 1 -- 172.21.15.106:0/3895660022 reap_dead start 2024-04-26T21:17:37.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa2ca00640 1 -- 172.21.15.106:0/3895660022 shutdown_connections 2024-04-26T21:17:37.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa2ca00640 1 -- 172.21.15.106:0/3895660022 >> 172.21.15.106:0/3895660022 conn(0x7faa28068340 msgr2=0x7faa28068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:37.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa2ca00640 1 -- 172.21.15.106:0/3895660022 shutdown_connections 2024-04-26T21:17:37.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.238+0000 7faa2ca00640 1 -- 172.21.15.106:0/3895660022 wait complete. 2024-04-26T21:17:37.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 Processor -- start 2024-04-26T21:17:37.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 -- start start 2024-04-26T21:17:37.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa2813b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2815e290 0x7faa281fb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa2815e710 0x7faa281fb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faa2815ff80 con 0x7faa0c006a20 2024-04-26T21:17:37.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa2815fe00 con 0x7faa2815e710 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faa28160100 con 0x7faa2815e290 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa2813b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa2813b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34082/0 (socket says 172.21.15.106:34082) 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25e00640 1 -- 172.21.15.106:0/3761404376 learned_addr learned my addr 172.21.15.106:0/3761404376 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25400640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2815e290 0x7faa281fb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa26800640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa2815e710 0x7faa281fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25e00640 1 -- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2815e290 msgr2=0x7faa281fb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25e00640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2815e290 0x7faa281fb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25e00640 1 -- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa2815e710 msgr2=0x7faa281fb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25e00640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa2815e710 0x7faa281fb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25e00640 1 -- 172.21.15.106:0/3761404376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2813b7a0 con 0x7faa0c006a20 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25400640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2815e290 0x7faa281fb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa26800640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa2815e710 0x7faa281fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:37.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa25e00640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa2813b1c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faa180119d0 tx=0x7faa18011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:37.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa1e000640 1 -- 172.21.15.106:0/3761404376 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1800fb50 con 0x7faa0c006a20 2024-04-26T21:17:37.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa1e000640 1 -- 172.21.15.106:0/3761404376 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1800fcf0 con 0x7faa0c006a20 2024-04-26T21:17:37.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa280b0610 con 0x7faa0c006a20 2024-04-26T21:17:37.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa1e000640 1 -- 172.21.15.106:0/3761404376 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1800fea0 con 0x7faa0c006a20 2024-04-26T21:17:37.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.242+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa280b0bd0 con 0x7faa0c006a20 2024-04-26T21:17:37.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.246+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa28069400 con 0x7faa0c006a20 2024-04-26T21:17:37.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.246+0000 7faa1e000640 1 -- 172.21.15.106:0/3761404376 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa18012040 con 0x7faa0c006a20 2024-04-26T21:17:37.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.246+0000 7faa1e000640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa08068380 0x7faa0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.246+0000 7faa1e000640 1 -- 172.21.15.106:0/3761404376 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7faa180873b0 con 0x7faa0c006a20 2024-04-26T21:17:37.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.246+0000 7faa25400640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa08068380 0x7faa0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.246+0000 7faa25400640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa08068380 0x7faa0806a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faa140aa000 tx=0x7faa280b3ee0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:37.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.250+0000 7faa1e000640 1 -- 172.21.15.106:0/3761404376 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faa18019030 con 0x7faa0c006a20 2024-04-26T21:17:37.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.462+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7faa280aff30 con 0x7faa0c006a20 2024-04-26T21:17:37.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.466+0000 7faa1e000640 1 -- 172.21.15.106:0/3761404376 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7faa18057bd0 con 0x7faa0c006a20 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa08068380 msgr2=0x7faa0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa08068380 0x7faa0806a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faa140aa000 tx=0x7faa280b3ee0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 msgr2=0x7faa2813b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa2813b1c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faa180119d0 tx=0x7faa18011e90 comp rx=0 tx=0).stop 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 shutdown_connections 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa2815e710 0x7faa281fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faa08068380 0x7faa0806a840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa2815e290 0x7faa281fb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 --2- 172.21.15.106:0/3761404376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa0c006a20 0x7faa2813b1c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 >> 172.21.15.106:0/3761404376 conn(0x7faa28068340 msgr2=0x7faa280ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 shutdown_connections 2024-04-26T21:17:37.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.470+0000 7faa2ca00640 1 -- 172.21.15.106:0/3761404376 wait complete. 2024-04-26T21:17:37.491 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-26T21:17:37.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.622+0000 7f42cc000640 1 Processor -- start 2024-04-26T21:17:37.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42cc000640 1 -- start start 2024-04-26T21:17:37.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42cc000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f42c413ed60 0x7f42c415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42cc000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c406eb70 0x7f42c40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42cc000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c40b3d10 con 0x7f42c413f140 2024-04-26T21:17:37.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42cc000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f42c40b3ac0 con 0x7f42c413ed60 2024-04-26T21:17:37.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42cc000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42c40b4920 con 0x7f42c406eb70 2024-04-26T21:17:37.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42c9600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f42c413ed60 0x7f42c415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42c8c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f42c413f140 0x7f42c40b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43974/0 (socket says 172.21.15.106:43974) 2024-04-26T21:17:37.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42c8c00640 1 -- 172.21.15.106:0/821508470 learned_addr learned my addr 172.21.15.106:0/821508470 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:37.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42ca000640 1 --2- 172.21.15.106:0/821508470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c406eb70 0x7f42c40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42c9600640 1 -- 172.21.15.106:0/821508470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c406eb70 msgr2=0x7f42c40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:37.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42c9600640 1 --2- 172.21.15.106:0/821508470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c406eb70 0x7f42c40d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42c9600640 1 -- 172.21.15.106:0/821508470 >> v1:172.21.15.106:6789/0 conn(0x7f42c413f140 legacy=0x7f42c40b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42c9600640 1 -- 172.21.15.106:0/821508470 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c40b3ff0 con 0x7f42c413ed60 2024-04-26T21:17:37.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.626+0000 7f42c3e00640 1 -- 172.21.15.106:0/821508470 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059812945 0 0) 0x7f42c40b3d10 con 0x7f42c413f140 2024-04-26T21:17:37.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42c9600640 1 --2- 172.21.15.106:0/821508470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413ed60 0x7f42c415c3e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f42c40b3c40 tx=0x7f42b801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6121db85e72070f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:37.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42c3e00640 1 -- 172.21.15.106:0/821508470 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b80b0070 con 0x7f42c413ed60 2024-04-26T21:17:37.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42c3e00640 1 -- 172.21.15.106:0/821508470 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b80ab600 con 0x7f42c413ed60 2024-04-26T21:17:37.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42c3e00640 1 -- 172.21.15.106:0/821508470 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b80ab9d0 con 0x7f42c413ed60 2024-04-26T21:17:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 -- 172.21.15.106:0/821508470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413ed60 msgr2=0x7f42c415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 --2- 172.21.15.106:0/821508470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413ed60 0x7f42c415c3e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f42c40b3c40 tx=0x7f42b801c380 comp rx=0 tx=0).stop 2024-04-26T21:17:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 -- 172.21.15.106:0/821508470 shutdown_connections 2024-04-26T21:17:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 --2- 172.21.15.106:0/821508470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c406eb70 0x7f42c40d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 --2- 172.21.15.106:0/821508470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413ed60 0x7f42c415c3e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 -- 172.21.15.106:0/821508470 >> 172.21.15.106:0/821508470 conn(0x7f42c4068340 msgr2=0x7f42c4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 -- 172.21.15.106:0/821508470 shutdown_connections 2024-04-26T21:17:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 -- 172.21.15.106:0/821508470 wait complete. 2024-04-26T21:17:37.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 Processor -- start 2024-04-26T21:17:37.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.630+0000 7f42cc000640 1 -- start start 2024-04-26T21:17:37.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42cc000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c413ed60 0x7f42c4159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42cc000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413e120 0x7f42c4164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42cc000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c415a790 0x7f42c4164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42cc000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41607b0 con 0x7f42c413e120 2024-04-26T21:17:37.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42cc000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4160630 con 0x7f42c413ed60 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42cc000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42c4168b60 con 0x7f42c415a790 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413e120 0x7f42c4164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413e120 0x7f42c4164830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34098/0 (socket says 172.21.15.106:34098) 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c8c00640 1 -- 172.21.15.106:0/1297607478 learned_addr learned my addr 172.21.15.106:0/1297607478 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c9600640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c413ed60 0x7f42c4159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42ca000640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c415a790 0x7f42c4164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c8c00640 1 -- 172.21.15.106:0/1297607478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c415a790 msgr2=0x7f42c4164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c8c00640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c415a790 0x7f42c4164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c8c00640 1 -- 172.21.15.106:0/1297607478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c413ed60 msgr2=0x7f42c4159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c8c00640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c413ed60 0x7f42c4159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c8c00640 1 -- 172.21.15.106:0/1297607478 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c41652b0 con 0x7f42c413e120 2024-04-26T21:17:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c8c00640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413e120 0x7f42c4164830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f42b000c480 tx=0x7f42b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c1600640 1 -- 172.21.15.106:0/1297607478 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0018070 con 0x7f42c413e120 2024-04-26T21:17:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c1600640 1 -- 172.21.15.106:0/1297607478 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0007500 con 0x7f42c413e120 2024-04-26T21:17:37.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c4165570 con 0x7f42c413e120 2024-04-26T21:17:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c1600640 1 -- 172.21.15.106:0/1297607478 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0004a30 con 0x7f42c413e120 2024-04-26T21:17:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c4159e90 con 0x7f42c413e120 2024-04-26T21:17:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c4069400 con 0x7f42c413e120 2024-04-26T21:17:37.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.634+0000 7f42c1600640 1 -- 172.21.15.106:0/1297607478 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42b001b070 con 0x7f42c413e120 2024-04-26T21:17:37.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.638+0000 7f42c1600640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f42a4068380 0x7f42a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:37.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.638+0000 7f42c1600640 1 -- 172.21.15.106:0/1297607478 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f42b0085a60 con 0x7f42c413e120 2024-04-26T21:17:37.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.638+0000 7f42c9600640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f42a4068380 0x7f42a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:37.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.638+0000 7f42c9600640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f42a4068380 0x7f42a406a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f42b80ad000 tx=0x7f42b80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:37.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.642+0000 7f42c1600640 1 -- 172.21.15.106:0/1297607478 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f42b0055b80 con 0x7f42c413e120 2024-04-26T21:17:37.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.850+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f42c40aa4c0 con 0x7f42c413e120 2024-04-26T21:17:37.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.854+0000 7f42c1600640 1 -- 172.21.15.106:0/1297607478 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f42b0059e80 con 0x7f42c413e120 2024-04-26T21:17:37.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f42a4068380 msgr2=0x7f42a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f42a4068380 0x7f42a406a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f42b80ad000 tx=0x7f42b80a6000 comp rx=0 tx=0).stop 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413e120 msgr2=0x7f42c4164830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413e120 0x7f42c4164830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f42b000c480 tx=0x7f42b000c940 comp rx=0 tx=0).stop 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 shutdown_connections 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f42a4068380 0x7f42a406a840 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42c415a790 0x7f42c4164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42c413e120 0x7f42c4164830 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 --2- 172.21.15.106:0/1297607478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c413ed60 0x7f42c4159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 >> 172.21.15.106:0/1297607478 conn(0x7f42c4068340 msgr2=0x7f42c406f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 shutdown_connections 2024-04-26T21:17:37.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:37.858+0000 7f42cc000640 1 -- 172.21.15.106:0/1297607478 wait complete. 2024-04-26T21:17:37.879 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-26T21:17:38.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.010+0000 7f165ca00640 1 Processor -- start 2024-04-26T21:17:38.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.010+0000 7f165ca00640 1 -- start start 2024-04-26T21:17:38.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f165ca00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16581624a0 0x7f16580b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f165ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16580aeae0 0x7f16580b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f165ca00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f16580b3820 0x7f1658072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f165ca00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f16580b55e0 con 0x7f16580b3820 2024-04-26T21:17:38.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f165ca00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f16580b58c0 con 0x7f16581624a0 2024-04-26T21:17:38.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f165ca00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f16580b5ba0 con 0x7f16580aeae0 2024-04-26T21:17:38.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1656800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f16580b3820 0x7f1658072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1656800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f16580b3820 0x7f1658072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34104/0 (socket says 172.21.15.106:34104) 2024-04-26T21:17:38.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1656800640 1 -- 172.21.15.106:0/1997468361 learned_addr learned my addr 172.21.15.106:0/1997468361 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:38.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f164d400640 1 --2- 172.21.15.106:0/1997468361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16580aeae0 0x7f16580b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1655e00640 1 --2- 172.21.15.106:0/1997468361 >> v2:172.21.15.112:3300/0 conn(0x7f16581624a0 0x7f16580b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1656800640 1 -- 172.21.15.106:0/1997468361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16580aeae0 msgr2=0x7f16580b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:38.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1656800640 1 --2- 172.21.15.106:0/1997468361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16580aeae0 0x7f16580b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1656800640 1 -- 172.21.15.106:0/1997468361 >> v2:172.21.15.112:3300/0 conn(0x7f16581624a0 msgr2=0x7f16580b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:38.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1656800640 1 --2- 172.21.15.106:0/1997468361 >> v2:172.21.15.112:3300/0 conn(0x7f16581624a0 0x7f16580b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1656800640 1 -- 172.21.15.106:0/1997468361 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165806e810 con 0x7f16580b3820 2024-04-26T21:17:38.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1655e00640 1 --2- 172.21.15.106:0/1997468361 >> v2:172.21.15.112:3300/0 conn(0x7f16581624a0 0x7f16580b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:38.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.014+0000 7f1656800640 1 --2- 172.21.15.106:0/1997468361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 0x7f1658072750 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f165806d2c0 tx=0x7f165001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884c7d248a283167 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:38.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f1655400640 1 -- 172.21.15.106:0/1997468361 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16500ac020 con 0x7f16580b3820 2024-04-26T21:17:38.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f1655400640 1 -- 172.21.15.106:0/1997468361 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16500a6470 con 0x7f16580b3820 2024-04-26T21:17:38.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f1655400640 1 -- 172.21.15.106:0/1997468361 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16500a6840 con 0x7f16580b3820 2024-04-26T21:17:38.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 -- 172.21.15.106:0/1997468361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 msgr2=0x7f1658072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 --2- 172.21.15.106:0/1997468361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 0x7f1658072750 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f165806d2c0 tx=0x7f165001c730 comp rx=0 tx=0).stop 2024-04-26T21:17:38.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 -- 172.21.15.106:0/1997468361 shutdown_connections 2024-04-26T21:17:38.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 --2- 172.21.15.106:0/1997468361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 0x7f1658072750 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 --2- 172.21.15.106:0/1997468361 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16580aeae0 0x7f16580b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 --2- 172.21.15.106:0/1997468361 >> v2:172.21.15.112:3300/0 conn(0x7f16581624a0 0x7f16580b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 -- 172.21.15.106:0/1997468361 >> 172.21.15.106:0/1997468361 conn(0x7f165806c5d0 msgr2=0x7f165806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:38.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 -- 172.21.15.106:0/1997468361 shutdown_connections 2024-04-26T21:17:38.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 -- 172.21.15.106:0/1997468361 wait complete. 2024-04-26T21:17:38.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 Processor -- start 2024-04-26T21:17:38.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 -- start start 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16580aeae0 0x7f16580d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 0x7f165814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16581624a0 0x7f16580ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f165806f190 con 0x7f16580b3820 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f165806f010 con 0x7f16580aeae0 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f165ca00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f165806f310 con 0x7f16581624a0 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f164d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 0x7f165814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f164d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 0x7f165814cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34110/0 (socket says 172.21.15.106:34110) 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f164d400640 1 -- 172.21.15.106:0/2097188084 learned_addr learned my addr 172.21.15.106:0/2097188084 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f1655e00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16580aeae0 0x7f16580d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.018+0000 7f1656800640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16581624a0 0x7f16580ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164d400640 1 -- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16581624a0 msgr2=0x7f16580ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164d400640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16581624a0 0x7f16580ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164d400640 1 -- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16580aeae0 msgr2=0x7f16580d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164d400640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16580aeae0 0x7f16580d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164d400640 1 -- 172.21.15.106:0/2097188084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16580b1150 con 0x7f16580b3820 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f1655e00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16580aeae0 0x7f16580d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f1656800640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16581624a0 0x7f16580ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164d400640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 0x7f165814cb50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f164000d830 tx=0x7f164000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164ea00640 1 -- 172.21.15.106:0/2097188084 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640018020 con 0x7f16580b3820 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164ea00640 1 -- 172.21.15.106:0/2097188084 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16400096a0 con 0x7f16580b3820 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16580b1430 con 0x7f16580b3820 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164ea00640 1 -- 172.21.15.106:0/2097188084 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640009a50 con 0x7f16580b3820 2024-04-26T21:17:38.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165814c630 con 0x7f16580b3820 2024-04-26T21:17:38.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1658069400 con 0x7f16580b3820 2024-04-26T21:17:38.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164ea00640 1 -- 172.21.15.106:0/2097188084 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f164001b020 con 0x7f16580b3820 2024-04-26T21:17:38.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164ea00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1634068380 0x7f163406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f164ea00640 1 -- 172.21.15.106:0/2097188084 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f1640086dc0 con 0x7f16580b3820 2024-04-26T21:17:38.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.022+0000 7f1655e00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1634068380 0x7f163406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.026+0000 7f1655e00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1634068380 0x7f163406a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1658158ca0 tx=0x7f1648008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:38.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.026+0000 7f164ea00640 1 -- 172.21.15.106:0/2097188084 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1640022020 con 0x7f16580b3820 2024-04-26T21:17:38.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.238+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f1658161a90 con 0x7f16580b3820 2024-04-26T21:17:38.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f164ea00640 1 -- 172.21.15.106:0/2097188084 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f1640057530 con 0x7f16580b3820 2024-04-26T21:17:38.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1634068380 msgr2=0x7f163406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1634068380 0x7f163406a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1658158ca0 tx=0x7f1648008040 comp rx=0 tx=0).stop 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 msgr2=0x7f165814cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 0x7f165814cb50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f164000d830 tx=0x7f164000dcf0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 shutdown_connections 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f1634068380 0x7f163406a840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f16581624a0 0x7f16580ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16580b3820 0x7f165814cb50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 --2- 172.21.15.106:0/2097188084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16580aeae0 0x7f16580d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 >> 172.21.15.106:0/2097188084 conn(0x7f165806c5d0 msgr2=0x7f16580d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 shutdown_connections 2024-04-26T21:17:38.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.242+0000 7f165ca00640 1 -- 172.21.15.106:0/2097188084 wait complete. 2024-04-26T21:17:38.265 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-26T21:17:38.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3fa00640 1 Processor -- start 2024-04-26T21:17:38.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3fa00640 1 -- start start 2024-04-26T21:17:38.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3fa00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6c3806c400 0x7f6c38070270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3fa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c3815d230 con 0x7f6c380cc100 2024-04-26T21:17:38.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3fa00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c380708e0 con 0x7f6c3806c7e0 2024-04-26T21:17:38.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3fa00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6c38070bc0 con 0x7f6c3806c400 2024-04-26T21:17:38.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3da00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6c380cc100 0x7f6c380cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:43990/0 (socket says 172.21.15.106:43990) 2024-04-26T21:17:38.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3da00640 1 -- 172.21.15.106:0/1166159796 learned_addr learned my addr 172.21.15.106:0/1166159796 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:38.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3d000640 1 --2- 172.21.15.106:0/1166159796 >> v2:172.21.15.112:3300/0 conn(0x7f6c3806c400 0x7f6c38070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c37e00640 1 -- 172.21.15.106:0/1166159796 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726799147 0 0) 0x7f6c3815d230 con 0x7f6c380cc100 2024-04-26T21:17:38.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c37e00640 1 -- 172.21.15.106:0/1166159796 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c1c003530 con 0x7f6c380cc100 2024-04-26T21:17:38.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3d000640 1 -- 172.21.15.106:0/1166159796 >> v1:172.21.15.112:6789/0 conn(0x7f6c3806c7e0 legacy=0x7f6c38073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c37e00640 1 -- 172.21.15.106:0/1166159796 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910819007 0 0) 0x7f6c380708e0 con 0x7f6c3806c7e0 2024-04-26T21:17:38.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3d000640 1 -- 172.21.15.106:0/1166159796 >> v1:172.21.15.106:6789/0 conn(0x7f6c380cc100 legacy=0x7f6c380cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.398+0000 7f6c3d000640 1 -- 172.21.15.106:0/1166159796 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c38070ea0 con 0x7f6c3806c400 2024-04-26T21:17:38.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c3d000640 1 --2- 172.21.15.106:0/1166159796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3806c400 0x7f6c38070270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097c0 tx=0x7f6c2801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc28aba7339d720 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:38.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c37e00640 1 -- 172.21.15.106:0/1166159796 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c280b1070 con 0x7f6c3806c400 2024-04-26T21:17:38.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c37e00640 1 -- 172.21.15.106:0/1166159796 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c280a8050 con 0x7f6c3806c400 2024-04-26T21:17:38.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c37e00640 1 -- 172.21.15.106:0/1166159796 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c280ac860 con 0x7f6c3806c400 2024-04-26T21:17:38.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c3fa00640 1 -- 172.21.15.106:0/1166159796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3806c400 msgr2=0x7f6c38070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c3fa00640 1 --2- 172.21.15.106:0/1166159796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3806c400 0x7f6c38070270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097c0 tx=0x7f6c2801c3e0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c3fa00640 1 -- 172.21.15.106:0/1166159796 shutdown_connections 2024-04-26T21:17:38.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c3fa00640 1 --2- 172.21.15.106:0/1166159796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3806c400 0x7f6c38070270 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c3fa00640 1 -- 172.21.15.106:0/1166159796 >> 172.21.15.106:0/1166159796 conn(0x7f6c380d1ab0 msgr2=0x7f6c380d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:38.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c3fa00640 1 -- 172.21.15.106:0/1166159796 shutdown_connections 2024-04-26T21:17:38.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.402+0000 7f6c3fa00640 1 -- 172.21.15.106:0/1166159796 wait complete. 2024-04-26T21:17:38.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 Processor -- start 2024-04-26T21:17:38.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 -- start start 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3806c400 0x7f6c380c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c3806c7e0 0x7f6c3814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c380cc100 0x7f6c380c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6c380ce380 con 0x7f6c380cc100 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6c380ce200 con 0x7f6c3806c400 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3816acf0 con 0x7f6c3806c7e0 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c380cc100 0x7f6c380c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c380cc100 0x7f6c380c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34116/0 (socket says 172.21.15.106:34116) 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3da00640 1 -- 172.21.15.106:0/3884797298 learned_addr learned my addr 172.21.15.106:0/3884797298 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3d000640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3806c400 0x7f6c380c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c2fe00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c3806c7e0 0x7f6c3814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3da00640 1 -- 172.21.15.106:0/3884797298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c3806c7e0 msgr2=0x7f6c3814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3da00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c3806c7e0 0x7f6c3814f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3da00640 1 -- 172.21.15.106:0/3884797298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3806c400 msgr2=0x7f6c380c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3da00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3806c400 0x7f6c380c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3da00640 1 -- 172.21.15.106:0/3884797298 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c380c4870 con 0x7f6c380cc100 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3da00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c380cc100 0x7f6c380c6fb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000cb40 tx=0x7f6c3000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c35600640 1 -- 172.21.15.106:0/3884797298 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30017070 con 0x7f6c380cc100 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c35600640 1 -- 172.21.15.106:0/3884797298 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3000aca0 con 0x7f6c380cc100 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c35600640 1 -- 172.21.15.106:0/3884797298 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30012620 con 0x7f6c380cc100 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c380c8cb0 con 0x7f6c380cc100 2024-04-26T21:17:38.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.406+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c380c9270 con 0x7f6c380cc100 2024-04-26T21:17:38.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.410+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c38069400 con 0x7f6c380cc100 2024-04-26T21:17:38.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.410+0000 7f6c35600640 1 -- 172.21.15.106:0/3884797298 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c3001a070 con 0x7f6c380cc100 2024-04-26T21:17:38.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.410+0000 7f6c35600640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6c14068380 0x7f6c1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.410+0000 7f6c35600640 1 -- 172.21.15.106:0/3884797298 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f6c30086590 con 0x7f6c380cc100 2024-04-26T21:17:38.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.410+0000 7f6c3d000640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6c14068380 0x7f6c1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.410+0000 7f6c3d000640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6c14068380 0x7f6c1406a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6c280ae000 tx=0x7f6c280a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:38.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.414+0000 7f6c35600640 1 -- 172.21.15.106:0/3884797298 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6c300566b0 con 0x7f6c380cc100 2024-04-26T21:17:38.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.626+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f6c3806cf40 con 0x7f6c380cc100 2024-04-26T21:17:38.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.630+0000 7f6c35600640 1 -- 172.21.15.106:0/3884797298 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f6c3005a9b0 con 0x7f6c380cc100 2024-04-26T21:17:38.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6c14068380 msgr2=0x7f6c1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6c14068380 0x7f6c1406a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6c280ae000 tx=0x7f6c280a7000 comp rx=0 tx=0).stop 2024-04-26T21:17:38.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c380cc100 msgr2=0x7f6c380c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c380cc100 0x7f6c380c6fb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000cb40 tx=0x7f6c3000a060 comp rx=0 tx=0).stop 2024-04-26T21:17:38.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 shutdown_connections 2024-04-26T21:17:38.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6c14068380 0x7f6c1406a840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c380cc100 0x7f6c380c6fb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c3806c7e0 0x7f6c3814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 --2- 172.21.15.106:0/3884797298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c3806c400 0x7f6c380c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 >> 172.21.15.106:0/3884797298 conn(0x7f6c380d1ab0 msgr2=0x7f6c381556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:38.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 shutdown_connections 2024-04-26T21:17:38.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.634+0000 7f6c3fa00640 1 -- 172.21.15.106:0/3884797298 wait complete. 2024-04-26T21:17:38.657 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-26T21:17:38.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60adc00640 1 Processor -- start 2024-04-26T21:17:38.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60adc00640 1 -- start start 2024-04-26T21:17:38.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60adc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a80d14d0 0x7f60a80b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60adc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a80b51e0 con 0x7f60a815f2b0 2024-04-26T21:17:38.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60adc00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a806e020 con 0x7f60a815eed0 2024-04-26T21:17:38.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60adc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f60a806e300 con 0x7f60a80d14d0 2024-04-26T21:17:38.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a6000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f60a815f2b0 0x7f60a80b4990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44006/0 (socket says 172.21.15.106:44006) 2024-04-26T21:17:38.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a6000640 1 -- 172.21.15.106:0/2792170265 learned_addr learned my addr 172.21.15.106:0/2792170265 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:38.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a7400640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a80d14d0 0x7f60a80b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922792447 0 0) 0x7f60a80b51e0 con 0x7f60a815f2b0 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f608c003530 con 0x7f60a815f2b0 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3303785321 0 0) 0x7f60a806e020 con 0x7f60a815eed0 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60a80b51e0 con 0x7f60a815eed0 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4285350676 0 0) 0x7f608c003530 con 0x7f60a815f2b0 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a80d14d0 msgr2=0x7f60a80b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a80d14d0 0x7f60a80b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 >> v1:172.21.15.112:6789/0 conn(0x7f60a815eed0 legacy=0x7f60a806ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a806e5e0 con 0x7f60a815f2b0 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f6094001680 con 0x7f60a815f2b0 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a7400640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a80d14d0 0x7f60a80b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 >> v1:172.21.15.106:6789/0 conn(0x7f60a815f2b0 legacy=0x7f60a80b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f608c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f608c004810 0x7f608c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a80d14d0 0x7f608c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f60a806e300 con 0x7f608c003b80 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f608c00ba00 con 0x7f608c004810 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f608c00bc00 con 0x7f60a80d14d0 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a6a00640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f608c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a6000640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f608c004810 0x7f608c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.790+0000 7f60a7400640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a80d14d0 0x7f608c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a6a00640 1 -- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a80d14d0 msgr2=0x7f608c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a6a00640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a80d14d0 0x7f608c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a6a00640 1 -- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f608c004810 msgr2=0x7f608c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a6a00640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f608c004810 0x7f608c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a6a00640 1 -- 172.21.15.106:0/2792170265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c003530 con 0x7f608c003b80 2024-04-26T21:17:38.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a6a00640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f608c003f80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6098007fd0 tx=0x7f609801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6afdc46cc91d0b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:38.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098001520 con 0x7f608c003b80 2024-04-26T21:17:38.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60980052f0 con 0x7f608c003b80 2024-04-26T21:17:38.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a5600640 1 -- 172.21.15.106:0/2792170265 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098003840 con 0x7f608c003b80 2024-04-26T21:17:38.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60adc00640 1 -- 172.21.15.106:0/2792170265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 msgr2=0x7f608c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60adc00640 1 --2- 172.21.15.106:0/2792170265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f608c003f80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6098007fd0 tx=0x7f609801c510 comp rx=0 tx=0).stop 2024-04-26T21:17:38.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60a7400640 1 -- 172.21.15.106:0/2792170265 reap_dead start 2024-04-26T21:17:38.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60adc00640 1 -- 172.21.15.106:0/2792170265 shutdown_connections 2024-04-26T21:17:38.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60adc00640 1 -- 172.21.15.106:0/2792170265 >> 172.21.15.106:0/2792170265 conn(0x7f60a8068340 msgr2=0x7f60a8068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:38.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60adc00640 1 -- 172.21.15.106:0/2792170265 shutdown_connections 2024-04-26T21:17:38.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.794+0000 7f60adc00640 1 -- 172.21.15.106:0/2792170265 wait complete. 2024-04-26T21:17:38.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 Processor -- start 2024-04-26T21:17:38.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 -- start start 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f60a8161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a81fc3d0 0x7f60a81502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60a8150800 0x7f60a8150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f60a8072c10 con 0x7f608c003b80 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f60a8072a90 con 0x7f60a8150800 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f60a816ad00 con 0x7f60a81fc3d0 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f60a8161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f60a8161bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34144/0 (socket says 172.21.15.106:34144) 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6a00640 1 -- 172.21.15.106:0/3096457411 learned_addr learned my addr 172.21.15.106:0/3096457411 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6000640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a81fc3d0 0x7f60a81502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a7400640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60a8150800 0x7f60a8150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6a00640 1 -- 172.21.15.106:0/3096457411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a81fc3d0 msgr2=0x7f60a81502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6a00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a81fc3d0 0x7f60a81502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6a00640 1 -- 172.21.15.106:0/3096457411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60a8150800 msgr2=0x7f60a8150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6a00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60a8150800 0x7f60a8150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6a00640 1 -- 172.21.15.106:0/3096457411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a813ea20 con 0x7f608c003b80 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a7400640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60a8150800 0x7f60a8150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60a6a00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f60a8161bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6098005040 tx=0x7f608c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f609ea00640 1 -- 172.21.15.106:0/3096457411 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098003e60 con 0x7f608c003b80 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f609ea00640 1 -- 172.21.15.106:0/3096457411 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60980054a0 con 0x7f608c003b80 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a81fb8f0 con 0x7f608c003b80 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f609ea00640 1 -- 172.21.15.106:0/3096457411 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098006a20 con 0x7f608c003b80 2024-04-26T21:17:38.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.798+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a81fbeb0 con 0x7f608c003b80 2024-04-26T21:17:38.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.802+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a8069400 con 0x7f608c003b80 2024-04-26T21:17:38.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.802+0000 7f609ea00640 1 -- 172.21.15.106:0/3096457411 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6098006bc0 con 0x7f608c003b80 2024-04-26T21:17:38.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.802+0000 7f609ea00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6088068380 0x7f608806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:38.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.802+0000 7f609ea00640 1 -- 172.21.15.106:0/3096457411 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f6098120fb0 con 0x7f608c003b80 2024-04-26T21:17:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.802+0000 7f60a6000640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6088068380 0x7f608806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.802+0000 7f60a6000640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6088068380 0x7f608806a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f60a814fd20 tx=0x7f6094001e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:38.806+0000 7f609ea00640 1 -- 172.21.15.106:0/3096457411 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6098016250 con 0x7f608c003b80 2024-04-26T21:17:39.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.018+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f60a806c830 con 0x7f608c003b80 2024-04-26T21:17:39.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.018+0000 7f609ea00640 1 -- 172.21.15.106:0/3096457411 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f60980f1870 con 0x7f608c003b80 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6088068380 msgr2=0x7f608806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6088068380 0x7f608806a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f60a814fd20 tx=0x7f6094001e40 comp rx=0 tx=0).stop 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 msgr2=0x7f60a8161bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f60a8161bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6098005040 tx=0x7f608c005840 comp rx=0 tx=0).stop 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 shutdown_connections 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60a8150800 0x7f60a8150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6088068380 0x7f608806a840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60a81fc3d0 0x7f60a81502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 --2- 172.21.15.106:0/3096457411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f608c003b80 0x7f60a8161bf0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 >> 172.21.15.106:0/3096457411 conn(0x7f60a8068340 msgr2=0x7f60a815a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:39.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 shutdown_connections 2024-04-26T21:17:39.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.022+0000 7f60adc00640 1 -- 172.21.15.106:0/3096457411 wait complete. 2024-04-26T21:17:39.045 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:39.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.174+0000 7f2dbe800640 1 Processor -- start 2024-04-26T21:17:39.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2dbe800640 1 -- start start 2024-04-26T21:17:39.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2dbe800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2db815f3d0 0x7f2db80cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2dbe800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db80d37f0 0x7f2db80cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2dbe800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db80d1d70 con 0x7f2db80cff60 2024-04-26T21:17:39.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2dbe800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f2db80d2050 con 0x7f2db815f3d0 2024-04-26T21:17:39.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2dbe800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2db80cd450 con 0x7f2db80d37f0 2024-04-26T21:17:39.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2db7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2db815f3d0 0x7f2db80cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2db7e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2db80cff60 0x7f2db806d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44010/0 (socket says 172.21.15.106:44010) 2024-04-26T21:17:39.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2db7e00640 1 -- 172.21.15.106:0/1785546758 learned_addr learned my addr 172.21.15.106:0/1785546758 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:39.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2db6a00640 1 --2- 172.21.15.106:0/1785546758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db80d37f0 0x7f2db80cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2db7400640 1 -- 172.21.15.106:0/1785546758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db80d37f0 msgr2=0x7f2db80cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:39.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2db7400640 1 --2- 172.21.15.106:0/1785546758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db80d37f0 0x7f2db80cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2db7400640 1 -- 172.21.15.106:0/1785546758 >> v1:172.21.15.106:6789/0 conn(0x7f2db80cff60 legacy=0x7f2db806d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2db7400640 1 -- 172.21.15.106:0/1785546758 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db80cd730 con 0x7f2db815f3d0 2024-04-26T21:17:39.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.178+0000 7f2db6a00640 1 --2- 172.21.15.106:0/1785546758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db80d37f0 0x7f2db80cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:39.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2db7400640 1 --2- 172.21.15.106:0/1785546758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db815f3d0 0x7f2db80cf4e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2da80097c0 tx=0x7f2da801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5f983a8a884d1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:39.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2db6000640 1 -- 172.21.15.106:0/1785546758 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da80b0070 con 0x7f2db815f3d0 2024-04-26T21:17:39.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2db6000640 1 -- 172.21.15.106:0/1785546758 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da80ab600 con 0x7f2db815f3d0 2024-04-26T21:17:39.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2db6000640 1 -- 172.21.15.106:0/1785546758 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da80ab9d0 con 0x7f2db815f3d0 2024-04-26T21:17:39.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 -- 172.21.15.106:0/1785546758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db815f3d0 msgr2=0x7f2db80cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 --2- 172.21.15.106:0/1785546758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db815f3d0 0x7f2db80cf4e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2da80097c0 tx=0x7f2da801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 -- 172.21.15.106:0/1785546758 shutdown_connections 2024-04-26T21:17:39.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 --2- 172.21.15.106:0/1785546758 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db80d37f0 0x7f2db80cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 --2- 172.21.15.106:0/1785546758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db815f3d0 0x7f2db80cf4e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 -- 172.21.15.106:0/1785546758 >> 172.21.15.106:0/1785546758 conn(0x7f2db80d2c60 msgr2=0x7f2db80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:39.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 -- 172.21.15.106:0/1785546758 shutdown_connections 2024-04-26T21:17:39.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 -- 172.21.15.106:0/1785546758 wait complete. 2024-04-26T21:17:39.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 Processor -- start 2024-04-26T21:17:39.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.182+0000 7f2dbe800640 1 -- start start 2024-04-26T21:17:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2dbe800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db80cff60 0x7f2db80cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2dbe800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80d37f0 0x7f2db80cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2dbe800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db815f3d0 0x7f2db80cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2dbe800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2db816c010 con 0x7f2db80cff60 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2dbe800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80d0370 con 0x7f2db80d37f0 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2dbe800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2db816c190 con 0x7f2db815f3d0 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db80cff60 0x7f2db80cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db80cff60 0x7f2db80cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34164/0 (socket says 172.21.15.106:34164) 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7400640 1 -- 172.21.15.106:0/2000624447 learned_addr learned my addr 172.21.15.106:0/2000624447 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db6a00640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80d37f0 0x7f2db80cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7e00640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db815f3d0 0x7f2db80cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7400640 1 -- 172.21.15.106:0/2000624447 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db815f3d0 msgr2=0x7f2db80cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7400640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db815f3d0 0x7f2db80cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7400640 1 -- 172.21.15.106:0/2000624447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80d37f0 msgr2=0x7f2db80cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7400640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80d37f0 0x7f2db80cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7400640 1 -- 172.21.15.106:0/2000624447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db80ca8c0 con 0x7f2db80cff60 2024-04-26T21:17:39.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2db7400640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db80cff60 0x7f2db80cbd30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2da80097c0 tx=0x7f2da801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:39.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2daf400640 1 -- 172.21.15.106:0/2000624447 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da80b0050 con 0x7f2db80cff60 2024-04-26T21:17:39.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2daf400640 1 -- 172.21.15.106:0/2000624447 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da80bc070 con 0x7f2db80cff60 2024-04-26T21:17:39.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2daf400640 1 -- 172.21.15.106:0/2000624447 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da80aac00 con 0x7f2db80cff60 2024-04-26T21:17:39.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db80c93e0 con 0x7f2db80cff60 2024-04-26T21:17:39.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db80c90b0 con 0x7f2db80cff60 2024-04-26T21:17:39.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db8069400 con 0x7f2db80cff60 2024-04-26T21:17:39.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.186+0000 7f2daf400640 1 -- 172.21.15.106:0/2000624447 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2da80c1460 con 0x7f2db80cff60 2024-04-26T21:17:39.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.190+0000 7f2daf400640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2d98068380 0x7f2d9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.190+0000 7f2daf400640 1 -- 172.21.15.106:0/2000624447 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f2da8121280 con 0x7f2db80cff60 2024-04-26T21:17:39.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.190+0000 7f2db6a00640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2d98068380 0x7f2d9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.190+0000 7f2db6a00640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2d98068380 0x7f2d9806a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2db80b05b0 tx=0x7f2da4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:39.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.194+0000 7f2daf400640 1 -- 172.21.15.106:0/2000624447 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2da8016090 con 0x7f2db80cff60 2024-04-26T21:17:39.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2db81588e0 con 0x7f2db80cff60 2024-04-26T21:17:39.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2daf400640 1 -- 172.21.15.106:0/2000624447 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13212 (secure 0 0 0) 0x7f2da80f13b0 con 0x7f2db80cff60 2024-04-26T21:17:39.357 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:39.358 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":37,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:36.300215+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2d98068380 msgr2=0x7f2d9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2d98068380 0x7f2d9806a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2db80b05b0 tx=0x7f2da4008040 comp rx=0 tx=0).stop 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db80cff60 msgr2=0x7f2db80cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db80cff60 0x7f2db80cbd30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2da80097c0 tx=0x7f2da801ace0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 shutdown_connections 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80d37f0 0x7f2db80cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2d98068380 0x7f2d9806a840 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2db815f3d0 0x7f2db80cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 --2- 172.21.15.106:0/2000624447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2db80cff60 0x7f2db80cbd30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 >> 172.21.15.106:0/2000624447 conn(0x7f2db80d2c60 msgr2=0x7f2db80c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 shutdown_connections 2024-04-26T21:17:39.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.354+0000 7f2dbe800640 1 -- 172.21.15.106:0/2000624447 wait complete. 2024-04-26T21:17:39.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:17:39.379 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:17:39.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb69e00640 1 Processor -- start 2024-04-26T21:17:39.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb69e00640 1 -- start start 2024-04-26T21:17:39.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb69e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 0x7fcb64162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb69e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb6415e8c0 0x7fcb6415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb69e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb64163510 con 0x7fcb64162bf0 2024-04-26T21:17:39.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb69e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6406eaf0 con 0x7fcb6415e8c0 2024-04-26T21:17:39.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb69e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6406dee0 con 0x7fcb640d1e50 2024-04-26T21:17:39.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb63400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb6415e8c0 0x7fcb6415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb62000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 0x7fcb64162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb62a00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcb64162bf0 0x7fcb6406d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:42122/0 (socket says 172.21.15.106:42122) 2024-04-26T21:17:39.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb62a00640 1 -- 172.21.15.106:0/2368215141 learned_addr learned my addr 172.21.15.106:0/2368215141 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:39.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb61600640 1 -- 172.21.15.106:0/2368215141 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917782945 0 0) 0x7fcb64163510 con 0x7fcb64162bf0 2024-04-26T21:17:39.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb61600640 1 -- 172.21.15.106:0/2368215141 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb48003530 con 0x7fcb64162bf0 2024-04-26T21:17:39.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb62000640 1 -- 172.21.15.106:0/2368215141 >> v2:172.21.15.112:3300/0 conn(0x7fcb6415e8c0 msgr2=0x7fcb6415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:39.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb62000640 1 --2- 172.21.15.106:0/2368215141 >> v2:172.21.15.112:3300/0 conn(0x7fcb6415e8c0 0x7fcb6415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb62000640 1 -- 172.21.15.106:0/2368215141 >> v1:172.21.15.112:6789/0 conn(0x7fcb64162bf0 legacy=0x7fcb6406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb62000640 1 -- 172.21.15.106:0/2368215141 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6406e1c0 con 0x7fcb640d1e50 2024-04-26T21:17:39.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.514+0000 7fcb63400640 1 --2- 172.21.15.106:0/2368215141 >> v2:172.21.15.112:3300/0 conn(0x7fcb6415e8c0 0x7fcb6415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:39.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb62000640 1 --2- 172.21.15.106:0/2368215141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 0x7fcb64162fd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb500097c0 tx=0x7fcb5001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930f9436fb5b5f4a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:39.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb61600640 1 -- 172.21.15.106:0/2368215141 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500a7070 con 0x7fcb640d1e50 2024-04-26T21:17:39.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb61600640 1 -- 172.21.15.106:0/2368215141 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb500b0070 con 0x7fcb640d1e50 2024-04-26T21:17:39.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb61600640 1 -- 172.21.15.106:0/2368215141 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500ab890 con 0x7fcb640d1e50 2024-04-26T21:17:39.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb69e00640 1 -- 172.21.15.106:0/2368215141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 msgr2=0x7fcb64162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb69e00640 1 --2- 172.21.15.106:0/2368215141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 0x7fcb64162fd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb500097c0 tx=0x7fcb5001c470 comp rx=0 tx=0).stop 2024-04-26T21:17:39.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb69e00640 1 -- 172.21.15.106:0/2368215141 shutdown_connections 2024-04-26T21:17:39.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb69e00640 1 --2- 172.21.15.106:0/2368215141 >> v2:172.21.15.112:3300/0 conn(0x7fcb6415e8c0 0x7fcb6415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb69e00640 1 --2- 172.21.15.106:0/2368215141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 0x7fcb64162fd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb69e00640 1 -- 172.21.15.106:0/2368215141 >> 172.21.15.106:0/2368215141 conn(0x7fcb640d2c50 msgr2=0x7fcb640d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:39.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb69e00640 1 -- 172.21.15.106:0/2368215141 shutdown_connections 2024-04-26T21:17:39.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.518+0000 7fcb69e00640 1 -- 172.21.15.106:0/2368215141 wait complete. 2024-04-26T21:17:39.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 Processor -- start 2024-04-26T21:17:39.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 -- start start 2024-04-26T21:17:39.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 0x7fcb64070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6415e8c0 0x7fcb640afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb64162bf0 0x7fcb6415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcb640cdef0 con 0x7fcb64162bf0 2024-04-26T21:17:39.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcb640cdd70 con 0x7fcb6415e8c0 2024-04-26T21:17:39.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcb640ce070 con 0x7fcb640d1e50 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb63400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb64162bf0 0x7fcb6415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb63400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb64162bf0 0x7fcb6415cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34176/0 (socket says 172.21.15.106:34176) 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb63400640 1 -- 172.21.15.106:0/233708745 learned_addr learned my addr 172.21.15.106:0/233708745 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb62000640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6415e8c0 0x7fcb640afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb62a00640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 0x7fcb64070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb63400640 1 -- 172.21.15.106:0/233708745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 msgr2=0x7fcb64070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb63400640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 0x7fcb64070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb63400640 1 -- 172.21.15.106:0/233708745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6415e8c0 msgr2=0x7fcb640afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb63400640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6415e8c0 0x7fcb640afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb63400640 1 -- 172.21.15.106:0/233708745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb64071530 con 0x7fcb64162bf0 2024-04-26T21:17:39.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb63400640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb64162bf0 0x7fcb6415cc60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00e950 tx=0x7fcb5c00ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:39.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb5b400640 1 -- 172.21.15.106:0/233708745 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c017070 con 0x7fcb64162bf0 2024-04-26T21:17:39.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb640c7440 con 0x7fcb64162bf0 2024-04-26T21:17:39.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb5b400640 1 -- 172.21.15.106:0/233708745 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c00ca00 con 0x7fcb64162bf0 2024-04-26T21:17:39.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb5b400640 1 -- 172.21.15.106:0/233708745 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00cdd0 con 0x7fcb64162bf0 2024-04-26T21:17:39.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.522+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb640c7a00 con 0x7fcb64162bf0 2024-04-26T21:17:39.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.526+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb64069400 con 0x7fcb64162bf0 2024-04-26T21:17:39.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.526+0000 7fcb5b400640 1 -- 172.21.15.106:0/233708745 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb5c013470 con 0x7fcb64162bf0 2024-04-26T21:17:39.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.526+0000 7fcb5b400640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb44068380 0x7fcb4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.526+0000 7fcb5b400640 1 -- 172.21.15.106:0/233708745 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fcb5c086310 con 0x7fcb64162bf0 2024-04-26T21:17:39.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.526+0000 7fcb62a00640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb44068380 0x7fcb4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.526+0000 7fcb62a00640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb44068380 0x7fcb4406a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb54005c10 tx=0x7fcb54009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.530+0000 7fcb5b400640 1 -- 172.21.15.106:0/233708745 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb5c0563b0 con 0x7fcb64162bf0 2024-04-26T21:17:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb640d33b0 con 0x7fcb64162bf0 2024-04-26T21:17:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb5b400640 1 -- 172.21.15.106:0/233708745 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7fcb5c05a6b0 con 0x7fcb64162bf0 2024-04-26T21:17:39.693 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb44068380 msgr2=0x7fcb4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb44068380 0x7fcb4406a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb54005c10 tx=0x7fcb54009040 comp rx=0 tx=0).stop 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb64162bf0 msgr2=0x7fcb6415cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb64162bf0 0x7fcb6415cc60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00e950 tx=0x7fcb5c00ee10 comp rx=0 tx=0).stop 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 shutdown_connections 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6415e8c0 0x7fcb640afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb44068380 0x7fcb4406a840 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb64162bf0 0x7fcb6415cc60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 --2- 172.21.15.106:0/233708745 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb640d1e50 0x7fcb64070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 >> 172.21.15.106:0/233708745 conn(0x7fcb640d2c50 msgr2=0x7fcb640b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 shutdown_connections 2024-04-26T21:17:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.690+0000 7fcb69e00640 1 -- 172.21.15.106:0/233708745 wait complete. 2024-04-26T21:17:39.713 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T21:17:39.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.842+0000 7f2b69400640 1 Processor -- start 2024-04-26T21:17:39.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.842+0000 7f2b69400640 1 -- start start 2024-04-26T21:17:39.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b69400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2b640b3220 0x7f2b640b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b69400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2b64162ce0 0x7f2b64163130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b69400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b640b3b20 con 0x7f2b640cd0d0 2024-04-26T21:17:39.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b69400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6406dc70 con 0x7f2b640b3220 2024-04-26T21:17:39.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b69400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2b640b3600 con 0x7f2b64162ce0 2024-04-26T21:17:39.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b63e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2b640b3220 0x7f2b640b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b63400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2b640cd0d0 0x7f2b640d16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44016/0 (socket says 172.21.15.106:44016) 2024-04-26T21:17:39.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b63400640 1 -- 172.21.15.106:0/231797482 learned_addr learned my addr 172.21.15.106:0/231797482 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:39.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b68a00640 1 --2- 172.21.15.106:0/231797482 >> v2:172.21.15.112:3300/0 conn(0x7f2b64162ce0 0x7f2b64163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b63e00640 1 -- 172.21.15.106:0/231797482 >> v2:172.21.15.112:3300/0 conn(0x7f2b64162ce0 msgr2=0x7f2b64163130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:39.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b63e00640 1 --2- 172.21.15.106:0/231797482 >> v2:172.21.15.112:3300/0 conn(0x7f2b64162ce0 0x7f2b64163130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b63e00640 1 -- 172.21.15.106:0/231797482 >> v1:172.21.15.106:6789/0 conn(0x7f2b640cd0d0 legacy=0x7f2b640d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b63e00640 1 -- 172.21.15.106:0/231797482 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6406d6b0 con 0x7f2b640b3220 2024-04-26T21:17:39.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.846+0000 7f2b62a00640 1 -- 172.21.15.106:0/231797482 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000971350 0 0) 0x7f2b640b3b20 con 0x7f2b640cd0d0 2024-04-26T21:17:39.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b63e00640 1 --2- 172.21.15.106:0/231797482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 0x7f2b640b3d60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2b64073680 tx=0x7f2b4c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8410cbb0c8b4bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:39.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b62a00640 1 -- 172.21.15.106:0/231797482 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0b0070 con 0x7f2b640b3220 2024-04-26T21:17:39.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b62a00640 1 -- 172.21.15.106:0/231797482 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4c0ab600 con 0x7f2b640b3220 2024-04-26T21:17:39.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b62a00640 1 -- 172.21.15.106:0/231797482 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0ab9d0 con 0x7f2b640b3220 2024-04-26T21:17:39.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 -- 172.21.15.106:0/231797482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 msgr2=0x7f2b640b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 --2- 172.21.15.106:0/231797482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 0x7f2b640b3d60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2b64073680 tx=0x7f2b4c01c480 comp rx=0 tx=0).stop 2024-04-26T21:17:39.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 -- 172.21.15.106:0/231797482 shutdown_connections 2024-04-26T21:17:39.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 --2- 172.21.15.106:0/231797482 >> v2:172.21.15.112:3300/0 conn(0x7f2b64162ce0 0x7f2b64163130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 --2- 172.21.15.106:0/231797482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 0x7f2b640b3d60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 -- 172.21.15.106:0/231797482 >> 172.21.15.106:0/231797482 conn(0x7f2b640d2a80 msgr2=0x7f2b640d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:39.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 -- 172.21.15.106:0/231797482 shutdown_connections 2024-04-26T21:17:39.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 -- 172.21.15.106:0/231797482 wait complete. 2024-04-26T21:17:39.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 Processor -- start 2024-04-26T21:17:39.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 -- start start 2024-04-26T21:17:39.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 0x7f2b6415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b640cd0d0 0x7f2b640c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b64162ce0 0x7f2b641533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2b64163c00 con 0x7f2b640b3220 2024-04-26T21:17:39.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2b64163a80 con 0x7f2b640cd0d0 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.850+0000 7f2b69400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2b640d1dc0 con 0x7f2b64162ce0 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 0x7f2b6415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 0x7f2b6415a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34206/0 (socket says 172.21.15.106:34206) 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63e00640 1 -- 172.21.15.106:0/425766417 learned_addr learned my addr 172.21.15.106:0/425766417 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63400640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b640cd0d0 0x7f2b640c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b68a00640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b64162ce0 0x7f2b641533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63e00640 1 -- 172.21.15.106:0/425766417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b64162ce0 msgr2=0x7f2b641533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63e00640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b64162ce0 0x7f2b641533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63e00640 1 -- 172.21.15.106:0/425766417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b640cd0d0 msgr2=0x7f2b640c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63e00640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b640cd0d0 0x7f2b640c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:39.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63e00640 1 -- 172.21.15.106:0/425766417 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b640ca240 con 0x7f2b640b3220 2024-04-26T21:17:39.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b68a00640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b64162ce0 0x7f2b641533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:39.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b63e00640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 0x7f2b6415a690 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0ae040 tx=0x7f2b4c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:39.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b5be00640 1 -- 172.21.15.106:0/425766417 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0b8020 con 0x7f2b640b3220 2024-04-26T21:17:39.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b5be00640 1 -- 172.21.15.106:0/425766417 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4c0b4410 con 0x7f2b640b3220 2024-04-26T21:17:39.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b5be00640 1 -- 172.21.15.106:0/425766417 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0b0040 con 0x7f2b640b3220 2024-04-26T21:17:39.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6415ad10 con 0x7f2b640b3220 2024-04-26T21:17:39.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6415b550 con 0x7f2b640b3220 2024-04-26T21:17:39.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b64069400 con 0x7f2b640b3220 2024-04-26T21:17:39.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.854+0000 7f2b5be00640 1 -- 172.21.15.106:0/425766417 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2b4c0bb020 con 0x7f2b640b3220 2024-04-26T21:17:39.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.858+0000 7f2b5be00640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2b400683b0 0x7f2b4006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:39.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.858+0000 7f2b5be00640 1 -- 172.21.15.106:0/425766417 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f2b4c120410 con 0x7f2b640b3220 2024-04-26T21:17:39.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.858+0000 7f2b63400640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2b400683b0 0x7f2b4006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:39.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.858+0000 7f2b63400640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2b400683b0 0x7f2b4006a870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2b54007fd0 tx=0x7f2b54007d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:39.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:39.862+0000 7f2b5be00640 1 -- 172.21.15.106:0/425766417 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2b4c0c2030 con 0x7f2b640b3220 2024-04-26T21:17:40.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.018+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2b64074020 con 0x7f2b640b3220 2024-04-26T21:17:40.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.018+0000 7f2b5be00640 1 -- 172.21.15.106:0/425766417 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) ==== 84+0+65 (secure 0 0 0) 0x7f2b6415ad10 con 0x7f2b640b3220 2024-04-26T21:17:40.023 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:40.024 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2024-04-26T21:17:40.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T21:17:40.024 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2024-04-26T21:17:40.024 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2024-04-26T21:17:40.024 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:40.024 INFO:teuthology.orchestra.run.smithi106.stdout:] 2024-04-26T21:17:40.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2b400683b0 msgr2=0x7f2b4006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:40.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2b400683b0 0x7f2b4006a870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2b54007fd0 tx=0x7f2b54007d60 comp rx=0 tx=0).stop 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 msgr2=0x7f2b6415a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 0x7f2b6415a690 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0ae040 tx=0x7f2b4c019220 comp rx=0 tx=0).stop 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 shutdown_connections 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b640cd0d0 0x7f2b640c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2b400683b0 0x7f2b4006a870 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2b64162ce0 0x7f2b641533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 --2- 172.21.15.106:0/425766417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b640b3220 0x7f2b6415a690 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 >> 172.21.15.106:0/425766417 conn(0x7f2b640d2a80 msgr2=0x7f2b640d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 shutdown_connections 2024-04-26T21:17:40.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.022+0000 7f2b69400640 1 -- 172.21.15.106:0/425766417 wait complete. 2024-04-26T21:17:40.044 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T21:17:40.045 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T21:17:40.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.178+0000 7f4db0200640 1 Processor -- start 2024-04-26T21:17:40.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.178+0000 7f4db0200640 1 -- start start 2024-04-26T21:17:40.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4db0200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4da8160ad0 0x7f4da8160f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:40.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4db0200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4da80cf890 0x7f4da80cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:40.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4db0200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da8161930 con 0x7f4da8157540 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4db0200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f4da80cdc90 con 0x7f4da8160ad0 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4db0200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4da8071f10 con 0x7f4da80cf890 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4dad800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4da8157540 0x7f4da80cd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44026/0 (socket says 172.21.15.106:44026) 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4dad800640 1 -- 172.21.15.106:0/316922620 learned_addr learned my addr 172.21.15.106:0/316922620 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4dace00640 1 --2- 172.21.15.106:0/316922620 >> v2:172.21.15.106:3300/0 conn(0x7f4da8160ad0 0x7f4da8160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4dae200640 1 --2- 172.21.15.106:0/316922620 >> v2:172.21.15.112:3300/0 conn(0x7f4da80cf890 0x7f4da80cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4dace00640 1 -- 172.21.15.106:0/316922620 >> v2:172.21.15.112:3300/0 conn(0x7f4da80cf890 msgr2=0x7f4da80cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4dace00640 1 --2- 172.21.15.106:0/316922620 >> v2:172.21.15.112:3300/0 conn(0x7f4da80cf890 0x7f4da80cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4dace00640 1 -- 172.21.15.106:0/316922620 >> v1:172.21.15.106:6789/0 conn(0x7f4da8157540 legacy=0x7f4da80cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4dace00640 1 -- 172.21.15.106:0/316922620 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da806e950 con 0x7f4da8160ad0 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4dae200640 1 --2- 172.21.15.106:0/316922620 >> v2:172.21.15.112:3300/0 conn(0x7f4da80cf890 0x7f4da80cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:40.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.182+0000 7f4da7e00640 1 -- 172.21.15.106:0/316922620 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337845287 0 0) 0x7f4d9c001120 con 0x7f4da8157540 2024-04-26T21:17:40.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4dace00640 1 --2- 172.21.15.106:0/316922620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8160ad0 0x7f4da8160f60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097c0 tx=0x7f4d9401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108f47071ac36fa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:40.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4da7e00640 1 -- 172.21.15.106:0/316922620 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d940b0070 con 0x7f4da8160ad0 2024-04-26T21:17:40.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4da7e00640 1 -- 172.21.15.106:0/316922620 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d940ab600 con 0x7f4da8160ad0 2024-04-26T21:17:40.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4da7e00640 1 -- 172.21.15.106:0/316922620 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d940ab9d0 con 0x7f4da8160ad0 2024-04-26T21:17:40.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 -- 172.21.15.106:0/316922620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8160ad0 msgr2=0x7f4da8160f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:40.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 --2- 172.21.15.106:0/316922620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8160ad0 0x7f4da8160f60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4d940097c0 tx=0x7f4d9401c460 comp rx=0 tx=0).stop 2024-04-26T21:17:40.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 -- 172.21.15.106:0/316922620 shutdown_connections 2024-04-26T21:17:40.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 --2- 172.21.15.106:0/316922620 >> v2:172.21.15.112:3300/0 conn(0x7f4da80cf890 0x7f4da80cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:40.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 --2- 172.21.15.106:0/316922620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8160ad0 0x7f4da8160f60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:40.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 -- 172.21.15.106:0/316922620 >> 172.21.15.106:0/316922620 conn(0x7f4da80b27a0 msgr2=0x7f4da80b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:40.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 -- 172.21.15.106:0/316922620 shutdown_connections 2024-04-26T21:17:40.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 -- 172.21.15.106:0/316922620 wait complete. 2024-04-26T21:17:40.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 Processor -- start 2024-04-26T21:17:40.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 -- start start 2024-04-26T21:17:40.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4da80cf890 0x7f4da8146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:40.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8157540 0x7f4da81507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:40.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4da8160ad0 0x7f4da8150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4da80cf370 con 0x7f4da8157540 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4da806f4d0 con 0x7f4da8160ad0 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.186+0000 7f4db0200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4da8157920 con 0x7f4da80cf890 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dace00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8157540 0x7f4da81507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dace00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8157540 0x7f4da81507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34228/0 (socket says 172.21.15.106:34228) 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dace00640 1 -- 172.21.15.106:0/3951242910 learned_addr learned my addr 172.21.15.106:0/3951242910 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dae200640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4da8160ad0 0x7f4da8150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dad800640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4da80cf890 0x7f4da8146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dace00640 1 -- 172.21.15.106:0/3951242910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4da80cf890 msgr2=0x7f4da8146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dace00640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4da80cf890 0x7f4da8146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dace00640 1 -- 172.21.15.106:0/3951242910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4da8160ad0 msgr2=0x7f4da8150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dace00640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4da8160ad0 0x7f4da8150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:40.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dace00640 1 -- 172.21.15.106:0/3951242910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da80b0860 con 0x7f4da8157540 2024-04-26T21:17:40.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dad800640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4da80cf890 0x7f4da8146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:40.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4dace00640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8157540 0x7f4da81507e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d94019070 tx=0x7f4d94019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:40.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4da5600640 1 -- 172.21.15.106:0/3951242910 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d940ba070 con 0x7f4da8157540 2024-04-26T21:17:40.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4da5600640 1 -- 172.21.15.106:0/3951242910 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d940b5460 con 0x7f4da8157540 2024-04-26T21:17:40.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4da5600640 1 -- 172.21.15.106:0/3951242910 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d940b0040 con 0x7f4da8157540 2024-04-26T21:17:40.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da80b0b40 con 0x7f4da8157540 2024-04-26T21:17:40.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da815ca40 con 0x7f4da8157540 2024-04-26T21:17:40.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da8069400 con 0x7f4da8157540 2024-04-26T21:17:40.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.190+0000 7f4da5600640 1 -- 172.21.15.106:0/3951242910 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d940bd070 con 0x7f4da8157540 2024-04-26T21:17:40.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.194+0000 7f4da5600640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4d88068380 0x7f4d8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:40.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.194+0000 7f4da5600640 1 -- 172.21.15.106:0/3951242910 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f4d94120d30 con 0x7f4da8157540 2024-04-26T21:17:40.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.194+0000 7f4dad800640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4d88068380 0x7f4d8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:40.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.194+0000 7f4dad800640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4d88068380 0x7f4d8806a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c007fd0 tx=0x7f4d9c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:40.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.198+0000 7f4da5600640 1 -- 172.21.15.106:0/3951242910 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4d94016050 con 0x7f4da8157540 2024-04-26T21:17:40.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:40.358+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4da8073c00 con 0x7f4da8157540 2024-04-26T21:17:41.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.302+0000 7f4da5600640 1 -- 172.21.15.106:0/3951242910 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) ==== 138+0+0 (secure 0 0 0) 0x7f4d940f1520 con 0x7f4da8157540 2024-04-26T21:17:41.308 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2024-04-26T21:17:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4d88068380 msgr2=0x7f4d8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4d88068380 0x7f4d8806a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c007fd0 tx=0x7f4d9c009040 comp rx=0 tx=0).stop 2024-04-26T21:17:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8157540 msgr2=0x7f4da81507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8157540 0x7f4da81507e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d94019070 tx=0x7f4d94019200 comp rx=0 tx=0).stop 2024-04-26T21:17:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 shutdown_connections 2024-04-26T21:17:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4da8160ad0 0x7f4da8150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:41.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4d88068380 0x7f4d8806a840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4da8157540 0x7f4da81507e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 --2- 172.21.15.106:0/3951242910 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4da80cf890 0x7f4da8146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 >> 172.21.15.106:0/3951242910 conn(0x7f4da80b27a0 msgr2=0x7f4da815e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 shutdown_connections 2024-04-26T21:17:41.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.306+0000 7f4db0200640 1 -- 172.21.15.106:0/3951242910 wait complete. 2024-04-26T21:17:41.340 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T21:17:41.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f3124a00640 1 Processor -- start 2024-04-26T21:17:41.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f3124a00640 1 -- start start 2024-04-26T21:17:41.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f3124a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3120146830 0x7f31200b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:41.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f3124a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31200b4170 con 0x7f31200cfdc0 2024-04-26T21:17:41.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f3124a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31200d02c0 con 0x7f31200b5170 2024-04-26T21:17:41.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f3124a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f31200b47a0 con 0x7f3120146830 2024-04-26T21:17:41.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f3117e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f31200cfdc0 0x7f312006df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44036/0 (socket says 172.21.15.106:44036) 2024-04-26T21:17:41.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f3117e00640 1 -- 172.21.15.106:0/904560609 learned_addr learned my addr 172.21.15.106:0/904560609 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:41.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311de00640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3120146830 0x7f31200b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:41.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357367848 0 0) 0x7f31200b4170 con 0x7f31200cfdc0 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3104003530 con 0x7f31200cfdc0 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259766518 0 0) 0x7f31200d02c0 con 0x7f31200b5170 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31200b4170 con 0x7f31200b5170 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3585401400 0 0) 0x7f3104003530 con 0x7f31200cfdc0 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3120146830 msgr2=0x7f31200b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3120146830 0x7f31200b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 >> v1:172.21.15.112:6789/0 conn(0x7f31200b5170 legacy=0x7f312015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31200d05a0 con 0x7f31200cfdc0 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f3108001680 con 0x7f31200cfdc0 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 >> v1:172.21.15.106:6789/0 conn(0x7f31200cfdc0 legacy=0x7f312006df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:41.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3120146830 0x7f3104003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:41.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31040040e0 0x7f3104004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:41.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3104004d50 0x7f31040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:41.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f31200b47a0 con 0x7f31040040e0 2024-04-26T21:17:41.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.482+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f310400bab0 con 0x7f3104004d50 2024-04-26T21:17:41.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f310400bcb0 con 0x7f3120146830 2024-04-26T21:17:41.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f3117e00640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31040040e0 0x7f3104004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:41.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f311de00640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3120146830 0x7f3104003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:41.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f311e800640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3104004d50 0x7f31040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:41.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f3117e00640 1 -- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3120146830 msgr2=0x7f3104003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:41.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f3117e00640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3120146830 0x7f3104003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:41.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f3117e00640 1 -- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3104004d50 msgr2=0x7f31040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:41.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f3117e00640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3104004d50 0x7f31040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:41.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f3117e00640 1 -- 172.21.15.106:0/904560609 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3104003530 con 0x7f31040040e0 2024-04-26T21:17:41.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f3117e00640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31040040e0 0x7f3104004810 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f310800c190 tx=0x7f310801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd8b9f413cf5366 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:41.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108007cd0 con 0x7f31040040e0 2024-04-26T21:17:41.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31080a9020 con 0x7f31040040e0 2024-04-26T21:17:41.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.486+0000 7f311d400640 1 -- 172.21.15.106:0/904560609 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31080a5b00 con 0x7f31040040e0 2024-04-26T21:17:41.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 -- 172.21.15.106:0/904560609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31040040e0 msgr2=0x7f3104004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:41.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 --2- 172.21.15.106:0/904560609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31040040e0 0x7f3104004810 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f310800c190 tx=0x7f310801cc00 comp rx=0 tx=0).stop 2024-04-26T21:17:41.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 -- 172.21.15.106:0/904560609 reap_dead start 2024-04-26T21:17:41.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 -- 172.21.15.106:0/904560609 shutdown_connections 2024-04-26T21:17:41.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 -- 172.21.15.106:0/904560609 >> 172.21.15.106:0/904560609 conn(0x7f31200b28a0 msgr2=0x7f31200b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:41.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 -- 172.21.15.106:0/904560609 shutdown_connections 2024-04-26T21:17:41.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 -- 172.21.15.106:0/904560609 wait complete. 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 Processor -- start 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 -- start start 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040040e0 0x7f3120073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31201453b0 0x7f3120072850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3120139ca0 0x7f312015d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f31200b3dc0 con 0x7f3120139ca0 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3120146c10 con 0x7f31040040e0 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3124a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f312006e690 con 0x7f31201453b0 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3120139ca0 0x7f312015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:41.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3120139ca0 0x7f312015d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34238/0 (socket says 172.21.15.106:34238) 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 -- 172.21.15.106:0/3404859570 learned_addr learned my addr 172.21.15.106:0/3404859570 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f3117e00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31201453b0 0x7f3120072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311de00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040040e0 0x7f3120073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 -- 172.21.15.106:0/3404859570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31201453b0 msgr2=0x7f3120072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31201453b0 0x7f3120072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 -- 172.21.15.106:0/3404859570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040040e0 msgr2=0x7f3120073320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040040e0 0x7f3120073320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 -- 172.21.15.106:0/3404859570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3120073970 con 0x7f3120139ca0 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.490+0000 7f311e800640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3120139ca0 0x7f312015d390 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3120071370 tx=0x7f3118011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.494+0000 7f3116000640 1 -- 172.21.15.106:0/3404859570 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3118010040 con 0x7f3120139ca0 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.494+0000 7f3116000640 1 -- 172.21.15.106:0/3404859570 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f311801a070 con 0x7f3120139ca0 2024-04-26T21:17:41.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.494+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3120073c50 con 0x7f3120139ca0 2024-04-26T21:17:41.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.494+0000 7f3116000640 1 -- 172.21.15.106:0/3404859570 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3118015410 con 0x7f3120139ca0 2024-04-26T21:17:41.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.494+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3120072330 con 0x7f3120139ca0 2024-04-26T21:17:41.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.494+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3120069400 con 0x7f3120139ca0 2024-04-26T21:17:41.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.494+0000 7f3116000640 1 -- 172.21.15.106:0/3404859570 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31180155b0 con 0x7f3120139ca0 2024-04-26T21:17:41.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.494+0000 7f3116000640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f30fc068380 0x7f30fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:41.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.494+0000 7f3116000640 1 -- 172.21.15.106:0/3404859570 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5619+0+0 (secure 0 0 0) 0x7f311808a580 con 0x7f3120139ca0 2024-04-26T21:17:41.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.498+0000 7f311de00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f30fc068380 0x7f30fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:41.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.498+0000 7f311de00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f30fc068380 0x7f30fc06a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3110009b00 tx=0x7f3110009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:41.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.498+0000 7f3116000640 1 -- 172.21.15.106:0/3404859570 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f311805ad00 con 0x7f3120139ca0 2024-04-26T21:17:41.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:41.654+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f312015f1c0 con 0x7f3120139ca0 2024-04-26T21:17:42.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.310+0000 7f3116000640 1 -- 172.21.15.106:0/3404859570 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) ==== 170+0+0 (secure 0 0 0) 0x7f311805a600 con 0x7f3120139ca0 2024-04-26T21:17:42.314 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2024-04-26T21:17:42.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f30fc068380 msgr2=0x7f30fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:42.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f30fc068380 0x7f30fc06a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3110009b00 tx=0x7f3110009190 comp rx=0 tx=0).stop 2024-04-26T21:17:42.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3120139ca0 msgr2=0x7f312015d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:42.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3120139ca0 0x7f312015d390 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3120071370 tx=0x7f3118011f40 comp rx=0 tx=0).stop 2024-04-26T21:17:42.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 shutdown_connections 2024-04-26T21:17:42.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f30fc068380 0x7f30fc06a840 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:42.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3120139ca0 0x7f312015d390 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:42.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31201453b0 0x7f3120072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:42.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 --2- 172.21.15.106:0/3404859570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040040e0 0x7f3120073320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:42.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 >> 172.21.15.106:0/3404859570 conn(0x7f31200b28a0 msgr2=0x7f312015e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:42.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 shutdown_connections 2024-04-26T21:17:42.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.314+0000 7f3124a00640 1 -- 172.21.15.106:0/3404859570 wait complete. 2024-04-26T21:17:42.355 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T21:17:42.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.490+0000 7fa1e4c00640 1 Processor -- start 2024-04-26T21:17:42.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.490+0000 7fa1e4c00640 1 -- start start 2024-04-26T21:17:42.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1e4c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa1e00b5260 0x7fa1e015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:42.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1e4c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa1e015de50 0x7fa1e0166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:42.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1e4c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e00b44a0 con 0x7fa1e015d530 2024-04-26T21:17:42.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1e4c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e00b4780 con 0x7fa1e015de50 2024-04-26T21:17:42.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1e4c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e00b4a60 con 0x7fa1e00b5260 2024-04-26T21:17:42.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1de800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa1e015de50 0x7fa1e0166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:42.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1dde00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa1e015d530 0x7fa1e00cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44052/0 (socket says 172.21.15.106:44052) 2024-04-26T21:17:42.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1dde00640 1 -- 172.21.15.106:0/948604084 learned_addr learned my addr 172.21.15.106:0/948604084 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:42.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1d5400640 1 --2- 172.21.15.106:0/948604084 >> v2:172.21.15.112:3300/0 conn(0x7fa1e00b5260 0x7fa1e015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:42.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1dd400640 1 -- 172.21.15.106:0/948604084 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1295358061 0 0) 0x7fa1e00b44a0 con 0x7fa1e015d530 2024-04-26T21:17:42.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1dd400640 1 -- 172.21.15.106:0/948604084 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c4003530 con 0x7fa1e015d530 2024-04-26T21:17:42.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1de800640 1 -- 172.21.15.106:0/948604084 >> v2:172.21.15.112:3300/0 conn(0x7fa1e00b5260 msgr2=0x7fa1e015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:42.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1de800640 1 --2- 172.21.15.106:0/948604084 >> v2:172.21.15.112:3300/0 conn(0x7fa1e00b5260 0x7fa1e015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:42.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1de800640 1 -- 172.21.15.106:0/948604084 >> v1:172.21.15.106:6789/0 conn(0x7fa1e015d530 legacy=0x7fa1e00cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:42.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.494+0000 7fa1de800640 1 -- 172.21.15.106:0/948604084 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e00b4d40 con 0x7fa1e015de50 2024-04-26T21:17:42.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1de800640 1 --2- 172.21.15.106:0/948604084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015de50 0x7fa1e0166ae0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00b0820 tx=0x7fa1d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9930ecf251cb85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:42.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1dd400640 1 -- 172.21.15.106:0/948604084 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80ab640 con 0x7fa1e015de50 2024-04-26T21:17:42.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1dd400640 1 -- 172.21.15.106:0/948604084 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d80b0070 con 0x7fa1e015de50 2024-04-26T21:17:42.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1dd400640 1 -- 172.21.15.106:0/948604084 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80ab9e0 con 0x7fa1e015de50 2024-04-26T21:17:42.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 -- 172.21.15.106:0/948604084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015de50 msgr2=0x7fa1e0166ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:42.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 --2- 172.21.15.106:0/948604084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015de50 0x7fa1e0166ae0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00b0820 tx=0x7fa1d801c480 comp rx=0 tx=0).stop 2024-04-26T21:17:42.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 -- 172.21.15.106:0/948604084 shutdown_connections 2024-04-26T21:17:42.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 --2- 172.21.15.106:0/948604084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015de50 0x7fa1e0166ae0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:42.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 --2- 172.21.15.106:0/948604084 >> v2:172.21.15.112:3300/0 conn(0x7fa1e00b5260 0x7fa1e015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:42.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 -- 172.21.15.106:0/948604084 >> 172.21.15.106:0/948604084 conn(0x7fa1e00b2910 msgr2=0x7fa1e00b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:42.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 -- 172.21.15.106:0/948604084 shutdown_connections 2024-04-26T21:17:42.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 -- 172.21.15.106:0/948604084 wait complete. 2024-04-26T21:17:42.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 Processor -- start 2024-04-26T21:17:42.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 -- start start 2024-04-26T21:17:42.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1e00b5260 0x7fa1e0145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:42.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015d530 0x7fa1e0145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:42.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1e015de50 0x7fa1e01460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:42.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e00d06b0 con 0x7fa1e015d530 2024-04-26T21:17:42.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e00d0530 con 0x7fa1e015de50 2024-04-26T21:17:42.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1e4c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e0169840 con 0x7fa1e00b5260 2024-04-26T21:17:42.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1d5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015d530 0x7fa1e0145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:42.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1d5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015d530 0x7fa1e0145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34260/0 (socket says 172.21.15.106:34260) 2024-04-26T21:17:42.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.498+0000 7fa1d5400640 1 -- 172.21.15.106:0/412884942 learned_addr learned my addr 172.21.15.106:0/412884942 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1dde00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1e00b5260 0x7fa1e0145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1de800640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1e015de50 0x7fa1e01460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d5400640 1 -- 172.21.15.106:0/412884942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1e00b5260 msgr2=0x7fa1e0145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d5400640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1e00b5260 0x7fa1e0145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d5400640 1 -- 172.21.15.106:0/412884942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1e015de50 msgr2=0x7fa1e01460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d5400640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1e015de50 0x7fa1e01460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d5400640 1 -- 172.21.15.106:0/412884942 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e0140b80 con 0x7fa1e015d530 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d5400640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015d530 0x7fa1e0145b90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800e900 tx=0x7fa1c800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d6a00640 1 -- 172.21.15.106:0/412884942 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8017070 con 0x7fa1e015d530 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d6a00640 1 -- 172.21.15.106:0/412884942 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c800ca00 con 0x7fa1e015d530 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e01445b0 con 0x7fa1e015d530 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d6a00640 1 -- 172.21.15.106:0/412884942 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800cdb0 con 0x7fa1e015d530 2024-04-26T21:17:42.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e0144e50 con 0x7fa1e015d530 2024-04-26T21:17:42.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e01449a0 con 0x7fa1e015d530 2024-04-26T21:17:42.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d6a00640 1 -- 172.21.15.106:0/412884942 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1c801a070 con 0x7fa1e015d530 2024-04-26T21:17:42.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d6a00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa1bc068380 0x7fa1bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:42.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.502+0000 7fa1d6a00640 1 -- 172.21.15.106:0/412884942 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6001+0+0 (secure 0 0 0) 0x7fa1c80869e0 con 0x7fa1e015d530 2024-04-26T21:17:42.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.506+0000 7fa1dde00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa1bc068380 0x7fa1bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:42.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.506+0000 7fa1dde00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa1bc068380 0x7fa1bc06a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0005c10 tx=0x7fa1d0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:42.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.510+0000 7fa1d6a00640 1 -- 172.21.15.106:0/412884942 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa1e0140b80 con 0x7fa1e015d530 2024-04-26T21:17:42.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:42.698+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa1e00d1950 con 0x7fa1e015d530 2024-04-26T21:17:43.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.322+0000 7fa1d6a00640 1 -- 172.21.15.106:0/412884942 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa1c8056820 con 0x7fa1e015d530 2024-04-26T21:17:43.335 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 5 and data pool 6 2024-04-26T21:17:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa1bc068380 msgr2=0x7fa1bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa1bc068380 0x7fa1bc06a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0005c10 tx=0x7fa1d0009040 comp rx=0 tx=0).stop 2024-04-26T21:17:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015d530 msgr2=0x7fa1e0145b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015d530 0x7fa1e0145b90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800e900 tx=0x7fa1c800edc0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 shutdown_connections 2024-04-26T21:17:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1e015de50 0x7fa1e01460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa1bc068380 0x7fa1bc06a840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1e015d530 0x7fa1e0145b90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 --2- 172.21.15.106:0/412884942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1e00b5260 0x7fa1e0145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 >> 172.21.15.106:0/412884942 conn(0x7fa1e00b2910 msgr2=0x7fa1e00b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 shutdown_connections 2024-04-26T21:17:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.342+0000 7fa1e4c00640 1 -- 172.21.15.106:0/412884942 wait complete. 2024-04-26T21:17:43.377 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:43.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd64a00640 1 Processor -- start 2024-04-26T21:17:43.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd64a00640 1 -- start start 2024-04-26T21:17:43.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd64a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd600d1500 0x7efd600b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd64a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd60163b70 con 0x7efd60146b70 2024-04-26T21:17:43.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd64a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd60163e10 con 0x7efd601464d0 2024-04-26T21:17:43.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd64a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7efd601468b0 con 0x7efd600d1500 2024-04-26T21:17:43.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd5e800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efd60146b70 0x7efd600b41c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44062/0 (socket says 172.21.15.106:44062) 2024-04-26T21:17:43.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd5e800640 1 -- 172.21.15.106:0/2816151538 learned_addr learned my addr 172.21.15.106:0/2816151538 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:43.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd55400640 1 --2- 172.21.15.106:0/2816151538 >> v2:172.21.15.106:3300/0 conn(0x7efd600d1500 0x7efd600b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd5d400640 1 -- 172.21.15.106:0/2816151538 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1541293670 0 0) 0x7efd60163b70 con 0x7efd60146b70 2024-04-26T21:17:43.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd5d400640 1 -- 172.21.15.106:0/2816151538 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd44003530 con 0x7efd60146b70 2024-04-26T21:17:43.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd55400640 1 -- 172.21.15.106:0/2816151538 >> v1:172.21.15.112:6789/0 conn(0x7efd601464d0 legacy=0x7efd600d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd55400640 1 -- 172.21.15.106:0/2816151538 >> v1:172.21.15.106:6789/0 conn(0x7efd60146b70 legacy=0x7efd600b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.510+0000 7efd55400640 1 -- 172.21.15.106:0/2816151538 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd601640f0 con 0x7efd600d1500 2024-04-26T21:17:43.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd55400640 1 --2- 172.21.15.106:0/2816151538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 0x7efd600b3c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efd500097c0 tx=0x7efd5001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3c1c06a9b8c540 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:43.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd5d400640 1 -- 172.21.15.106:0/2816151538 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500b1070 con 0x7efd600d1500 2024-04-26T21:17:43.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd5d400640 1 -- 172.21.15.106:0/2816151538 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd500ac5f0 con 0x7efd600d1500 2024-04-26T21:17:43.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd5d400640 1 -- 172.21.15.106:0/2816151538 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500ac9c0 con 0x7efd600d1500 2024-04-26T21:17:43.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd64a00640 1 -- 172.21.15.106:0/2816151538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 msgr2=0x7efd600b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd64a00640 1 --2- 172.21.15.106:0/2816151538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 0x7efd600b3c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efd500097c0 tx=0x7efd5001c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd64a00640 1 -- 172.21.15.106:0/2816151538 shutdown_connections 2024-04-26T21:17:43.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd64a00640 1 --2- 172.21.15.106:0/2816151538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 0x7efd600b3c80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd64a00640 1 -- 172.21.15.106:0/2816151538 >> 172.21.15.106:0/2816151538 conn(0x7efd60068340 msgr2=0x7efd60068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:43.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd64a00640 1 -- 172.21.15.106:0/2816151538 shutdown_connections 2024-04-26T21:17:43.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.514+0000 7efd64a00640 1 -- 172.21.15.106:0/2816151538 wait complete. 2024-04-26T21:17:43.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 Processor -- start 2024-04-26T21:17:43.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 -- start start 2024-04-26T21:17:43.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 0x7efd6013d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd601464d0 0x7efd60154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd60146b70 0x7efd60165d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efd60170f90 con 0x7efd600d1500 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efd60170e10 con 0x7efd60146b70 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efd60171110 con 0x7efd601464d0 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 0x7efd6013d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 0x7efd6013d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34266/0 (socket says 172.21.15.106:34266) 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5de00640 1 -- 172.21.15.106:0/3526283797 learned_addr learned my addr 172.21.15.106:0/3526283797 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5e800640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd60146b70 0x7efd60165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd55400640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd601464d0 0x7efd60154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5de00640 1 -- 172.21.15.106:0/3526283797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd601464d0 msgr2=0x7efd60154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5de00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd601464d0 0x7efd60154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5de00640 1 -- 172.21.15.106:0/3526283797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd60146b70 msgr2=0x7efd60165d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5de00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd60146b70 0x7efd60165d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5de00640 1 -- 172.21.15.106:0/3526283797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd601429b0 con 0x7efd600d1500 2024-04-26T21:17:43.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd5de00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 0x7efd6013d3b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efd48007fd0 tx=0x7efd4800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:43.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd56a00640 1 -- 172.21.15.106:0/3526283797 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48017070 con 0x7efd600d1500 2024-04-26T21:17:43.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd56a00640 1 -- 172.21.15.106:0/3526283797 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd480052d0 con 0x7efd600d1500 2024-04-26T21:17:43.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd60141910 con 0x7efd600d1500 2024-04-26T21:17:43.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd56a00640 1 -- 172.21.15.106:0/3526283797 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48003840 con 0x7efd600d1500 2024-04-26T21:17:43.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.518+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd60141ed0 con 0x7efd600d1500 2024-04-26T21:17:43.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.522+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd60069400 con 0x7efd600d1500 2024-04-26T21:17:43.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.522+0000 7efd56a00640 1 -- 172.21.15.106:0/3526283797 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd4801a070 con 0x7efd600d1500 2024-04-26T21:17:43.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.522+0000 7efd56a00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efd3c0683b0 0x7efd3c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.522+0000 7efd56a00640 1 -- 172.21.15.106:0/3526283797 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7efd48085f60 con 0x7efd600d1500 2024-04-26T21:17:43.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.522+0000 7efd55400640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efd3c0683b0 0x7efd3c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.522+0000 7efd55400640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efd3c0683b0 0x7efd3c06a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efd500ae000 tx=0x7efd50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:43.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.526+0000 7efd56a00640 1 -- 172.21.15.106:0/3526283797 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efd48005480 con 0x7efd600d1500 2024-04-26T21:17:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.682+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd60068a60 con 0x7efd600d1500 2024-04-26T21:17:43.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd56a00640 1 -- 172.21.15.106:0/3526283797 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17003 (secure 0 0 0) 0x7efd480562f0 con 0x7efd600d1500 2024-04-26T21:17:43.689 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:43.689 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":40,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:42.703372+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:17:40.370502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T21:17:41.669690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:43.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efd3c0683b0 msgr2=0x7efd3c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efd3c0683b0 0x7efd3c06a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efd500ae000 tx=0x7efd50008040 comp rx=0 tx=0).stop 2024-04-26T21:17:43.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 msgr2=0x7efd6013d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 0x7efd6013d3b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efd48007fd0 tx=0x7efd4800c890 comp rx=0 tx=0).stop 2024-04-26T21:17:43.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 shutdown_connections 2024-04-26T21:17:43.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd60146b70 0x7efd60165d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7efd3c0683b0 0x7efd3c06a870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efd601464d0 0x7efd60154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 --2- 172.21.15.106:0/3526283797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd600d1500 0x7efd6013d3b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 >> 172.21.15.106:0/3526283797 conn(0x7efd60068340 msgr2=0x7efd60149400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:43.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 shutdown_connections 2024-04-26T21:17:43.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.686+0000 7efd64a00640 1 -- 172.21.15.106:0/3526283797 wait complete. 2024-04-26T21:17:43.711 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:43.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.842+0000 7f1842600640 1 Processor -- start 2024-04-26T21:17:43.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.842+0000 7f1842600640 1 -- start start 2024-04-26T21:17:43.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f1842600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f183c13ed60 0x7f183c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f1842600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f183c13f140 0x7f183c0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f1842600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c0b3d10 con 0x7f183c06eb70 2024-04-26T21:17:43.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f1842600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f183c0b3ac0 con 0x7f183c13ed60 2024-04-26T21:17:43.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f1842600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f183c0b4920 con 0x7f183c13f140 2024-04-26T21:17:43.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f183b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f183c13ed60 0x7f183c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f183b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f183c13ed60 0x7f183c15c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34280/0 (socket says 172.21.15.106:34280) 2024-04-26T21:17:43.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f183b400640 1 -- 172.21.15.106:0/3489056766 learned_addr learned my addr 172.21.15.106:0/3489056766 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:43.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f1832a00640 1 --2- 172.21.15.106:0/3489056766 >> v2:172.21.15.112:3300/0 conn(0x7f183c13f140 0x7f183c0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f183b400640 1 -- 172.21.15.106:0/3489056766 >> v2:172.21.15.112:3300/0 conn(0x7f183c13f140 msgr2=0x7f183c0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:43.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f183b400640 1 --2- 172.21.15.106:0/3489056766 >> v2:172.21.15.112:3300/0 conn(0x7f183c13f140 0x7f183c0b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f183b400640 1 -- 172.21.15.106:0/3489056766 >> v1:172.21.15.112:6789/0 conn(0x7f183c06eb70 legacy=0x7f183c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:43.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f183b400640 1 -- 172.21.15.106:0/3489056766 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c0b3ff0 con 0x7f183c13ed60 2024-04-26T21:17:43.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.846+0000 7f183b400640 1 --2- 172.21.15.106:0/3489056766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 0x7f183c15c3e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f183c15f930 tx=0x7f182c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db97f9903ea68702 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:43.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f183aa00640 1 -- 172.21.15.106:0/3489056766 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0b1070 con 0x7f183c13ed60 2024-04-26T21:17:43.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f183aa00640 1 -- 172.21.15.106:0/3489056766 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182c0ac620 con 0x7f183c13ed60 2024-04-26T21:17:43.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f183aa00640 1 -- 172.21.15.106:0/3489056766 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0ac9f0 con 0x7f183c13ed60 2024-04-26T21:17:43.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 -- 172.21.15.106:0/3489056766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 msgr2=0x7f183c15c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 --2- 172.21.15.106:0/3489056766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 0x7f183c15c3e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f183c15f930 tx=0x7f182c01c3c0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 -- 172.21.15.106:0/3489056766 shutdown_connections 2024-04-26T21:17:43.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 --2- 172.21.15.106:0/3489056766 >> v2:172.21.15.112:3300/0 conn(0x7f183c13f140 0x7f183c0b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 --2- 172.21.15.106:0/3489056766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 0x7f183c15c3e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 -- 172.21.15.106:0/3489056766 >> 172.21.15.106:0/3489056766 conn(0x7f183c068340 msgr2=0x7f183c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:43.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 -- 172.21.15.106:0/3489056766 shutdown_connections 2024-04-26T21:17:43.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 -- 172.21.15.106:0/3489056766 wait complete. 2024-04-26T21:17:43.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 Processor -- start 2024-04-26T21:17:43.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 -- start start 2024-04-26T21:17:43.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 0x7f183c13d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13def0 0x7f183c1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c15dd00 0x7f183c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f183c0d1680 con 0x7f183c13ed60 2024-04-26T21:17:43.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f183c0d1500 con 0x7f183c15dd00 2024-04-26T21:17:43.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f1842600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f183c160420 con 0x7f183c13def0 2024-04-26T21:17:43.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f183b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 0x7f183c13d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f183b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 0x7f183c13d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34286/0 (socket says 172.21.15.106:34286) 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.850+0000 7f183b400640 1 -- 172.21.15.106:0/1113539231 learned_addr learned my addr 172.21.15.106:0/1113539231 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1832a00640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13def0 0x7f183c1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f183be00640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c15dd00 0x7f183c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f183b400640 1 -- 172.21.15.106:0/1113539231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13def0 msgr2=0x7f183c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f183b400640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13def0 0x7f183c1573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f183b400640 1 -- 172.21.15.106:0/1113539231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c15dd00 msgr2=0x7f183c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f183b400640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c15dd00 0x7f183c15e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f183b400640 1 -- 172.21.15.106:0/1113539231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c0b1120 con 0x7f183c13ed60 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f183b400640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 0x7f183c13d770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f182c01aa70 tx=0x7f182c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1833e00640 1 -- 172.21.15.106:0/1113539231 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0ba070 con 0x7f183c13ed60 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1833e00640 1 -- 172.21.15.106:0/1113539231 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182c0b5400 con 0x7f183c13ed60 2024-04-26T21:17:43.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c1650b0 con 0x7f183c13ed60 2024-04-26T21:17:43.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1833e00640 1 -- 172.21.15.106:0/1113539231 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0b1040 con 0x7f183c13ed60 2024-04-26T21:17:43.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c165630 con 0x7f183c13ed60 2024-04-26T21:17:43.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183c15e6c0 con 0x7f183c13ed60 2024-04-26T21:17:43.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1833e00640 1 -- 172.21.15.106:0/1113539231 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f182c0bd070 con 0x7f183c13ed60 2024-04-26T21:17:43.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1833e00640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18180683b0 0x7f181806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:43.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.854+0000 7f1833e00640 1 -- 172.21.15.106:0/1113539231 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f182c11fe40 con 0x7f183c13ed60 2024-04-26T21:17:43.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.858+0000 7f1832a00640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18180683b0 0x7f181806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:43.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.858+0000 7f1832a00640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18180683b0 0x7f181806a870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f183c166250 tx=0x7f1824008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:43.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:43.858+0000 7f1833e00640 1 -- 172.21.15.106:0/1113539231 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f183c0b1120 con 0x7f183c13ed60 2024-04-26T21:17:44.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f183c069400 con 0x7f183c13ed60 2024-04-26T21:17:44.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1833e00640 1 -- 172.21.15.106:0/1113539231 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17003 (secure 0 0 0) 0x7f182c0160d0 con 0x7f183c13ed60 2024-04-26T21:17:44.021 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:44.022 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":40,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:42.703372+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:17:40.370502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T21:17:41.669690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:44.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18180683b0 msgr2=0x7f181806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:44.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18180683b0 0x7f181806a870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f183c166250 tx=0x7f1824008040 comp rx=0 tx=0).stop 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 msgr2=0x7f183c13d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 0x7f183c13d770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f182c01aa70 tx=0x7f182c019160 comp rx=0 tx=0).stop 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 shutdown_connections 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f183c15dd00 0x7f183c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18180683b0 0x7f181806a870 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f183c13def0 0x7f183c1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 --2- 172.21.15.106:0/1113539231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f183c13ed60 0x7f183c13d770 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 >> 172.21.15.106:0/1113539231 conn(0x7f183c068340 msgr2=0x7f183c0b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 shutdown_connections 2024-04-26T21:17:44.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.018+0000 7f1842600640 1 -- 172.21.15.106:0/1113539231 wait complete. 2024-04-26T21:17:44.044 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T21:17:44.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f365e400640 1 Processor -- start 2024-04-26T21:17:44.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f365e400640 1 -- start start 2024-04-26T21:17:44.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f365e400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 0x7f36580cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f365e400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f36580cee30 0x7f36580cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f365e400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36580cdab0 con 0x7f36580d14d0 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f365e400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f36580cdd90 con 0x7f36580cee30 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f365e400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f36580ce070 con 0x7f3658160440 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f3656a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f36580cee30 0x7f36580cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f3656a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f36580cee30 0x7f36580cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34294/0 (socket says 172.21.15.106:34294) 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f3656a00640 1 -- 172.21.15.106:0/478138363 learned_addr learned my addr 172.21.15.106:0/478138363 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f3657400640 1 --2- 172.21.15.106:0/478138363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 0x7f36580cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f3656a00640 1 -- 172.21.15.106:0/478138363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 msgr2=0x7f36580cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f3656a00640 1 --2- 172.21.15.106:0/478138363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 0x7f36580cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f3656a00640 1 -- 172.21.15.106:0/478138363 >> v1:172.21.15.112:6789/0 conn(0x7f36580d14d0 legacy=0x7f36580d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f3656a00640 1 -- 172.21.15.106:0/478138363 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36580ce350 con 0x7f36580cee30 2024-04-26T21:17:44.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.178+0000 7f3657400640 1 --2- 172.21.15.106:0/478138363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 0x7f36580cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:44.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f3656a00640 1 --2- 172.21.15.106:0/478138363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 0x7f36580cf9a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3644009870 tx=0x7f364401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be2323d2f19d61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:44.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f3656000640 1 -- 172.21.15.106:0/478138363 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36440a6040 con 0x7f36580cee30 2024-04-26T21:17:44.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f3656000640 1 -- 172.21.15.106:0/478138363 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36440af070 con 0x7f36580cee30 2024-04-26T21:17:44.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f3656000640 1 -- 172.21.15.106:0/478138363 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36440aa860 con 0x7f36580cee30 2024-04-26T21:17:44.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f365e400640 1 -- 172.21.15.106:0/478138363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 msgr2=0x7f36580cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f365e400640 1 --2- 172.21.15.106:0/478138363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 0x7f36580cf9a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3644009870 tx=0x7f364401c520 comp rx=0 tx=0).stop 2024-04-26T21:17:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f365e400640 1 -- 172.21.15.106:0/478138363 shutdown_connections 2024-04-26T21:17:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f365e400640 1 --2- 172.21.15.106:0/478138363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 0x7f36580cf9a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f365e400640 1 --2- 172.21.15.106:0/478138363 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 0x7f36580cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f365e400640 1 -- 172.21.15.106:0/478138363 >> 172.21.15.106:0/478138363 conn(0x7f36580d2c50 msgr2=0x7f36580d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f365e400640 1 -- 172.21.15.106:0/478138363 shutdown_connections 2024-04-26T21:17:44.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.182+0000 7f365e400640 1 -- 172.21.15.106:0/478138363 wait complete. 2024-04-26T21:17:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 Processor -- start 2024-04-26T21:17:44.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 -- start start 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 0x7f3658149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36580d14d0 0x7f3658158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 0x7f3658159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f36580b6430 con 0x7f36580cee30 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f36580b62b0 con 0x7f36580d14d0 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f36580b65b0 con 0x7f3658160440 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 0x7f3658149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 0x7f3658149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34306/0 (socket says 172.21.15.106:34306) 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657400640 1 -- 172.21.15.106:0/3257222049 learned_addr learned my addr 172.21.15.106:0/3257222049 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3656a00640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36580d14d0 0x7f3658158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657e00640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 0x7f3658159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:44.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657400640 1 -- 172.21.15.106:0/3257222049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 msgr2=0x7f3658159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 0x7f3658159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657400640 1 -- 172.21.15.106:0/3257222049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36580d14d0 msgr2=0x7f3658158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36580d14d0 0x7f3658158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657400640 1 -- 172.21.15.106:0/3257222049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3658159680 con 0x7f36580cee30 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3656a00640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36580d14d0 0x7f3658158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f3657400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 0x7f3658149f20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f364800ce00 tx=0x7f364800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f364f400640 1 -- 172.21.15.106:0/3257222049 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364800f890 con 0x7f36580cee30 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f364f400640 1 -- 172.21.15.106:0/3257222049 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364800fa30 con 0x7f36580cee30 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f364f400640 1 -- 172.21.15.106:0/3257222049 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364800fe00 con 0x7f36580cee30 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3658159960 con 0x7f36580cee30 2024-04-26T21:17:44.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.186+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3658159f20 con 0x7f36580cee30 2024-04-26T21:17:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.190+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3658069400 con 0x7f36580cee30 2024-04-26T21:17:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.190+0000 7f364f400640 1 -- 172.21.15.106:0/3257222049 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3648018400 con 0x7f36580cee30 2024-04-26T21:17:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.190+0000 7f364f400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3638068380 0x7f363806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.190+0000 7f364f400640 1 -- 172.21.15.106:0/3257222049 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f3648087a00 con 0x7f36580cee30 2024-04-26T21:17:44.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.190+0000 7f3656a00640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3638068380 0x7f363806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:44.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.190+0000 7f3656a00640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3638068380 0x7f363806a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f36440ae000 tx=0x7f36440a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:44.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.194+0000 7f364f400640 1 -- 172.21.15.106:0/3257222049 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3648014030 con 0x7f36580cee30 2024-04-26T21:17:44.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:44.390+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3658068e30 con 0x7f36580cee30 2024-04-26T21:17:45.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f364f400640 1 -- 172.21.15.106:0/3257222049 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f364800ae20 con 0x7f36580cee30 2024-04-26T21:17:45.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3638068380 msgr2=0x7f363806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:45.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3638068380 0x7f363806a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f36440ae000 tx=0x7f36440a7000 comp rx=0 tx=0).stop 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 msgr2=0x7f3658149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 0x7f3658149f20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f364800ce00 tx=0x7f364800a650 comp rx=0 tx=0).stop 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 shutdown_connections 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36580d14d0 0x7f3658158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3638068380 0x7f363806a840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3658160440 0x7f3658159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 --2- 172.21.15.106:0/3257222049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580cee30 0x7f3658149f20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 >> 172.21.15.106:0/3257222049 conn(0x7f36580d2c50 msgr2=0x7f3658071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 shutdown_connections 2024-04-26T21:17:45.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.342+0000 7f365e400640 1 -- 172.21.15.106:0/3257222049 wait complete. 2024-04-26T21:17:45.370 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T21:17:45.370 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T21:17:45.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0f02000640 1 Processor -- start 2024-04-26T21:17:45.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0f02000640 1 -- start start 2024-04-26T21:17:45.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0f02000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0efc159890 0x7f0efc162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:45.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0f02000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0efc06ffb0 0x7f0efc0d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:45.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0f02000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0efc0d1ab0 con 0x7f0efc0d1680 2024-04-26T21:17:45.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0f02000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f0efc072770 con 0x7f0efc06ffb0 2024-04-26T21:17:45.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0f02000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0efc163b60 con 0x7f0efc159890 2024-04-26T21:17:45.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0ef3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0efc06ffb0 0x7f0efc0d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:45.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0efbe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0efc0d1680 0x7f0efc15f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44066/0 (socket says 172.21.15.106:44066) 2024-04-26T21:17:45.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0efbe00640 1 -- 172.21.15.106:0/2358440950 learned_addr learned my addr 172.21.15.106:0/2358440950 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:45.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0efb400640 1 --2- 172.21.15.106:0/2358440950 >> v2:172.21.15.112:3300/0 conn(0x7f0efc159890 0x7f0efc162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:45.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0ef3e00640 1 -- 172.21.15.106:0/2358440950 >> v2:172.21.15.112:3300/0 conn(0x7f0efc159890 msgr2=0x7f0efc162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:45.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0ef3e00640 1 --2- 172.21.15.106:0/2358440950 >> v2:172.21.15.112:3300/0 conn(0x7f0efc159890 0x7f0efc162bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:45.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0ef3e00640 1 -- 172.21.15.106:0/2358440950 >> v1:172.21.15.106:6789/0 conn(0x7f0efc0d1680 legacy=0x7f0efc15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:45.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0ef3e00640 1 -- 172.21.15.106:0/2358440950 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc0729c0 con 0x7f0efc06ffb0 2024-04-26T21:17:45.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0efb400640 1 --2- 172.21.15.106:0/2358440950 >> v2:172.21.15.112:3300/0 conn(0x7f0efc159890 0x7f0efc162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:45.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.510+0000 7f0efaa00640 1 -- 172.21.15.106:0/2358440950 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032696360 0 0) 0x7f0efc0d1ab0 con 0x7f0efc0d1680 2024-04-26T21:17:45.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0ef3e00640 1 --2- 172.21.15.106:0/2358440950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 0x7f0efc0d1140 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0efc06e060 tx=0x7f0ee401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af27eef410d4af7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:45.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0efaa00640 1 -- 172.21.15.106:0/2358440950 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40ab650 con 0x7f0efc06ffb0 2024-04-26T21:17:45.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0efaa00640 1 -- 172.21.15.106:0/2358440950 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40b0070 con 0x7f0efc06ffb0 2024-04-26T21:17:45.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0efaa00640 1 -- 172.21.15.106:0/2358440950 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40aba10 con 0x7f0efc06ffb0 2024-04-26T21:17:45.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 -- 172.21.15.106:0/2358440950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 msgr2=0x7f0efc0d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:45.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 --2- 172.21.15.106:0/2358440950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 0x7f0efc0d1140 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0efc06e060 tx=0x7f0ee401c450 comp rx=0 tx=0).stop 2024-04-26T21:17:45.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 -- 172.21.15.106:0/2358440950 shutdown_connections 2024-04-26T21:17:45.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 --2- 172.21.15.106:0/2358440950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 0x7f0efc0d1140 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:45.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 --2- 172.21.15.106:0/2358440950 >> v2:172.21.15.112:3300/0 conn(0x7f0efc159890 0x7f0efc162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:45.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 -- 172.21.15.106:0/2358440950 >> 172.21.15.106:0/2358440950 conn(0x7f0efc06c400 msgr2=0x7f0efc06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:45.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 -- 172.21.15.106:0/2358440950 shutdown_connections 2024-04-26T21:17:45.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 -- 172.21.15.106:0/2358440950 wait complete. 2024-04-26T21:17:45.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 Processor -- start 2024-04-26T21:17:45.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.514+0000 7f0f02000640 1 -- start start 2024-04-26T21:17:45.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0f02000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 0x7f0efc153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:45.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0f02000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0efc0d1680 0x7f0efc14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:45.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0f02000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0efc1466b0 0x7f0efc14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:45.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0f02000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc075e30 con 0x7f0efc06ffb0 2024-04-26T21:17:45.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0f02000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc073540 con 0x7f0efc1466b0 2024-04-26T21:17:45.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0f02000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0efc070440 con 0x7f0efc0d1680 2024-04-26T21:17:45.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 0x7f0efc153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:45.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 0x7f0efc153920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34318/0 (socket says 172.21.15.106:34318) 2024-04-26T21:17:45.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efb400640 1 -- 172.21.15.106:0/1221124535 learned_addr learned my addr 172.21.15.106:0/1221124535 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0ef3e00640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0efc0d1680 0x7f0efc14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efbe00640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0efc1466b0 0x7f0efc14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efb400640 1 -- 172.21.15.106:0/1221124535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0efc0d1680 msgr2=0x7f0efc14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efb400640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0efc0d1680 0x7f0efc14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efb400640 1 -- 172.21.15.106:0/1221124535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0efc1466b0 msgr2=0x7f0efc14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efb400640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0efc1466b0 0x7f0efc14e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efb400640 1 -- 172.21.15.106:0/1221124535 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc154050 con 0x7f0efc06ffb0 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0efb400640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 0x7f0efc153920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00d800 tx=0x7f0eec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0ef3400640 1 -- 172.21.15.106:0/1221124535 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec018020 con 0x7f0efc06ffb0 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0ef3400640 1 -- 172.21.15.106:0/1221124535 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eec0096c0 con 0x7f0efc06ffb0 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0ef3400640 1 -- 172.21.15.106:0/1221124535 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec009ab0 con 0x7f0efc06ffb0 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0efc14fb10 con 0x7f0efc06ffb0 2024-04-26T21:17:45.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0efc146b40 con 0x7f0efc06ffb0 2024-04-26T21:17:45.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.518+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0efc069400 con 0x7f0efc06ffb0 2024-04-26T21:17:45.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.522+0000 7f0ef3400640 1 -- 172.21.15.106:0/1221124535 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0eec01b020 con 0x7f0efc06ffb0 2024-04-26T21:17:45.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.522+0000 7f0ef3400640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0ed80683b0 0x7f0ed806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:45.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.522+0000 7f0ef3400640 1 -- 172.21.15.106:0/1221124535 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f0eec087060 con 0x7f0efc06ffb0 2024-04-26T21:17:45.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.522+0000 7f0ef3e00640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0ed80683b0 0x7f0ed806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:45.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.522+0000 7f0ef3e00640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0ed80683b0 0x7f0ed806a870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40af000 tx=0x7f0ee40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:45.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.526+0000 7f0ef3400640 1 -- 172.21.15.106:0/1221124535 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0eec022020 con 0x7f0efc06ffb0 2024-04-26T21:17:45.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:45.718+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0efc169d40 con 0x7f0efc06ffb0 2024-04-26T21:17:46.286 INFO:tasks.ceph.mds.c.smithi106.stderr:2024-04-26T21:17:46.286+0000 7fa76b600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:17:46.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0ef3400640 1 -- 172.21.15.106:0/1221124535 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f0eec057480 con 0x7f0efc06ffb0 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0ed80683b0 msgr2=0x7f0ed806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0ed80683b0 0x7f0ed806a870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40af000 tx=0x7f0ee40a7000 comp rx=0 tx=0).stop 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 msgr2=0x7f0efc153920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 0x7f0efc153920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00d800 tx=0x7f0eec00dcc0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 shutdown_connections 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0efc1466b0 0x7f0efc14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0ed80683b0 0x7f0ed806a870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0efc0d1680 0x7f0efc14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 --2- 172.21.15.106:0/1221124535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0efc06ffb0 0x7f0efc153920 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 >> 172.21.15.106:0/1221124535 conn(0x7f0efc06c400 msgr2=0x7f0efc14d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 shutdown_connections 2024-04-26T21:17:46.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.350+0000 7f0f02000640 1 -- 172.21.15.106:0/1221124535 wait complete. 2024-04-26T21:17:46.378 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T21:17:46.378 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:17:46.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda18e00640 1 Processor -- start 2024-04-26T21:17:46.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda18e00640 1 -- start start 2024-04-26T21:17:46.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda18e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda1413ed60 0x7fda1415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda18e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fda1413f140 0x7fda140b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda18e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda140b3d10 con 0x7fda1406eb70 2024-04-26T21:17:46.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda18e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fda140b3ac0 con 0x7fda1413f140 2024-04-26T21:17:46.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda18e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fda140b4920 con 0x7fda1413ed60 2024-04-26T21:17:46.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda0be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fda1413f140 0x7fda140b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda12800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fda1406eb70 0x7fda140d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44076/0 (socket says 172.21.15.106:44076) 2024-04-26T21:17:46.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda12800640 1 -- 172.21.15.106:0/1581479332 learned_addr learned my addr 172.21.15.106:0/1581479332 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:46.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda11e00640 1 --2- 172.21.15.106:0/1581479332 >> v2:172.21.15.112:3300/0 conn(0x7fda1413ed60 0x7fda1415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda0be00640 1 -- 172.21.15.106:0/1581479332 >> v2:172.21.15.112:3300/0 conn(0x7fda1413ed60 msgr2=0x7fda1415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:46.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda0be00640 1 --2- 172.21.15.106:0/1581479332 >> v2:172.21.15.112:3300/0 conn(0x7fda1413ed60 0x7fda1415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda0be00640 1 -- 172.21.15.106:0/1581479332 >> v1:172.21.15.106:6789/0 conn(0x7fda1406eb70 legacy=0x7fda140d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda0be00640 1 -- 172.21.15.106:0/1581479332 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda140b3ff0 con 0x7fda1413f140 2024-04-26T21:17:46.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.514+0000 7fda11400640 1 -- 172.21.15.106:0/1581479332 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2349096219 0 0) 0x7fda140b3d10 con 0x7fda1406eb70 2024-04-26T21:17:46.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda0be00640 1 --2- 172.21.15.106:0/1581479332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1413f140 0x7fda140b52e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fda14074400 tx=0x7fd9fc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e8e512588d238c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:46.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda11400640 1 -- 172.21.15.106:0/1581479332 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0b2070 con 0x7fda1413f140 2024-04-26T21:17:46.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda11400640 1 -- 172.21.15.106:0/1581479332 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc0a9070 con 0x7fda1413f140 2024-04-26T21:17:46.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda11400640 1 -- 172.21.15.106:0/1581479332 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0ad880 con 0x7fda1413f140 2024-04-26T21:17:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda18e00640 1 -- 172.21.15.106:0/1581479332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1413f140 msgr2=0x7fda140b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda18e00640 1 --2- 172.21.15.106:0/1581479332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1413f140 0x7fda140b52e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fda14074400 tx=0x7fd9fc01c360 comp rx=0 tx=0).stop 2024-04-26T21:17:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda18e00640 1 -- 172.21.15.106:0/1581479332 shutdown_connections 2024-04-26T21:17:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda18e00640 1 --2- 172.21.15.106:0/1581479332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1413f140 0x7fda140b52e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda18e00640 1 --2- 172.21.15.106:0/1581479332 >> v2:172.21.15.112:3300/0 conn(0x7fda1413ed60 0x7fda1415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda18e00640 1 -- 172.21.15.106:0/1581479332 >> 172.21.15.106:0/1581479332 conn(0x7fda14068340 msgr2=0x7fda14068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda18e00640 1 -- 172.21.15.106:0/1581479332 shutdown_connections 2024-04-26T21:17:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.518+0000 7fda18e00640 1 -- 172.21.15.106:0/1581479332 wait complete. 2024-04-26T21:17:46.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 Processor -- start 2024-04-26T21:17:46.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 -- start start 2024-04-26T21:17:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda1413ed60 0x7fda14157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1415a950 0x7fda1415add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda1413ae00 0x7fda1413b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fda140d1680 con 0x7fda1415a950 2024-04-26T21:17:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fda140d1500 con 0x7fda1413ed60 2024-04-26T21:17:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fda14160400 con 0x7fda1413ae00 2024-04-26T21:17:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1415a950 0x7fda1415add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1415a950 0x7fda1415add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34348/0 (socket says 172.21.15.106:34348) 2024-04-26T21:17:46.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0be00640 1 -- 172.21.15.106:0/3483586594 learned_addr learned my addr 172.21.15.106:0/3483586594 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda11e00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda1413ed60 0x7fda14157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda12800640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda1413ae00 0x7fda1413b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0be00640 1 -- 172.21.15.106:0/3483586594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda1413ae00 msgr2=0x7fda1413b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0be00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda1413ae00 0x7fda1413b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0be00640 1 -- 172.21.15.106:0/3483586594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda1413ed60 msgr2=0x7fda14157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0be00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda1413ed60 0x7fda14157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0be00640 1 -- 172.21.15.106:0/3483586594 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda14159610 con 0x7fda1415a950 2024-04-26T21:17:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda12800640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda1413ae00 0x7fda1413b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0be00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1415a950 0x7fda1415add0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0b0040 tx=0x7fd9fc019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0a000640 1 -- 172.21.15.106:0/3483586594 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0ba020 con 0x7fda1415a950 2024-04-26T21:17:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0a000640 1 -- 172.21.15.106:0/3483586594 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc0add80 con 0x7fda1415a950 2024-04-26T21:17:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda141598f0 con 0x7fda1415a950 2024-04-26T21:17:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda0a000640 1 -- 172.21.15.106:0/3483586594 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0b2040 con 0x7fda1415a950 2024-04-26T21:17:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.522+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda14158000 con 0x7fda1415a950 2024-04-26T21:17:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.526+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda14069400 con 0x7fda1415a950 2024-04-26T21:17:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.526+0000 7fda0a000640 1 -- 172.21.15.106:0/3483586594 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9fc0bd020 con 0x7fda1415a950 2024-04-26T21:17:46.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.526+0000 7fda0a000640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd9f0068380 0x7fd9f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.526+0000 7fda0a000640 1 -- 172.21.15.106:0/3483586594 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd9fc1206b0 con 0x7fda1415a950 2024-04-26T21:17:46.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.526+0000 7fda11e00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd9f0068380 0x7fd9f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.526+0000 7fda11e00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd9f0068380 0x7fd9f006a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda04009af0 tx=0x7fda04008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:46.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.530+0000 7fda0a000640 1 -- 172.21.15.106:0/3483586594 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd9fc0c4030 con 0x7fda1415a950 2024-04-26T21:17:46.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.718+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda1415c170 con 0x7fda1415a950 2024-04-26T21:17:46.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.718+0000 7fda0a000640 1 -- 172.21.15.106:0/3483586594 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7fd9fc016070 con 0x7fda1415a950 2024-04-26T21:17:46.723 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:46.723 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:17:45.722737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5469":{"gid":5469,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1043820033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1043820033},{"type":"v1","addr":"172.21.15.106:6836","nonce":1043820033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5469,"qdb_cluster":[5469]},"id":2}]} 2024-04-26T21:17:46.723 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 18 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd9f0068380 msgr2=0x7fd9f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd9f0068380 0x7fd9f006a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda04009af0 tx=0x7fda04008040 comp rx=0 tx=0).stop 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1415a950 msgr2=0x7fda1415add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1415a950 0x7fda1415add0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0b0040 tx=0x7fd9fc019100 comp rx=0 tx=0).stop 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 shutdown_connections 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd9f0068380 0x7fd9f006a840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fda1413ae00 0x7fda1413b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1415a950 0x7fda1415add0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 --2- 172.21.15.106:0/3483586594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda1413ed60 0x7fda14157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 >> 172.21.15.106:0/3483586594 conn(0x7fda14068340 msgr2=0x7fda140d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:46.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 shutdown_connections 2024-04-26T21:17:46.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.722+0000 7fda18e00640 1 -- 172.21.15.106:0/3483586594 wait complete. 2024-04-26T21:17:46.744 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:17:46.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.874+0000 7f190da00640 1 Processor -- start 2024-04-26T21:17:46.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.874+0000 7f190da00640 1 -- start start 2024-04-26T21:17:46.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f190da00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190813f140 0x7f190815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f190da00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19080b3d10 con 0x7f190813ed60 2024-04-26T21:17:46.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f190da00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19080b3ff0 con 0x7f190806eb70 2024-04-26T21:17:46.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f190da00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f19080b3ac0 con 0x7f190813f140 2024-04-26T21:17:46.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f190813ed60 0x7f19080b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44078/0 (socket says 172.21.15.106:44078) 2024-04-26T21:17:46.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906a00640 1 -- 172.21.15.106:0/1352318493 learned_addr learned my addr 172.21.15.106:0/1352318493 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:46.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f18fe000640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190813f140 0x7f190815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215840996 0 0) 0x7f19080b3d10 con 0x7f190813ed60 2024-04-26T21:17:46.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18ec005740 con 0x7f190813ed60 2024-04-26T21:17:46.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80572858 0 0) 0x7f19080b3ff0 con 0x7f190806eb70 2024-04-26T21:17:46.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19080b3d10 con 0x7f190806eb70 2024-04-26T21:17:46.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2469618506 0 0) 0x7f18ec005740 con 0x7f190813ed60 2024-04-26T21:17:46.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190813f140 msgr2=0x7f190815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190813f140 0x7f190815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 >> v1:172.21.15.112:6789/0 conn(0x7f190806eb70 legacy=0x7f19080d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19080b42d0 con 0x7f190813ed60 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f18f8001a20 con 0x7f190813ed60 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f18fe000640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190813f140 0x7f190815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 >> v1:172.21.15.106:6789/0 conn(0x7f190813ed60 legacy=0x7f19080b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18ec005d90 0x7f18ec006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec006a20 0x7f18ec006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0073e0 0x7f18ec00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f19080b3ac0 con 0x7f18ec0073e0 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec00e310 con 0x7f18ec006a20 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec00e510 con 0x7f18ec005d90 2024-04-26T21:17:46.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1907400640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0073e0 0x7f18ec00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1906a00640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18ec005d90 0x7f18ec006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f18fe000640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec006a20 0x7f18ec006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1907400640 1 -- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18ec005d90 msgr2=0x7f18ec006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:46.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1907400640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18ec005d90 0x7f18ec006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1907400640 1 -- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec006a20 msgr2=0x7f18ec006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:46.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1907400640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec006a20 0x7f18ec006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.878+0000 7f1907400640 1 -- 172.21.15.106:0/1352318493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec005740 con 0x7f18ec0073e0 2024-04-26T21:17:46.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f1907400640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0073e0 0x7f18ec00dbe0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f19080b48d0 tx=0x7f190001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7284e04e9932bfe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:46.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900001520 con 0x7f18ec0073e0 2024-04-26T21:17:46.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19000052f0 con 0x7f18ec0073e0 2024-04-26T21:17:46.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f1906000640 1 -- 172.21.15.106:0/1352318493 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900003840 con 0x7f18ec0073e0 2024-04-26T21:17:46.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f190da00640 1 -- 172.21.15.106:0/1352318493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0073e0 msgr2=0x7f18ec00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f190da00640 1 --2- 172.21.15.106:0/1352318493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0073e0 0x7f18ec00dbe0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f19080b48d0 tx=0x7f190001c520 comp rx=0 tx=0).stop 2024-04-26T21:17:46.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f1907400640 1 -- 172.21.15.106:0/1352318493 reap_dead start 2024-04-26T21:17:46.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f190da00640 1 -- 172.21.15.106:0/1352318493 shutdown_connections 2024-04-26T21:17:46.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f190da00640 1 -- 172.21.15.106:0/1352318493 >> 172.21.15.106:0/1352318493 conn(0x7f1908068340 msgr2=0x7f1908068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:46.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f190da00640 1 -- 172.21.15.106:0/1352318493 shutdown_connections 2024-04-26T21:17:46.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.882+0000 7f190da00640 1 -- 172.21.15.106:0/1352318493 wait complete. 2024-04-26T21:17:46.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 Processor -- start 2024-04-26T21:17:46.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 -- start start 2024-04-26T21:17:46.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec0073e0 0x7f1908146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1908159570 0x7f1908146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19081f6c70 0x7f19081f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f190815c3e0 con 0x7f1908159570 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19080d1710 con 0x7f18ec0073e0 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f190815c560 con 0x7f19081f6c70 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18fe000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1908159570 0x7f1908146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18fe000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1908159570 0x7f1908146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34368/0 (socket says 172.21.15.106:34368) 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18fe000640 1 -- 172.21.15.106:0/2892125368 learned_addr learned my addr 172.21.15.106:0/2892125368 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f1906a00640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec0073e0 0x7f1908146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f1907400640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19081f6c70 0x7f19081f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18fe000640 1 -- 172.21.15.106:0/2892125368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19081f6c70 msgr2=0x7f19081f70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18fe000640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19081f6c70 0x7f19081f70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18fe000640 1 -- 172.21.15.106:0/2892125368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec0073e0 msgr2=0x7f1908146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18fe000640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec0073e0 0x7f1908146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:46.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18fe000640 1 -- 172.21.15.106:0/2892125368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19081f4410 con 0x7f1908159570 2024-04-26T21:17:46.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18fe000640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1908159570 0x7f1908146f50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f18f0011860 tx=0x7f18f0011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:46.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18ff400640 1 -- 172.21.15.106:0/2892125368 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f000fbd0 con 0x7f1908159570 2024-04-26T21:17:46.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18ff400640 1 -- 172.21.15.106:0/2892125368 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f000fd70 con 0x7f1908159570 2024-04-26T21:17:46.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f18ff400640 1 -- 172.21.15.106:0/2892125368 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f00156a0 con 0x7f1908159570 2024-04-26T21:17:46.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19081f46f0 con 0x7f1908159570 2024-04-26T21:17:46.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19081f7630 con 0x7f1908159570 2024-04-26T21:17:46.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.886+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1908069400 con 0x7f1908159570 2024-04-26T21:17:46.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.890+0000 7f18ff400640 1 -- 172.21.15.106:0/2892125368 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18f0015840 con 0x7f1908159570 2024-04-26T21:17:46.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.890+0000 7f18ff400640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e40683b0 0x7f18e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:46.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.890+0000 7f18ff400640 1 -- 172.21.15.106:0/2892125368 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f18f0087410 con 0x7f1908159570 2024-04-26T21:17:46.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.890+0000 7f1906a00640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e40683b0 0x7f18e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:46.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.890+0000 7f1906a00640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e40683b0 0x7f18e406a870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f18f8002240 tx=0x7f18f8001460 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:46.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:46.894+0000 7f18ff400640 1 -- 172.21.15.106:0/2892125368 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f18f0019030 con 0x7f1908159570 2024-04-26T21:17:47.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.050+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19080cfbb0 con 0x7f1908159570 2024-04-26T21:17:47.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f18ff400640 1 -- 172.21.15.106:0/2892125368 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16990 (secure 0 0 0) 0x7f18f00571d0 con 0x7f1908159570 2024-04-26T21:17:47.057 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:47.057 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":41,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:17:44.328112+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:17:40.370502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T21:17:41.669690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:17:47.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e40683b0 msgr2=0x7f18e406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e40683b0 0x7f18e406a870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f18f8002240 tx=0x7f18f8001460 comp rx=0 tx=0).stop 2024-04-26T21:17:47.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1908159570 msgr2=0x7f1908146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1908159570 0x7f1908146f50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f18f0011860 tx=0x7f18f0011d20 comp rx=0 tx=0).stop 2024-04-26T21:17:47.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 shutdown_connections 2024-04-26T21:17:47.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e40683b0 0x7f18e406a870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f19081f6c70 0x7f19081f70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1908159570 0x7f1908146f50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 --2- 172.21.15.106:0/2892125368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec0073e0 0x7f1908146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 >> 172.21.15.106:0/2892125368 conn(0x7f1908068340 msgr2=0x7f1908068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:47.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 shutdown_connections 2024-04-26T21:17:47.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.054+0000 7f190da00640 1 -- 172.21.15.106:0/2892125368 wait complete. 2024-04-26T21:17:47.079 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T21:17:47.079 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:17:47.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe367200640 1 Processor -- start 2024-04-26T21:17:47.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe367200640 1 -- start start 2024-04-26T21:17:47.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe367200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680b3220 0x7fe3680b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe367200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe3680cd0d0 0x7fe3680d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe367200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3680b3b20 con 0x7fe3680d1bf0 2024-04-26T21:17:47.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe367200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe36806dc70 con 0x7fe3680cd0d0 2024-04-26T21:17:47.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe367200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe3680b3600 con 0x7fe3680b3220 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe365400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe3680cd0d0 0x7fe3680d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe365e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680b3220 0x7fe3680b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe365400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe3680cd0d0 0x7fe3680d16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:37874/0 (socket says 172.21.15.106:37874) 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe365400640 1 -- 172.21.15.106:0/2198772204 learned_addr learned my addr 172.21.15.106:0/2198772204 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe365e00640 1 -- 172.21.15.106:0/2198772204 >> v2:172.21.15.112:3300/0 conn(0x7fe3680cd0d0 msgr2=0x7fe3680d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe365e00640 1 --2- 172.21.15.106:0/2198772204 >> v2:172.21.15.112:3300/0 conn(0x7fe3680cd0d0 0x7fe3680d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe364a00640 1 -- 172.21.15.106:0/2198772204 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431516886 0 0) 0x7fe3680b3b20 con 0x7fe3680d1bf0 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe365e00640 1 -- 172.21.15.106:0/2198772204 >> v1:172.21.15.112:6789/0 conn(0x7fe3680d1bf0 legacy=0x7fe3680cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe365e00640 1 -- 172.21.15.106:0/2198772204 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36806d6b0 con 0x7fe3680b3220 2024-04-26T21:17:47.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.214+0000 7fe365400640 1 --2- 172.21.15.106:0/2198772204 >> v2:172.21.15.112:3300/0 conn(0x7fe3680cd0d0 0x7fe3680d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:47.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe365e00640 1 --2- 172.21.15.106:0/2198772204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680b3220 0x7fe3680b3d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3580097c0 tx=0x7fe35801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c51a2f32dfbbd6c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:47.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe364a00640 1 -- 172.21.15.106:0/2198772204 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3580b0070 con 0x7fe3680b3220 2024-04-26T21:17:47.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe364a00640 1 -- 172.21.15.106:0/2198772204 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3580a4e50 con 0x7fe3680b3220 2024-04-26T21:17:47.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe364a00640 1 -- 172.21.15.106:0/2198772204 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3580ab820 con 0x7fe3680b3220 2024-04-26T21:17:47.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe367200640 1 -- 172.21.15.106:0/2198772204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680b3220 msgr2=0x7fe3680b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe367200640 1 --2- 172.21.15.106:0/2198772204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680b3220 0x7fe3680b3d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3580097c0 tx=0x7fe35801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe367200640 1 -- 172.21.15.106:0/2198772204 shutdown_connections 2024-04-26T21:17:47.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe367200640 1 --2- 172.21.15.106:0/2198772204 >> v2:172.21.15.112:3300/0 conn(0x7fe3680cd0d0 0x7fe3680d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe367200640 1 --2- 172.21.15.106:0/2198772204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680b3220 0x7fe3680b3d60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe367200640 1 -- 172.21.15.106:0/2198772204 >> 172.21.15.106:0/2198772204 conn(0x7fe3680d2a80 msgr2=0x7fe3680d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:47.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe367200640 1 -- 172.21.15.106:0/2198772204 shutdown_connections 2024-04-26T21:17:47.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.218+0000 7fe367200640 1 -- 172.21.15.106:0/2198772204 wait complete. 2024-04-26T21:17:47.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 Processor -- start 2024-04-26T21:17:47.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 -- start start 2024-04-26T21:17:47.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3680b3220 0x7fe3681428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3680cd0d0 0x7fe368143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680d1bf0 0x7fe368157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe36816c1a0 con 0x7fe3680cd0d0 2024-04-26T21:17:47.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe36816c020 con 0x7fe3680b3220 2024-04-26T21:17:47.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe36816c320 con 0x7fe3680d1bf0 2024-04-26T21:17:47.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3680cd0d0 0x7fe368143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3680b3220 0x7fe3681428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe366800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680d1bf0 0x7fe368157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3680cd0d0 0x7fe368143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39040/0 (socket says 172.21.15.106:39040) 2024-04-26T21:17:47.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365400640 1 -- 172.21.15.106:0/1787217537 learned_addr learned my addr 172.21.15.106:0/1787217537 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365400640 1 -- 172.21.15.106:0/1787217537 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680d1bf0 msgr2=0x7fe368157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365400640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680d1bf0 0x7fe368157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365400640 1 -- 172.21.15.106:0/1787217537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3680b3220 msgr2=0x7fe3681428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365400640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3680b3220 0x7fe3681428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365400640 1 -- 172.21.15.106:0/1787217537 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe368142e30 con 0x7fe3680cd0d0 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe365400640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3680cd0d0 0x7fe368143110 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe35400e960 tx=0x7fe35400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe35e000640 1 -- 172.21.15.106:0/1787217537 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354017070 con 0x7fe3680cd0d0 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe35e000640 1 -- 172.21.15.106:0/1787217537 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35400ca00 con 0x7fe3680cd0d0 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe35e000640 1 -- 172.21.15.106:0/1787217537 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35400cdb0 con 0x7fe3680cd0d0 2024-04-26T21:17:47.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3680afc10 con 0x7fe3680cd0d0 2024-04-26T21:17:47.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3680b01d0 con 0x7fe3680cd0d0 2024-04-26T21:17:47.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.222+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe368069400 con 0x7fe3680cd0d0 2024-04-26T21:17:47.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.226+0000 7fe35e000640 1 -- 172.21.15.106:0/1787217537 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe35401a070 con 0x7fe3680cd0d0 2024-04-26T21:17:47.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.226+0000 7fe35e000640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe348068380 0x7fe34806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.226+0000 7fe35e000640 1 -- 172.21.15.106:0/1787217537 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fe354086d40 con 0x7fe3680cd0d0 2024-04-26T21:17:47.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.226+0000 7fe365e00640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe348068380 0x7fe34806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.226+0000 7fe365e00640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe348068380 0x7fe34806a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe3580ad000 tx=0x7fe3580a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:47.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.230+0000 7fe35e000640 1 -- 172.21.15.106:0/1787217537 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe368142e30 con 0x7fe3680cd0d0 2024-04-26T21:17:47.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.386+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe368074020 con 0x7fe348068380 2024-04-26T21:17:47.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.390+0000 7fe35e000640 1 -- 172.21.15.106:0/1787217537 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247143 (secure 0 0 0) 0x7fe368074020 con 0x7fe348068380 2024-04-26T21:17:47.398 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:47.399 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:17:47.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe348068380 msgr2=0x7fe34806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe348068380 0x7fe34806a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe3580ad000 tx=0x7fe3580a6000 comp rx=0 tx=0).stop 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3680cd0d0 msgr2=0x7fe368143110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3680cd0d0 0x7fe368143110 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe35400e960 tx=0x7fe35400ee20 comp rx=0 tx=0).stop 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 shutdown_connections 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fe348068380 0x7fe34806a840 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe3680d1bf0 0x7fe368157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3680cd0d0 0x7fe368143110 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 --2- 172.21.15.106:0/1787217537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3680b3220 0x7fe3681428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 >> 172.21.15.106:0/1787217537 conn(0x7fe3680d2a80 msgr2=0x7fe3680cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 shutdown_connections 2024-04-26T21:17:47.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.394+0000 7fe367200640 1 -- 172.21.15.106:0/1787217537 wait complete. 2024-04-26T21:17:47.419 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-26T21:17:46.307672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220716,"kb_used_data":4548,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754004,"statfs":{"total":773094113280,"available":772868100096,"internally_reserved":0,"allocated":4657152,"data_stored":2633128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.998078"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325971+0000","last_change":"2024-04-26T21:17:42.325971+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325971+0000","last_undegraded":"2024-04-26T21:17:42.325971+0000","last_fullsized":"2024-04-26T21:17:42.325971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324918+0000","last_change":"2024-04-26T21:17:42.324918+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324918+0000","last_undegraded":"2024-04-26T21:17:42.324918+0000","last_fullsized":"2024-04-26T21:17:42.324918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.334896+0000","last_change":"2024-04-26T21:17:42.334896+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.334896+0000","last_undegraded":"2024-04-26T21:17:42.334896+0000","last_fullsized":"2024-04-26T21:17:42.334896+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352639+0000","last_change":"2024-04-26T21:17:43.344118+0000","last_active":"2024-04-26T21:17:44.352639+0000","last_peered":"2024-04-26T21:17:44.352639+0000","last_clean":"2024-04-26T21:17:44.352639+0000","last_became_active":"2024-04-26T21:17:43.343673+0000","last_became_peered":"2024-04-26T21:17:43.343673+0000","last_unstale":"2024-04-26T21:17:44.352639+0000","last_undegraded":"2024-04-26T21:17:44.352639+0000","last_fullsized":"2024-04-26T21:17:44.352639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:28.124260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352497+0000","last_change":"2024-04-26T21:17:43.342242+0000","last_active":"2024-04-26T21:17:44.352497+0000","last_peered":"2024-04-26T21:17:44.352497+0000","last_clean":"2024-04-26T21:17:44.352497+0000","last_became_active":"2024-04-26T21:17:43.342000+0000","last_became_peered":"2024-04-26T21:17:43.342000+0000","last_unstale":"2024-04-26T21:17:44.352497+0000","last_undegraded":"2024-04-26T21:17:44.352497+0000","last_fullsized":"2024-04-26T21:17:44.352497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:43.733147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324327+0000","last_change":"2024-04-26T21:17:42.324327+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324327+0000","last_undegraded":"2024-04-26T21:17:42.324327+0000","last_fullsized":"2024-04-26T21:17:42.324327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327075+0000","last_change":"2024-04-26T21:17:42.327075+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327075+0000","last_undegraded":"2024-04-26T21:17:42.327075+0000","last_fullsized":"2024-04-26T21:17:42.327075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324934+0000","last_change":"2024-04-26T21:17:42.324934+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324934+0000","last_undegraded":"2024-04-26T21:17:42.324934+0000","last_fullsized":"2024-04-26T21:17:42.324934+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330824+0000","last_change":"2024-04-26T21:17:42.330824+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330824+0000","last_undegraded":"2024-04-26T21:17:42.330824+0000","last_fullsized":"2024-04-26T21:17:42.330824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326116+0000","last_change":"2024-04-26T21:17:42.326116+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326116+0000","last_undegraded":"2024-04-26T21:17:42.326116+0000","last_fullsized":"2024-04-26T21:17:42.326116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325217+0000","last_change":"2024-04-26T21:17:42.325217+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325217+0000","last_undegraded":"2024-04-26T21:17:42.325217+0000","last_fullsized":"2024-04-26T21:17:42.325217+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330256+0000","last_change":"2024-04-26T21:17:42.330256+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330256+0000","last_undegraded":"2024-04-26T21:17:42.330256+0000","last_fullsized":"2024-04-26T21:17:42.330256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325607+0000","last_change":"2024-04-26T21:17:42.325607+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325607+0000","last_undegraded":"2024-04-26T21:17:42.325607+0000","last_fullsized":"2024-04-26T21:17:42.325607+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325791+0000","last_change":"2024-04-26T21:17:42.325791+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325791+0000","last_undegraded":"2024-04-26T21:17:42.325791+0000","last_fullsized":"2024-04-26T21:17:42.325791+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326616+0000","last_change":"2024-04-26T21:17:42.326616+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326616+0000","last_undegraded":"2024-04-26T21:17:42.326616+0000","last_fullsized":"2024-04-26T21:17:42.326616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330187+0000","last_change":"2024-04-26T21:17:42.330187+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330187+0000","last_undegraded":"2024-04-26T21:17:42.330187+0000","last_fullsized":"2024-04-26T21:17:42.330187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330036+0000","last_change":"2024-04-26T21:17:42.330036+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330036+0000","last_undegraded":"2024-04-26T21:17:42.330036+0000","last_fullsized":"2024-04-26T21:17:42.330036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.329633+0000","last_change":"2024-04-26T21:17:42.329633+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.329633+0000","last_undegraded":"2024-04-26T21:17:42.329633+0000","last_fullsized":"2024-04-26T21:17:42.329633+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352564+0000","last_change":"2024-04-26T21:17:43.348983+0000","last_active":"2024-04-26T21:17:44.352564+0000","last_peered":"2024-04-26T21:17:44.352564+0000","last_clean":"2024-04-26T21:17:44.352564+0000","last_became_active":"2024-04-26T21:17:43.348709+0000","last_became_peered":"2024-04-26T21:17:43.348709+0000","last_unstale":"2024-04-26T21:17:44.352564+0000","last_undegraded":"2024-04-26T21:17:44.352564+0000","last_fullsized":"2024-04-26T21:17:44.352564+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:19.584578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330744+0000","last_change":"2024-04-26T21:17:42.330744+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330744+0000","last_undegraded":"2024-04-26T21:17:42.330744+0000","last_fullsized":"2024-04-26T21:17:42.330744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325194+0000","last_change":"2024-04-26T21:17:42.325194+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325194+0000","last_undegraded":"2024-04-26T21:17:42.325194+0000","last_fullsized":"2024-04-26T21:17:42.325194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324863+0000","last_change":"2024-04-26T21:17:42.324863+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324863+0000","last_undegraded":"2024-04-26T21:17:42.324863+0000","last_fullsized":"2024-04-26T21:17:42.324863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.332663+0000","last_change":"2024-04-26T21:17:42.332663+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.332663+0000","last_undegraded":"2024-04-26T21:17:42.332663+0000","last_fullsized":"2024-04-26T21:17:42.332663+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352349+0000","last_change":"2024-04-26T21:17:43.336925+0000","last_active":"2024-04-26T21:17:44.352349+0000","last_peered":"2024-04-26T21:17:44.352349+0000","last_clean":"2024-04-26T21:17:44.352349+0000","last_became_active":"2024-04-26T21:17:43.330141+0000","last_became_peered":"2024-04-26T21:17:43.330141+0000","last_unstale":"2024-04-26T21:17:44.352349+0000","last_undegraded":"2024-04-26T21:17:44.352349+0000","last_fullsized":"2024-04-26T21:17:44.352349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:22.996159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.332644+0000","last_change":"2024-04-26T21:17:42.332644+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.332644+0000","last_undegraded":"2024-04-26T21:17:42.332644+0000","last_fullsized":"2024-04-26T21:17:42.332644+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.323804+0000","last_change":"2024-04-26T21:17:42.323804+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.323804+0000","last_undegraded":"2024-04-26T21:17:42.323804+0000","last_fullsized":"2024-04-26T21:17:42.323804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331124+0000","last_change":"2024-04-26T21:17:42.331124+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331124+0000","last_undegraded":"2024-04-26T21:17:42.331124+0000","last_fullsized":"2024-04-26T21:17:42.331124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325768+0000","last_change":"2024-04-26T21:17:42.325768+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325768+0000","last_undegraded":"2024-04-26T21:17:42.325768+0000","last_fullsized":"2024-04-26T21:17:42.325768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330365+0000","last_change":"2024-04-26T21:17:42.330365+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330365+0000","last_undegraded":"2024-04-26T21:17:42.330365+0000","last_fullsized":"2024-04-26T21:17:42.330365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331956+0000","last_change":"2024-04-26T21:17:42.331956+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331956+0000","last_undegraded":"2024-04-26T21:17:42.331956+0000","last_fullsized":"2024-04-26T21:17:42.331956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331349+0000","last_change":"2024-04-26T21:17:42.331349+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331349+0000","last_undegraded":"2024-04-26T21:17:42.331349+0000","last_fullsized":"2024-04-26T21:17:42.331349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322372+0000","last_change":"2024-04-26T21:17:42.322372+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322372+0000","last_undegraded":"2024-04-26T21:17:42.322372+0000","last_fullsized":"2024-04-26T21:17:42.322372+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330396+0000","last_change":"2024-04-26T21:17:42.330396+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330396+0000","last_undegraded":"2024-04-26T21:17:42.330396+0000","last_fullsized":"2024-04-26T21:17:42.330396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350348+0000","last_change":"2024-04-26T21:17:42.343816+0000","last_active":"2024-04-26T21:17:42.350348+0000","last_peered":"2024-04-26T21:17:42.350348+0000","last_clean":"2024-04-26T21:17:42.350348+0000","last_became_active":"2024-04-26T21:17:42.342970+0000","last_became_peered":"2024-04-26T21:17:42.342970+0000","last_unstale":"2024-04-26T21:17:42.350348+0000","last_undegraded":"2024-04-26T21:17:42.350348+0000","last_fullsized":"2024-04-26T21:17:42.350348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.914925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.321717+0000","last_change":"2024-04-26T21:17:42.321717+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.321717+0000","last_undegraded":"2024-04-26T21:17:42.321717+0000","last_fullsized":"2024-04-26T21:17:42.321717+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.346639+0000","last_change":"2024-04-26T21:17:42.345983+0000","last_active":"2024-04-26T21:17:42.346639+0000","last_peered":"2024-04-26T21:17:42.346639+0000","last_clean":"2024-04-26T21:17:42.346639+0000","last_became_active":"2024-04-26T21:17:42.345713+0000","last_became_peered":"2024-04-26T21:17:42.345713+0000","last_unstale":"2024-04-26T21:17:42.346639+0000","last_undegraded":"2024-04-26T21:17:42.346639+0000","last_fullsized":"2024-04-26T21:17:42.346639+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326205+0000","last_change":"2024-04-26T21:17:42.326205+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326205+0000","last_undegraded":"2024-04-26T21:17:42.326205+0000","last_fullsized":"2024-04-26T21:17:42.326205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.334767+0000","last_change":"2024-04-26T21:17:42.331607+0000","last_active":"2024-04-26T21:17:42.334767+0000","last_peered":"2024-04-26T21:17:42.334767+0000","last_clean":"2024-04-26T21:17:42.334767+0000","last_became_active":"2024-04-26T21:17:42.331352+0000","last_became_peered":"2024-04-26T21:17:42.331352+0000","last_unstale":"2024-04-26T21:17:42.334767+0000","last_undegraded":"2024-04-26T21:17:42.334767+0000","last_fullsized":"2024-04-26T21:17:42.334767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325541+0000","last_change":"2024-04-26T21:17:42.325541+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325541+0000","last_undegraded":"2024-04-26T21:17:42.325541+0000","last_fullsized":"2024-04-26T21:17:42.325541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.337829+0000","last_change":"2024-04-26T21:17:42.331626+0000","last_active":"2024-04-26T21:17:42.337829+0000","last_peered":"2024-04-26T21:17:42.337829+0000","last_clean":"2024-04-26T21:17:42.337829+0000","last_became_active":"2024-04-26T21:17:42.331295+0000","last_became_peered":"2024-04-26T21:17:42.331295+0000","last_unstale":"2024-04-26T21:17:42.337829+0000","last_undegraded":"2024-04-26T21:17:42.337829+0000","last_fullsized":"2024-04-26T21:17:42.337829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:08.843853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.336539+0000","last_change":"2024-04-26T21:17:42.336539+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.336539+0000","last_undegraded":"2024-04-26T21:17:42.336539+0000","last_fullsized":"2024-04-26T21:17:42.336539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345540+0000","last_change":"2024-04-26T21:17:42.341073+0000","last_active":"2024-04-26T21:17:42.345540+0000","last_peered":"2024-04-26T21:17:42.345540+0000","last_clean":"2024-04-26T21:17:42.345540+0000","last_became_active":"2024-04-26T21:17:42.340849+0000","last_became_peered":"2024-04-26T21:17:42.340849+0000","last_unstale":"2024-04-26T21:17:42.345540+0000","last_undegraded":"2024-04-26T21:17:42.345540+0000","last_fullsized":"2024-04-26T21:17:42.345540+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:59.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326170+0000","last_change":"2024-04-26T21:17:42.326170+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326170+0000","last_undegraded":"2024-04-26T21:17:42.326170+0000","last_fullsized":"2024-04-26T21:17:42.326170+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345701+0000","last_change":"2024-04-26T21:17:42.342767+0000","last_active":"2024-04-26T21:17:42.345701+0000","last_peered":"2024-04-26T21:17:42.345701+0000","last_clean":"2024-04-26T21:17:42.345701+0000","last_became_active":"2024-04-26T21:17:42.342487+0000","last_became_peered":"2024-04-26T21:17:42.342487+0000","last_unstale":"2024-04-26T21:17:42.345701+0000","last_undegraded":"2024-04-26T21:17:42.345701+0000","last_fullsized":"2024-04-26T21:17:42.345701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.323614+0000","last_change":"2024-04-26T21:17:42.323614+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.323614+0000","last_undegraded":"2024-04-26T21:17:42.323614+0000","last_fullsized":"2024-04-26T21:17:42.323614+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.337640+0000","last_change":"2024-04-26T21:17:42.335963+0000","last_active":"2024-04-26T21:17:42.337640+0000","last_peered":"2024-04-26T21:17:42.337640+0000","last_clean":"2024-04-26T21:17:42.337640+0000","last_became_active":"2024-04-26T21:17:42.335654+0000","last_became_peered":"2024-04-26T21:17:42.335654+0000","last_unstale":"2024-04-26T21:17:42.337640+0000","last_undegraded":"2024-04-26T21:17:42.337640+0000","last_fullsized":"2024-04-26T21:17:42.337640+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.328215+0000","last_change":"2024-04-26T21:17:42.328215+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.328215+0000","last_undegraded":"2024-04-26T21:17:42.328215+0000","last_fullsized":"2024-04-26T21:17:42.328215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.343466+0000","last_change":"2024-04-26T21:17:42.339198+0000","last_active":"2024-04-26T21:17:42.343466+0000","last_peered":"2024-04-26T21:17:42.343466+0000","last_clean":"2024-04-26T21:17:42.343466+0000","last_became_active":"2024-04-26T21:17:42.338880+0000","last_became_peered":"2024-04-26T21:17:42.338880+0000","last_unstale":"2024-04-26T21:17:42.343466+0000","last_undegraded":"2024-04-26T21:17:42.343466+0000","last_fullsized":"2024-04-26T21:17:42.343466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:22.514736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352642+0000","last_change":"2024-04-26T21:17:43.343916+0000","last_active":"2024-04-26T21:17:44.352642+0000","last_peered":"2024-04-26T21:17:44.352642+0000","last_clean":"2024-04-26T21:17:44.352642+0000","last_became_active":"2024-04-26T21:17:43.343321+0000","last_became_peered":"2024-04-26T21:17:43.343321+0000","last_unstale":"2024-04-26T21:17:44.352642+0000","last_undegraded":"2024-04-26T21:17:44.352642+0000","last_fullsized":"2024-04-26T21:17:44.352642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:59.139005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.339164+0000","last_change":"2024-04-26T21:17:42.331814+0000","last_active":"2024-04-26T21:17:42.339164+0000","last_peered":"2024-04-26T21:17:42.339164+0000","last_clean":"2024-04-26T21:17:42.339164+0000","last_became_active":"2024-04-26T21:17:42.329773+0000","last_became_peered":"2024-04-26T21:17:42.329773+0000","last_unstale":"2024-04-26T21:17:42.339164+0000","last_undegraded":"2024-04-26T21:17:42.339164+0000","last_fullsized":"2024-04-26T21:17:42.339164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:46.523068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327073+0000","last_change":"2024-04-26T21:17:42.327073+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327073+0000","last_undegraded":"2024-04-26T21:17:42.327073+0000","last_fullsized":"2024-04-26T21:17:42.327073+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.339240+0000","last_change":"2024-04-26T21:17:42.334519+0000","last_active":"2024-04-26T21:17:42.339240+0000","last_peered":"2024-04-26T21:17:42.339240+0000","last_clean":"2024-04-26T21:17:42.339240+0000","last_became_active":"2024-04-26T21:17:42.334204+0000","last_became_peered":"2024-04-26T21:17:42.334204+0000","last_unstale":"2024-04-26T21:17:42.339240+0000","last_undegraded":"2024-04-26T21:17:42.339240+0000","last_fullsized":"2024-04-26T21:17:42.339240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.333627+0000","last_change":"2024-04-26T21:17:42.333627+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.333627+0000","last_undegraded":"2024-04-26T21:17:42.333627+0000","last_fullsized":"2024-04-26T21:17:42.333627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345267+0000","last_change":"2024-04-26T21:17:42.340533+0000","last_active":"2024-04-26T21:17:42.345267+0000","last_peered":"2024-04-26T21:17:42.345267+0000","last_clean":"2024-04-26T21:17:42.345267+0000","last_became_active":"2024-04-26T21:17:42.340333+0000","last_became_peered":"2024-04-26T21:17:42.340333+0000","last_unstale":"2024-04-26T21:17:42.345267+0000","last_undegraded":"2024-04-26T21:17:42.345267+0000","last_fullsized":"2024-04-26T21:17:42.345267+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327145+0000","last_change":"2024-04-26T21:17:42.327145+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327145+0000","last_undegraded":"2024-04-26T21:17:42.327145+0000","last_fullsized":"2024-04-26T21:17:42.327145+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345613+0000","last_change":"2024-04-26T21:17:42.342883+0000","last_active":"2024-04-26T21:17:42.345613+0000","last_peered":"2024-04-26T21:17:42.345613+0000","last_clean":"2024-04-26T21:17:42.345613+0000","last_became_active":"2024-04-26T21:17:42.342378+0000","last_became_peered":"2024-04-26T21:17:42.342378+0000","last_unstale":"2024-04-26T21:17:42.345613+0000","last_undegraded":"2024-04-26T21:17:42.345613+0000","last_fullsized":"2024-04-26T21:17:42.345613+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:11.615397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.336159+0000","last_change":"2024-04-26T21:17:42.336159+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.336159+0000","last_undegraded":"2024-04-26T21:17:42.336159+0000","last_fullsized":"2024-04-26T21:17:42.336159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.343826+0000","last_change":"2024-04-26T21:17:42.341405+0000","last_active":"2024-04-26T21:17:42.343826+0000","last_peered":"2024-04-26T21:17:42.343826+0000","last_clean":"2024-04-26T21:17:42.343826+0000","last_became_active":"2024-04-26T21:17:42.340573+0000","last_became_peered":"2024-04-26T21:17:42.340573+0000","last_unstale":"2024-04-26T21:17:42.343826+0000","last_undegraded":"2024-04-26T21:17:42.343826+0000","last_fullsized":"2024-04-26T21:17:42.343826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:00.764821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.321696+0000","last_change":"2024-04-26T21:17:42.321696+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.321696+0000","last_undegraded":"2024-04-26T21:17:42.321696+0000","last_fullsized":"2024-04-26T21:17:42.321696+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.336725+0000","last_change":"2024-04-26T21:17:42.334314+0000","last_active":"2024-04-26T21:17:42.336725+0000","last_peered":"2024-04-26T21:17:42.336725+0000","last_clean":"2024-04-26T21:17:42.336725+0000","last_became_active":"2024-04-26T21:17:42.334063+0000","last_became_peered":"2024-04-26T21:17:42.334063+0000","last_unstale":"2024-04-26T21:17:42.336725+0000","last_undegraded":"2024-04-26T21:17:42.336725+0000","last_fullsized":"2024-04-26T21:17:42.336725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.328232+0000","last_change":"2024-04-26T21:17:42.328232+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.328232+0000","last_undegraded":"2024-04-26T21:17:42.328232+0000","last_fullsized":"2024-04-26T21:17:42.328232+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350267+0000","last_change":"2024-04-26T21:17:42.343295+0000","last_active":"2024-04-26T21:17:42.350267+0000","last_peered":"2024-04-26T21:17:42.350267+0000","last_clean":"2024-04-26T21:17:42.350267+0000","last_became_active":"2024-04-26T21:17:42.343005+0000","last_became_peered":"2024-04-26T21:17:42.343005+0000","last_unstale":"2024-04-26T21:17:42.350267+0000","last_undegraded":"2024-04-26T21:17:42.350267+0000","last_fullsized":"2024-04-26T21:17:42.350267+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:36.094637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324751+0000","last_change":"2024-04-26T21:17:42.324751+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324751+0000","last_undegraded":"2024-04-26T21:17:42.324751+0000","last_fullsized":"2024-04-26T21:17:42.324751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.347427+0000","last_change":"2024-04-26T21:17:42.343042+0000","last_active":"2024-04-26T21:17:42.347427+0000","last_peered":"2024-04-26T21:17:42.347427+0000","last_clean":"2024-04-26T21:17:42.347427+0000","last_became_active":"2024-04-26T21:17:42.342560+0000","last_became_peered":"2024-04-26T21:17:42.342560+0000","last_unstale":"2024-04-26T21:17:42.347427+0000","last_undegraded":"2024-04-26T21:17:42.347427+0000","last_fullsized":"2024-04-26T21:17:42.347427+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322102+0000","last_change":"2024-04-26T21:17:42.322102+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322102+0000","last_undegraded":"2024-04-26T21:17:42.322102+0000","last_fullsized":"2024-04-26T21:17:42.322102+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.346109+0000","last_change":"2024-04-26T21:17:42.339674+0000","last_active":"2024-04-26T21:17:42.346109+0000","last_peered":"2024-04-26T21:17:42.346109+0000","last_clean":"2024-04-26T21:17:42.346109+0000","last_became_active":"2024-04-26T21:17:42.339432+0000","last_became_peered":"2024-04-26T21:17:42.339432+0000","last_unstale":"2024-04-26T21:17:42.346109+0000","last_undegraded":"2024-04-26T21:17:42.346109+0000","last_fullsized":"2024-04-26T21:17:42.346109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324691+0000","last_change":"2024-04-26T21:17:42.324691+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324691+0000","last_undegraded":"2024-04-26T21:17:42.324691+0000","last_fullsized":"2024-04-26T21:17:42.324691+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.343500+0000","last_change":"2024-04-26T21:17:42.339219+0000","last_active":"2024-04-26T21:17:42.343500+0000","last_peered":"2024-04-26T21:17:42.343500+0000","last_clean":"2024-04-26T21:17:42.343500+0000","last_became_active":"2024-04-26T21:17:42.338644+0000","last_became_peered":"2024-04-26T21:17:42.338644+0000","last_unstale":"2024-04-26T21:17:42.343500+0000","last_undegraded":"2024-04-26T21:17:42.343500+0000","last_fullsized":"2024-04-26T21:17:42.343500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:43.477240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326636+0000","last_change":"2024-04-26T21:17:42.326636+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326636+0000","last_undegraded":"2024-04-26T21:17:42.326636+0000","last_fullsized":"2024-04-26T21:17:42.326636+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352602+0000","last_change":"2024-04-26T21:17:42.343539+0000","last_active":"2024-04-26T21:17:44.352602+0000","last_peered":"2024-04-26T21:17:44.352602+0000","last_clean":"2024-04-26T21:17:44.352602+0000","last_became_active":"2024-04-26T21:17:42.343185+0000","last_became_peered":"2024-04-26T21:17:42.343185+0000","last_unstale":"2024-04-26T21:17:44.352602+0000","last_undegraded":"2024-04-26T21:17:44.352602+0000","last_fullsized":"2024-04-26T21:17:44.352602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:09.794788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352739+0000","last_change":"2024-04-26T21:17:43.337701+0000","last_active":"2024-04-26T21:17:44.352739+0000","last_peered":"2024-04-26T21:17:44.352739+0000","last_clean":"2024-04-26T21:17:44.352739+0000","last_became_active":"2024-04-26T21:17:43.337408+0000","last_became_peered":"2024-04-26T21:17:43.337408+0000","last_unstale":"2024-04-26T21:17:44.352739+0000","last_undegraded":"2024-04-26T21:17:44.352739+0000","last_fullsized":"2024-04-26T21:17:44.352739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:24.993078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.336187+0000","last_change":"2024-04-26T21:17:42.332453+0000","last_active":"2024-04-26T21:17:42.336187+0000","last_peered":"2024-04-26T21:17:42.336187+0000","last_clean":"2024-04-26T21:17:42.336187+0000","last_became_active":"2024-04-26T21:17:42.332152+0000","last_became_peered":"2024-04-26T21:17:42.332152+0000","last_unstale":"2024-04-26T21:17:42.336187+0000","last_undegraded":"2024-04-26T21:17:42.336187+0000","last_fullsized":"2024-04-26T21:17:42.336187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.329729+0000","last_change":"2024-04-26T21:17:42.329729+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.329729+0000","last_undegraded":"2024-04-26T21:17:42.329729+0000","last_fullsized":"2024-04-26T21:17:42.329729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352455+0000","last_change":"2024-04-26T21:17:42.341816+0000","last_active":"2024-04-26T21:17:44.352455+0000","last_peered":"2024-04-26T21:17:44.352455+0000","last_clean":"2024-04-26T21:17:44.352455+0000","last_became_active":"2024-04-26T21:17:42.341562+0000","last_became_peered":"2024-04-26T21:17:42.341562+0000","last_unstale":"2024-04-26T21:17:44.352455+0000","last_undegraded":"2024-04-26T21:17:44.352455+0000","last_fullsized":"2024-04-26T21:17:44.352455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:36.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330154+0000","last_change":"2024-04-26T21:17:42.330154+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330154+0000","last_undegraded":"2024-04-26T21:17:42.330154+0000","last_fullsized":"2024-04-26T21:17:42.330154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352398+0000","last_change":"2024-04-26T21:17:42.338754+0000","last_active":"2024-04-26T21:17:44.352398+0000","last_peered":"2024-04-26T21:17:44.352398+0000","last_clean":"2024-04-26T21:17:44.352398+0000","last_became_active":"2024-04-26T21:17:42.338473+0000","last_became_peered":"2024-04-26T21:17:42.338473+0000","last_unstale":"2024-04-26T21:17:44.352398+0000","last_undegraded":"2024-04-26T21:17:44.352398+0000","last_fullsized":"2024-04-26T21:17:44.352398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:06.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324880+0000","last_change":"2024-04-26T21:17:42.324880+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324880+0000","last_undegraded":"2024-04-26T21:17:42.324880+0000","last_fullsized":"2024-04-26T21:17:42.324880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.347496+0000","last_change":"2024-04-26T21:17:42.343967+0000","last_active":"2024-04-26T21:17:42.347496+0000","last_peered":"2024-04-26T21:17:42.347496+0000","last_clean":"2024-04-26T21:17:42.347496+0000","last_became_active":"2024-04-26T21:17:42.343698+0000","last_became_peered":"2024-04-26T21:17:42.343698+0000","last_unstale":"2024-04-26T21:17:42.347496+0000","last_undegraded":"2024-04-26T21:17:42.347496+0000","last_fullsized":"2024-04-26T21:17:42.347496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322093+0000","last_change":"2024-04-26T21:17:42.322093+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322093+0000","last_undegraded":"2024-04-26T21:17:42.322093+0000","last_fullsized":"2024-04-26T21:17:42.322093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352335+0000","last_change":"2024-04-26T21:17:42.339504+0000","last_active":"2024-04-26T21:17:44.352335+0000","last_peered":"2024-04-26T21:17:44.352335+0000","last_clean":"2024-04-26T21:17:44.352335+0000","last_became_active":"2024-04-26T21:17:42.339252+0000","last_became_peered":"2024-04-26T21:17:42.339252+0000","last_unstale":"2024-04-26T21:17:44.352335+0000","last_undegraded":"2024-04-26T21:17:44.352335+0000","last_fullsized":"2024-04-26T21:17:44.352335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:05.142831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.320939+0000","last_change":"2024-04-26T21:17:42.320939+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.320939+0000","last_undegraded":"2024-04-26T21:17:42.320939+0000","last_fullsized":"2024-04-26T21:17:42.320939+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350409+0000","last_change":"2024-04-26T21:17:42.345973+0000","last_active":"2024-04-26T21:17:42.350409+0000","last_peered":"2024-04-26T21:17:42.350409+0000","last_clean":"2024-04-26T21:17:42.350409+0000","last_became_active":"2024-04-26T21:17:42.345147+0000","last_became_peered":"2024-04-26T21:17:42.345147+0000","last_unstale":"2024-04-26T21:17:42.350409+0000","last_undegraded":"2024-04-26T21:17:42.350409+0000","last_fullsized":"2024-04-26T21:17:42.350409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:01.319492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326548+0000","last_change":"2024-04-26T21:17:42.326548+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326548+0000","last_undegraded":"2024-04-26T21:17:42.326548+0000","last_fullsized":"2024-04-26T21:17:42.326548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.354116+0000","last_change":"2024-04-26T21:17:42.342526+0000","last_active":"2024-04-26T21:17:44.354116+0000","last_peered":"2024-04-26T21:17:44.354116+0000","last_clean":"2024-04-26T21:17:44.354116+0000","last_became_active":"2024-04-26T21:17:42.342262+0000","last_became_peered":"2024-04-26T21:17:42.342262+0000","last_unstale":"2024-04-26T21:17:44.354116+0000","last_undegraded":"2024-04-26T21:17:44.354116+0000","last_fullsized":"2024-04-26T21:17:44.354116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:02.905628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322086+0000","last_change":"2024-04-26T21:17:42.322086+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322086+0000","last_undegraded":"2024-04-26T21:17:42.322086+0000","last_fullsized":"2024-04-26T21:17:42.322086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.346178+0000","last_change":"2024-04-26T21:17:42.344849+0000","last_active":"2024-04-26T21:17:42.346178+0000","last_peered":"2024-04-26T21:17:42.346178+0000","last_clean":"2024-04-26T21:17:42.346178+0000","last_became_active":"2024-04-26T21:17:42.344569+0000","last_became_peered":"2024-04-26T21:17:42.344569+0000","last_unstale":"2024-04-26T21:17:42.346178+0000","last_undegraded":"2024-04-26T21:17:42.346178+0000","last_fullsized":"2024-04-26T21:17:42.346178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331323+0000","last_change":"2024-04-26T21:17:42.331323+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331323+0000","last_undegraded":"2024-04-26T21:17:42.331323+0000","last_fullsized":"2024-04-26T21:17:42.331323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345164+0000","last_change":"2024-04-26T21:17:42.343191+0000","last_active":"2024-04-26T21:17:42.345164+0000","last_peered":"2024-04-26T21:17:42.345164+0000","last_clean":"2024-04-26T21:17:42.345164+0000","last_became_active":"2024-04-26T21:17:42.342930+0000","last_became_peered":"2024-04-26T21:17:42.342930+0000","last_unstale":"2024-04-26T21:17:42.345164+0000","last_undegraded":"2024-04-26T21:17:42.345164+0000","last_fullsized":"2024-04-26T21:17:42.345164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.320868+0000","last_change":"2024-04-26T21:17:42.320868+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.320868+0000","last_undegraded":"2024-04-26T21:17:42.320868+0000","last_fullsized":"2024-04-26T21:17:42.320868+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350335+0000","last_change":"2024-04-26T21:17:42.343800+0000","last_active":"2024-04-26T21:17:42.350335+0000","last_peered":"2024-04-26T21:17:42.350335+0000","last_clean":"2024-04-26T21:17:42.350335+0000","last_became_active":"2024-04-26T21:17:42.343481+0000","last_became_peered":"2024-04-26T21:17:42.343481+0000","last_unstale":"2024-04-26T21:17:42.350335+0000","last_undegraded":"2024-04-26T21:17:42.350335+0000","last_fullsized":"2024-04-26T21:17:42.350335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:10.939610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325326+0000","last_change":"2024-04-26T21:17:42.325326+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325326+0000","last_undegraded":"2024-04-26T21:17:42.325326+0000","last_fullsized":"2024-04-26T21:17:42.325326+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.337852+0000","last_change":"2024-04-26T21:17:42.331930+0000","last_active":"2024-04-26T21:17:42.337852+0000","last_peered":"2024-04-26T21:17:42.337852+0000","last_clean":"2024-04-26T21:17:42.337852+0000","last_became_active":"2024-04-26T21:17:42.331650+0000","last_became_peered":"2024-04-26T21:17:42.331650+0000","last_unstale":"2024-04-26T21:17:42.337852+0000","last_undegraded":"2024-04-26T21:17:42.337852+0000","last_fullsized":"2024-04-26T21:17:42.337852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:27.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.329101+0000","last_change":"2024-04-26T21:17:42.329101+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.329101+0000","last_undegraded":"2024-04-26T21:17:42.329101+0000","last_fullsized":"2024-04-26T21:17:42.329101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.331666+0000","last_change":"2024-04-26T21:17:42.328692+0000","last_active":"2024-04-26T21:17:42.331666+0000","last_peered":"2024-04-26T21:17:42.331666+0000","last_clean":"2024-04-26T21:17:42.331666+0000","last_became_active":"2024-04-26T21:17:42.328387+0000","last_became_peered":"2024-04-26T21:17:42.328387+0000","last_unstale":"2024-04-26T21:17:42.331666+0000","last_undegraded":"2024-04-26T21:17:42.331666+0000","last_fullsized":"2024-04-26T21:17:42.331666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:07.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327465+0000","last_change":"2024-04-26T21:17:42.327465+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327465+0000","last_undegraded":"2024-04-26T21:17:42.327465+0000","last_fullsized":"2024-04-26T21:17:42.327465+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.347418+0000","last_change":"2024-04-26T21:17:42.342999+0000","last_active":"2024-04-26T21:17:42.347418+0000","last_peered":"2024-04-26T21:17:42.347418+0000","last_clean":"2024-04-26T21:17:42.347418+0000","last_became_active":"2024-04-26T21:17:42.342017+0000","last_became_peered":"2024-04-26T21:17:42.342017+0000","last_unstale":"2024-04-26T21:17:42.347418+0000","last_undegraded":"2024-04-26T21:17:42.347418+0000","last_fullsized":"2024-04-26T21:17:42.347418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.331878+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:17:42.331878+0000","last_peered":"2024-04-26T21:17:42.331878+0000","last_clean":"2024-04-26T21:17:42.331878+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:17:42.331878+0000","last_undegraded":"2024-04-26T21:17:42.331878+0000","last_fullsized":"2024-04-26T21:17:42.331878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":193715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:17:47.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:17:47.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa50800640 1 Processor -- start 2024-04-26T21:17:47.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa50800640 1 -- start start 2024-04-26T21:17:47.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa50800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa4813f140 0x7ffa4815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa50800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa480b3d10 con 0x7ffa4806eb70 2024-04-26T21:17:47.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa50800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa480b3ff0 con 0x7ffa4813ed60 2024-04-26T21:17:47.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa50800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ffa480b3ac0 con 0x7ffa4813f140 2024-04-26T21:17:47.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa4e800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ffa4806eb70 0x7ffa480d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50914/0 (socket says 172.21.15.106:50914) 2024-04-26T21:17:47.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa4e800640 1 -- 172.21.15.106:0/935839960 learned_addr learned my addr 172.21.15.106:0/935839960 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:47.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa4d400640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa4813f140 0x7ffa4815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.590+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627266706 0 0) 0x7ffa480b3d10 con 0x7ffa4806eb70 2024-04-26T21:17:47.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa30003530 con 0x7ffa4806eb70 2024-04-26T21:17:47.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2619800821 0 0) 0x7ffa30003530 con 0x7ffa4806eb70 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa4813f140 msgr2=0x7ffa4815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa4813f140 0x7ffa4815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 >> v1:172.21.15.112:6789/0 conn(0x7ffa4813ed60 legacy=0x7ffa480b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa480b42d0 con 0x7ffa4806eb70 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7ffa44001a20 con 0x7ffa4806eb70 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 >> v1:172.21.15.106:6789/0 conn(0x7ffa4806eb70 legacy=0x7ffa480d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa300039f0 0x7ffa30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30004310 0x7ffa30004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa3000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480b3ac0 con 0x7ffa30005060 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3000bf40 con 0x7ffa30004310 2024-04-26T21:17:47.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3000c140 con 0x7ffa300039f0 2024-04-26T21:17:47.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4e800640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa3000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4d400640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30004310 0x7ffa30004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4de00640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa300039f0 0x7ffa30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4e800640 1 -- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa300039f0 msgr2=0x7ffa30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:47.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4e800640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa300039f0 0x7ffa30003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4e800640 1 -- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30004310 msgr2=0x7ffa30004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:47.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4e800640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30004310 0x7ffa30004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.594+0000 7ffa4e800640 1 -- 172.21.15.106:0/935839960 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa30003530 con 0x7ffa30005060 2024-04-26T21:17:47.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa4e800640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa3000b9d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ffa4815f930 tx=0x7ffa4401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2a9974aed850fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:47.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4400a4a0 con 0x7ffa30005060 2024-04-26T21:17:47.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa440ad630 con 0x7ffa30005060 2024-04-26T21:17:47.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa4ca00640 1 -- 172.21.15.106:0/935839960 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa440ada20 con 0x7ffa30005060 2024-04-26T21:17:47.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 -- 172.21.15.106:0/935839960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 msgr2=0x7ffa3000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 --2- 172.21.15.106:0/935839960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa3000b9d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ffa4815f930 tx=0x7ffa4401d2e0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa4e800640 1 -- 172.21.15.106:0/935839960 reap_dead start 2024-04-26T21:17:47.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 -- 172.21.15.106:0/935839960 shutdown_connections 2024-04-26T21:17:47.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 -- 172.21.15.106:0/935839960 >> 172.21.15.106:0/935839960 conn(0x7ffa48068340 msgr2=0x7ffa48068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:47.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 -- 172.21.15.106:0/935839960 shutdown_connections 2024-04-26T21:17:47.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 -- 172.21.15.106:0/935839960 wait complete. 2024-04-26T21:17:47.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 Processor -- start 2024-04-26T21:17:47.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 -- start start 2024-04-26T21:17:47.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa4813a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa480ac470 0x7ffa480ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa480aa4c0 0x7ffa480aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480d1500 con 0x7ffa30005060 2024-04-26T21:17:47.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480b4920 con 0x7ffa480aa4c0 2024-04-26T21:17:47.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa50800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ffa480d1680 con 0x7ffa480ac470 2024-04-26T21:17:47.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa4de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa4813a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa4de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa4813a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39056/0 (socket says 172.21.15.106:39056) 2024-04-26T21:17:47.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.598+0000 7ffa4de00640 1 -- 172.21.15.106:0/1976356048 learned_addr learned my addr 172.21.15.106:0/1976356048 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:47.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa4de00640 1 -- 172.21.15.106:0/1976356048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa480ac470 msgr2=0x7ffa480ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa4de00640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa480ac470 0x7ffa480ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa4de00640 1 -- 172.21.15.106:0/1976356048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa480aa4c0 msgr2=0x7ffa480aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa4de00640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa480aa4c0 0x7ffa480aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa4de00640 1 -- 172.21.15.106:0/1976356048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa481f3bb0 con 0x7ffa30005060 2024-04-26T21:17:47.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa4de00640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa4813a6b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c011bb0 tx=0x7ffa3c00f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:47.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa42000640 1 -- 172.21.15.106:0/1976356048 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c019020 con 0x7ffa30005060 2024-04-26T21:17:47.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa42000640 1 -- 172.21.15.106:0/1976356048 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa3c00fc30 con 0x7ffa30005060 2024-04-26T21:17:47.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa481f3e90 con 0x7ffa30005060 2024-04-26T21:17:47.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa42000640 1 -- 172.21.15.106:0/1976356048 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0050d0 con 0x7ffa30005060 2024-04-26T21:17:47.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa481f4450 con 0x7ffa30005060 2024-04-26T21:17:47.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa48069400 con 0x7ffa30005060 2024-04-26T21:17:47.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa42000640 1 -- 172.21.15.106:0/1976356048 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffa3c01c020 con 0x7ffa30005060 2024-04-26T21:17:47.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa42000640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffa2c068380 0x7ffa2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa42000640 1 -- 172.21.15.106:0/1976356048 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7ffa3c089fc0 con 0x7ffa30005060 2024-04-26T21:17:47.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.602+0000 7ffa4d400640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffa2c068380 0x7ffa2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.606+0000 7ffa4d400640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffa2c068380 0x7ffa2c06a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa480b5750 tx=0x7ffa380095f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:47.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.606+0000 7ffa42000640 1 -- 172.21.15.106:0/1976356048 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffa3c023030 con 0x7ffa30005060 2024-04-26T21:17:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.758+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa480b1bd0 con 0x7ffa2c068380 2024-04-26T21:17:47.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.766+0000 7ffa42000640 1 -- 172.21.15.106:0/1976356048 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247143 (secure 0 0 0) 0x7ffa480b1bd0 con 0x7ffa2c068380 2024-04-26T21:17:47.772 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:47.774 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:17:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffa2c068380 msgr2=0x7ffa2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffa2c068380 0x7ffa2c06a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa480b5750 tx=0x7ffa380095f0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 msgr2=0x7ffa4813a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa4813a6b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c011bb0 tx=0x7ffa3c00f5a0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 shutdown_connections 2024-04-26T21:17:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa480aa4c0 0x7ffa480aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ffa2c068380 0x7ffa2c06a840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa480ac470 0x7ffa480ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 --2- 172.21.15.106:0/1976356048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30005060 0x7ffa4813a6b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 >> 172.21.15.106:0/1976356048 conn(0x7ffa48068340 msgr2=0x7ffa48160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 shutdown_connections 2024-04-26T21:17:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.770+0000 7ffa50800640 1 -- 172.21.15.106:0/1976356048 wait complete. 2024-04-26T21:17:47.793 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-26T21:17:46.307672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220716,"kb_used_data":4548,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754004,"statfs":{"total":773094113280,"available":772868100096,"internally_reserved":0,"allocated":4657152,"data_stored":2633128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.998078"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325971+0000","last_change":"2024-04-26T21:17:42.325971+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325971+0000","last_undegraded":"2024-04-26T21:17:42.325971+0000","last_fullsized":"2024-04-26T21:17:42.325971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324918+0000","last_change":"2024-04-26T21:17:42.324918+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324918+0000","last_undegraded":"2024-04-26T21:17:42.324918+0000","last_fullsized":"2024-04-26T21:17:42.324918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.334896+0000","last_change":"2024-04-26T21:17:42.334896+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.334896+0000","last_undegraded":"2024-04-26T21:17:42.334896+0000","last_fullsized":"2024-04-26T21:17:42.334896+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352639+0000","last_change":"2024-04-26T21:17:43.344118+0000","last_active":"2024-04-26T21:17:44.352639+0000","last_peered":"2024-04-26T21:17:44.352639+0000","last_clean":"2024-04-26T21:17:44.352639+0000","last_became_active":"2024-04-26T21:17:43.343673+0000","last_became_peered":"2024-04-26T21:17:43.343673+0000","last_unstale":"2024-04-26T21:17:44.352639+0000","last_undegraded":"2024-04-26T21:17:44.352639+0000","last_fullsized":"2024-04-26T21:17:44.352639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:28.124260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352497+0000","last_change":"2024-04-26T21:17:43.342242+0000","last_active":"2024-04-26T21:17:44.352497+0000","last_peered":"2024-04-26T21:17:44.352497+0000","last_clean":"2024-04-26T21:17:44.352497+0000","last_became_active":"2024-04-26T21:17:43.342000+0000","last_became_peered":"2024-04-26T21:17:43.342000+0000","last_unstale":"2024-04-26T21:17:44.352497+0000","last_undegraded":"2024-04-26T21:17:44.352497+0000","last_fullsized":"2024-04-26T21:17:44.352497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:43.733147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324327+0000","last_change":"2024-04-26T21:17:42.324327+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324327+0000","last_undegraded":"2024-04-26T21:17:42.324327+0000","last_fullsized":"2024-04-26T21:17:42.324327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327075+0000","last_change":"2024-04-26T21:17:42.327075+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327075+0000","last_undegraded":"2024-04-26T21:17:42.327075+0000","last_fullsized":"2024-04-26T21:17:42.327075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324934+0000","last_change":"2024-04-26T21:17:42.324934+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324934+0000","last_undegraded":"2024-04-26T21:17:42.324934+0000","last_fullsized":"2024-04-26T21:17:42.324934+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330824+0000","last_change":"2024-04-26T21:17:42.330824+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330824+0000","last_undegraded":"2024-04-26T21:17:42.330824+0000","last_fullsized":"2024-04-26T21:17:42.330824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326116+0000","last_change":"2024-04-26T21:17:42.326116+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326116+0000","last_undegraded":"2024-04-26T21:17:42.326116+0000","last_fullsized":"2024-04-26T21:17:42.326116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325217+0000","last_change":"2024-04-26T21:17:42.325217+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325217+0000","last_undegraded":"2024-04-26T21:17:42.325217+0000","last_fullsized":"2024-04-26T21:17:42.325217+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330256+0000","last_change":"2024-04-26T21:17:42.330256+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330256+0000","last_undegraded":"2024-04-26T21:17:42.330256+0000","last_fullsized":"2024-04-26T21:17:42.330256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325607+0000","last_change":"2024-04-26T21:17:42.325607+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325607+0000","last_undegraded":"2024-04-26T21:17:42.325607+0000","last_fullsized":"2024-04-26T21:17:42.325607+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325791+0000","last_change":"2024-04-26T21:17:42.325791+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325791+0000","last_undegraded":"2024-04-26T21:17:42.325791+0000","last_fullsized":"2024-04-26T21:17:42.325791+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326616+0000","last_change":"2024-04-26T21:17:42.326616+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326616+0000","last_undegraded":"2024-04-26T21:17:42.326616+0000","last_fullsized":"2024-04-26T21:17:42.326616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330187+0000","last_change":"2024-04-26T21:17:42.330187+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330187+0000","last_undegraded":"2024-04-26T21:17:42.330187+0000","last_fullsized":"2024-04-26T21:17:42.330187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330036+0000","last_change":"2024-04-26T21:17:42.330036+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330036+0000","last_undegraded":"2024-04-26T21:17:42.330036+0000","last_fullsized":"2024-04-26T21:17:42.330036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.329633+0000","last_change":"2024-04-26T21:17:42.329633+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.329633+0000","last_undegraded":"2024-04-26T21:17:42.329633+0000","last_fullsized":"2024-04-26T21:17:42.329633+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352564+0000","last_change":"2024-04-26T21:17:43.348983+0000","last_active":"2024-04-26T21:17:44.352564+0000","last_peered":"2024-04-26T21:17:44.352564+0000","last_clean":"2024-04-26T21:17:44.352564+0000","last_became_active":"2024-04-26T21:17:43.348709+0000","last_became_peered":"2024-04-26T21:17:43.348709+0000","last_unstale":"2024-04-26T21:17:44.352564+0000","last_undegraded":"2024-04-26T21:17:44.352564+0000","last_fullsized":"2024-04-26T21:17:44.352564+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:19.584578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330744+0000","last_change":"2024-04-26T21:17:42.330744+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330744+0000","last_undegraded":"2024-04-26T21:17:42.330744+0000","last_fullsized":"2024-04-26T21:17:42.330744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325194+0000","last_change":"2024-04-26T21:17:42.325194+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325194+0000","last_undegraded":"2024-04-26T21:17:42.325194+0000","last_fullsized":"2024-04-26T21:17:42.325194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324863+0000","last_change":"2024-04-26T21:17:42.324863+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324863+0000","last_undegraded":"2024-04-26T21:17:42.324863+0000","last_fullsized":"2024-04-26T21:17:42.324863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.332663+0000","last_change":"2024-04-26T21:17:42.332663+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.332663+0000","last_undegraded":"2024-04-26T21:17:42.332663+0000","last_fullsized":"2024-04-26T21:17:42.332663+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352349+0000","last_change":"2024-04-26T21:17:43.336925+0000","last_active":"2024-04-26T21:17:44.352349+0000","last_peered":"2024-04-26T21:17:44.352349+0000","last_clean":"2024-04-26T21:17:44.352349+0000","last_became_active":"2024-04-26T21:17:43.330141+0000","last_became_peered":"2024-04-26T21:17:43.330141+0000","last_unstale":"2024-04-26T21:17:44.352349+0000","last_undegraded":"2024-04-26T21:17:44.352349+0000","last_fullsized":"2024-04-26T21:17:44.352349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:22.996159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.332644+0000","last_change":"2024-04-26T21:17:42.332644+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.332644+0000","last_undegraded":"2024-04-26T21:17:42.332644+0000","last_fullsized":"2024-04-26T21:17:42.332644+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.323804+0000","last_change":"2024-04-26T21:17:42.323804+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.323804+0000","last_undegraded":"2024-04-26T21:17:42.323804+0000","last_fullsized":"2024-04-26T21:17:42.323804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331124+0000","last_change":"2024-04-26T21:17:42.331124+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331124+0000","last_undegraded":"2024-04-26T21:17:42.331124+0000","last_fullsized":"2024-04-26T21:17:42.331124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325768+0000","last_change":"2024-04-26T21:17:42.325768+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325768+0000","last_undegraded":"2024-04-26T21:17:42.325768+0000","last_fullsized":"2024-04-26T21:17:42.325768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330365+0000","last_change":"2024-04-26T21:17:42.330365+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330365+0000","last_undegraded":"2024-04-26T21:17:42.330365+0000","last_fullsized":"2024-04-26T21:17:42.330365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331956+0000","last_change":"2024-04-26T21:17:42.331956+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331956+0000","last_undegraded":"2024-04-26T21:17:42.331956+0000","last_fullsized":"2024-04-26T21:17:42.331956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331349+0000","last_change":"2024-04-26T21:17:42.331349+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331349+0000","last_undegraded":"2024-04-26T21:17:42.331349+0000","last_fullsized":"2024-04-26T21:17:42.331349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322372+0000","last_change":"2024-04-26T21:17:42.322372+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322372+0000","last_undegraded":"2024-04-26T21:17:42.322372+0000","last_fullsized":"2024-04-26T21:17:42.322372+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330396+0000","last_change":"2024-04-26T21:17:42.330396+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330396+0000","last_undegraded":"2024-04-26T21:17:42.330396+0000","last_fullsized":"2024-04-26T21:17:42.330396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350348+0000","last_change":"2024-04-26T21:17:42.343816+0000","last_active":"2024-04-26T21:17:42.350348+0000","last_peered":"2024-04-26T21:17:42.350348+0000","last_clean":"2024-04-26T21:17:42.350348+0000","last_became_active":"2024-04-26T21:17:42.342970+0000","last_became_peered":"2024-04-26T21:17:42.342970+0000","last_unstale":"2024-04-26T21:17:42.350348+0000","last_undegraded":"2024-04-26T21:17:42.350348+0000","last_fullsized":"2024-04-26T21:17:42.350348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.914925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.321717+0000","last_change":"2024-04-26T21:17:42.321717+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.321717+0000","last_undegraded":"2024-04-26T21:17:42.321717+0000","last_fullsized":"2024-04-26T21:17:42.321717+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.346639+0000","last_change":"2024-04-26T21:17:42.345983+0000","last_active":"2024-04-26T21:17:42.346639+0000","last_peered":"2024-04-26T21:17:42.346639+0000","last_clean":"2024-04-26T21:17:42.346639+0000","last_became_active":"2024-04-26T21:17:42.345713+0000","last_became_peered":"2024-04-26T21:17:42.345713+0000","last_unstale":"2024-04-26T21:17:42.346639+0000","last_undegraded":"2024-04-26T21:17:42.346639+0000","last_fullsized":"2024-04-26T21:17:42.346639+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326205+0000","last_change":"2024-04-26T21:17:42.326205+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326205+0000","last_undegraded":"2024-04-26T21:17:42.326205+0000","last_fullsized":"2024-04-26T21:17:42.326205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.334767+0000","last_change":"2024-04-26T21:17:42.331607+0000","last_active":"2024-04-26T21:17:42.334767+0000","last_peered":"2024-04-26T21:17:42.334767+0000","last_clean":"2024-04-26T21:17:42.334767+0000","last_became_active":"2024-04-26T21:17:42.331352+0000","last_became_peered":"2024-04-26T21:17:42.331352+0000","last_unstale":"2024-04-26T21:17:42.334767+0000","last_undegraded":"2024-04-26T21:17:42.334767+0000","last_fullsized":"2024-04-26T21:17:42.334767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325541+0000","last_change":"2024-04-26T21:17:42.325541+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325541+0000","last_undegraded":"2024-04-26T21:17:42.325541+0000","last_fullsized":"2024-04-26T21:17:42.325541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.337829+0000","last_change":"2024-04-26T21:17:42.331626+0000","last_active":"2024-04-26T21:17:42.337829+0000","last_peered":"2024-04-26T21:17:42.337829+0000","last_clean":"2024-04-26T21:17:42.337829+0000","last_became_active":"2024-04-26T21:17:42.331295+0000","last_became_peered":"2024-04-26T21:17:42.331295+0000","last_unstale":"2024-04-26T21:17:42.337829+0000","last_undegraded":"2024-04-26T21:17:42.337829+0000","last_fullsized":"2024-04-26T21:17:42.337829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:08.843853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.336539+0000","last_change":"2024-04-26T21:17:42.336539+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.336539+0000","last_undegraded":"2024-04-26T21:17:42.336539+0000","last_fullsized":"2024-04-26T21:17:42.336539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345540+0000","last_change":"2024-04-26T21:17:42.341073+0000","last_active":"2024-04-26T21:17:42.345540+0000","last_peered":"2024-04-26T21:17:42.345540+0000","last_clean":"2024-04-26T21:17:42.345540+0000","last_became_active":"2024-04-26T21:17:42.340849+0000","last_became_peered":"2024-04-26T21:17:42.340849+0000","last_unstale":"2024-04-26T21:17:42.345540+0000","last_undegraded":"2024-04-26T21:17:42.345540+0000","last_fullsized":"2024-04-26T21:17:42.345540+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:59.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326170+0000","last_change":"2024-04-26T21:17:42.326170+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326170+0000","last_undegraded":"2024-04-26T21:17:42.326170+0000","last_fullsized":"2024-04-26T21:17:42.326170+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345701+0000","last_change":"2024-04-26T21:17:42.342767+0000","last_active":"2024-04-26T21:17:42.345701+0000","last_peered":"2024-04-26T21:17:42.345701+0000","last_clean":"2024-04-26T21:17:42.345701+0000","last_became_active":"2024-04-26T21:17:42.342487+0000","last_became_peered":"2024-04-26T21:17:42.342487+0000","last_unstale":"2024-04-26T21:17:42.345701+0000","last_undegraded":"2024-04-26T21:17:42.345701+0000","last_fullsized":"2024-04-26T21:17:42.345701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.323614+0000","last_change":"2024-04-26T21:17:42.323614+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.323614+0000","last_undegraded":"2024-04-26T21:17:42.323614+0000","last_fullsized":"2024-04-26T21:17:42.323614+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.337640+0000","last_change":"2024-04-26T21:17:42.335963+0000","last_active":"2024-04-26T21:17:42.337640+0000","last_peered":"2024-04-26T21:17:42.337640+0000","last_clean":"2024-04-26T21:17:42.337640+0000","last_became_active":"2024-04-26T21:17:42.335654+0000","last_became_peered":"2024-04-26T21:17:42.335654+0000","last_unstale":"2024-04-26T21:17:42.337640+0000","last_undegraded":"2024-04-26T21:17:42.337640+0000","last_fullsized":"2024-04-26T21:17:42.337640+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.328215+0000","last_change":"2024-04-26T21:17:42.328215+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.328215+0000","last_undegraded":"2024-04-26T21:17:42.328215+0000","last_fullsized":"2024-04-26T21:17:42.328215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.343466+0000","last_change":"2024-04-26T21:17:42.339198+0000","last_active":"2024-04-26T21:17:42.343466+0000","last_peered":"2024-04-26T21:17:42.343466+0000","last_clean":"2024-04-26T21:17:42.343466+0000","last_became_active":"2024-04-26T21:17:42.338880+0000","last_became_peered":"2024-04-26T21:17:42.338880+0000","last_unstale":"2024-04-26T21:17:42.343466+0000","last_undegraded":"2024-04-26T21:17:42.343466+0000","last_fullsized":"2024-04-26T21:17:42.343466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:22.514736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352642+0000","last_change":"2024-04-26T21:17:43.343916+0000","last_active":"2024-04-26T21:17:44.352642+0000","last_peered":"2024-04-26T21:17:44.352642+0000","last_clean":"2024-04-26T21:17:44.352642+0000","last_became_active":"2024-04-26T21:17:43.343321+0000","last_became_peered":"2024-04-26T21:17:43.343321+0000","last_unstale":"2024-04-26T21:17:44.352642+0000","last_undegraded":"2024-04-26T21:17:44.352642+0000","last_fullsized":"2024-04-26T21:17:44.352642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:59.139005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.339164+0000","last_change":"2024-04-26T21:17:42.331814+0000","last_active":"2024-04-26T21:17:42.339164+0000","last_peered":"2024-04-26T21:17:42.339164+0000","last_clean":"2024-04-26T21:17:42.339164+0000","last_became_active":"2024-04-26T21:17:42.329773+0000","last_became_peered":"2024-04-26T21:17:42.329773+0000","last_unstale":"2024-04-26T21:17:42.339164+0000","last_undegraded":"2024-04-26T21:17:42.339164+0000","last_fullsized":"2024-04-26T21:17:42.339164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:46.523068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327073+0000","last_change":"2024-04-26T21:17:42.327073+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327073+0000","last_undegraded":"2024-04-26T21:17:42.327073+0000","last_fullsized":"2024-04-26T21:17:42.327073+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.339240+0000","last_change":"2024-04-26T21:17:42.334519+0000","last_active":"2024-04-26T21:17:42.339240+0000","last_peered":"2024-04-26T21:17:42.339240+0000","last_clean":"2024-04-26T21:17:42.339240+0000","last_became_active":"2024-04-26T21:17:42.334204+0000","last_became_peered":"2024-04-26T21:17:42.334204+0000","last_unstale":"2024-04-26T21:17:42.339240+0000","last_undegraded":"2024-04-26T21:17:42.339240+0000","last_fullsized":"2024-04-26T21:17:42.339240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.333627+0000","last_change":"2024-04-26T21:17:42.333627+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.333627+0000","last_undegraded":"2024-04-26T21:17:42.333627+0000","last_fullsized":"2024-04-26T21:17:42.333627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345267+0000","last_change":"2024-04-26T21:17:42.340533+0000","last_active":"2024-04-26T21:17:42.345267+0000","last_peered":"2024-04-26T21:17:42.345267+0000","last_clean":"2024-04-26T21:17:42.345267+0000","last_became_active":"2024-04-26T21:17:42.340333+0000","last_became_peered":"2024-04-26T21:17:42.340333+0000","last_unstale":"2024-04-26T21:17:42.345267+0000","last_undegraded":"2024-04-26T21:17:42.345267+0000","last_fullsized":"2024-04-26T21:17:42.345267+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327145+0000","last_change":"2024-04-26T21:17:42.327145+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327145+0000","last_undegraded":"2024-04-26T21:17:42.327145+0000","last_fullsized":"2024-04-26T21:17:42.327145+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345613+0000","last_change":"2024-04-26T21:17:42.342883+0000","last_active":"2024-04-26T21:17:42.345613+0000","last_peered":"2024-04-26T21:17:42.345613+0000","last_clean":"2024-04-26T21:17:42.345613+0000","last_became_active":"2024-04-26T21:17:42.342378+0000","last_became_peered":"2024-04-26T21:17:42.342378+0000","last_unstale":"2024-04-26T21:17:42.345613+0000","last_undegraded":"2024-04-26T21:17:42.345613+0000","last_fullsized":"2024-04-26T21:17:42.345613+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:11.615397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.336159+0000","last_change":"2024-04-26T21:17:42.336159+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.336159+0000","last_undegraded":"2024-04-26T21:17:42.336159+0000","last_fullsized":"2024-04-26T21:17:42.336159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.343826+0000","last_change":"2024-04-26T21:17:42.341405+0000","last_active":"2024-04-26T21:17:42.343826+0000","last_peered":"2024-04-26T21:17:42.343826+0000","last_clean":"2024-04-26T21:17:42.343826+0000","last_became_active":"2024-04-26T21:17:42.340573+0000","last_became_peered":"2024-04-26T21:17:42.340573+0000","last_unstale":"2024-04-26T21:17:42.343826+0000","last_undegraded":"2024-04-26T21:17:42.343826+0000","last_fullsized":"2024-04-26T21:17:42.343826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:00.764821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.321696+0000","last_change":"2024-04-26T21:17:42.321696+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.321696+0000","last_undegraded":"2024-04-26T21:17:42.321696+0000","last_fullsized":"2024-04-26T21:17:42.321696+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.336725+0000","last_change":"2024-04-26T21:17:42.334314+0000","last_active":"2024-04-26T21:17:42.336725+0000","last_peered":"2024-04-26T21:17:42.336725+0000","last_clean":"2024-04-26T21:17:42.336725+0000","last_became_active":"2024-04-26T21:17:42.334063+0000","last_became_peered":"2024-04-26T21:17:42.334063+0000","last_unstale":"2024-04-26T21:17:42.336725+0000","last_undegraded":"2024-04-26T21:17:42.336725+0000","last_fullsized":"2024-04-26T21:17:42.336725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.328232+0000","last_change":"2024-04-26T21:17:42.328232+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.328232+0000","last_undegraded":"2024-04-26T21:17:42.328232+0000","last_fullsized":"2024-04-26T21:17:42.328232+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350267+0000","last_change":"2024-04-26T21:17:42.343295+0000","last_active":"2024-04-26T21:17:42.350267+0000","last_peered":"2024-04-26T21:17:42.350267+0000","last_clean":"2024-04-26T21:17:42.350267+0000","last_became_active":"2024-04-26T21:17:42.343005+0000","last_became_peered":"2024-04-26T21:17:42.343005+0000","last_unstale":"2024-04-26T21:17:42.350267+0000","last_undegraded":"2024-04-26T21:17:42.350267+0000","last_fullsized":"2024-04-26T21:17:42.350267+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:36.094637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324751+0000","last_change":"2024-04-26T21:17:42.324751+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324751+0000","last_undegraded":"2024-04-26T21:17:42.324751+0000","last_fullsized":"2024-04-26T21:17:42.324751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.347427+0000","last_change":"2024-04-26T21:17:42.343042+0000","last_active":"2024-04-26T21:17:42.347427+0000","last_peered":"2024-04-26T21:17:42.347427+0000","last_clean":"2024-04-26T21:17:42.347427+0000","last_became_active":"2024-04-26T21:17:42.342560+0000","last_became_peered":"2024-04-26T21:17:42.342560+0000","last_unstale":"2024-04-26T21:17:42.347427+0000","last_undegraded":"2024-04-26T21:17:42.347427+0000","last_fullsized":"2024-04-26T21:17:42.347427+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322102+0000","last_change":"2024-04-26T21:17:42.322102+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322102+0000","last_undegraded":"2024-04-26T21:17:42.322102+0000","last_fullsized":"2024-04-26T21:17:42.322102+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.346109+0000","last_change":"2024-04-26T21:17:42.339674+0000","last_active":"2024-04-26T21:17:42.346109+0000","last_peered":"2024-04-26T21:17:42.346109+0000","last_clean":"2024-04-26T21:17:42.346109+0000","last_became_active":"2024-04-26T21:17:42.339432+0000","last_became_peered":"2024-04-26T21:17:42.339432+0000","last_unstale":"2024-04-26T21:17:42.346109+0000","last_undegraded":"2024-04-26T21:17:42.346109+0000","last_fullsized":"2024-04-26T21:17:42.346109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324691+0000","last_change":"2024-04-26T21:17:42.324691+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324691+0000","last_undegraded":"2024-04-26T21:17:42.324691+0000","last_fullsized":"2024-04-26T21:17:42.324691+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.343500+0000","last_change":"2024-04-26T21:17:42.339219+0000","last_active":"2024-04-26T21:17:42.343500+0000","last_peered":"2024-04-26T21:17:42.343500+0000","last_clean":"2024-04-26T21:17:42.343500+0000","last_became_active":"2024-04-26T21:17:42.338644+0000","last_became_peered":"2024-04-26T21:17:42.338644+0000","last_unstale":"2024-04-26T21:17:42.343500+0000","last_undegraded":"2024-04-26T21:17:42.343500+0000","last_fullsized":"2024-04-26T21:17:42.343500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:43.477240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326636+0000","last_change":"2024-04-26T21:17:42.326636+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326636+0000","last_undegraded":"2024-04-26T21:17:42.326636+0000","last_fullsized":"2024-04-26T21:17:42.326636+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352602+0000","last_change":"2024-04-26T21:17:42.343539+0000","last_active":"2024-04-26T21:17:44.352602+0000","last_peered":"2024-04-26T21:17:44.352602+0000","last_clean":"2024-04-26T21:17:44.352602+0000","last_became_active":"2024-04-26T21:17:42.343185+0000","last_became_peered":"2024-04-26T21:17:42.343185+0000","last_unstale":"2024-04-26T21:17:44.352602+0000","last_undegraded":"2024-04-26T21:17:44.352602+0000","last_fullsized":"2024-04-26T21:17:44.352602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:09.794788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352739+0000","last_change":"2024-04-26T21:17:43.337701+0000","last_active":"2024-04-26T21:17:44.352739+0000","last_peered":"2024-04-26T21:17:44.352739+0000","last_clean":"2024-04-26T21:17:44.352739+0000","last_became_active":"2024-04-26T21:17:43.337408+0000","last_became_peered":"2024-04-26T21:17:43.337408+0000","last_unstale":"2024-04-26T21:17:44.352739+0000","last_undegraded":"2024-04-26T21:17:44.352739+0000","last_fullsized":"2024-04-26T21:17:44.352739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:24.993078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.336187+0000","last_change":"2024-04-26T21:17:42.332453+0000","last_active":"2024-04-26T21:17:42.336187+0000","last_peered":"2024-04-26T21:17:42.336187+0000","last_clean":"2024-04-26T21:17:42.336187+0000","last_became_active":"2024-04-26T21:17:42.332152+0000","last_became_peered":"2024-04-26T21:17:42.332152+0000","last_unstale":"2024-04-26T21:17:42.336187+0000","last_undegraded":"2024-04-26T21:17:42.336187+0000","last_fullsized":"2024-04-26T21:17:42.336187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.329729+0000","last_change":"2024-04-26T21:17:42.329729+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.329729+0000","last_undegraded":"2024-04-26T21:17:42.329729+0000","last_fullsized":"2024-04-26T21:17:42.329729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352455+0000","last_change":"2024-04-26T21:17:42.341816+0000","last_active":"2024-04-26T21:17:44.352455+0000","last_peered":"2024-04-26T21:17:44.352455+0000","last_clean":"2024-04-26T21:17:44.352455+0000","last_became_active":"2024-04-26T21:17:42.341562+0000","last_became_peered":"2024-04-26T21:17:42.341562+0000","last_unstale":"2024-04-26T21:17:44.352455+0000","last_undegraded":"2024-04-26T21:17:44.352455+0000","last_fullsized":"2024-04-26T21:17:44.352455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:36.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330154+0000","last_change":"2024-04-26T21:17:42.330154+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330154+0000","last_undegraded":"2024-04-26T21:17:42.330154+0000","last_fullsized":"2024-04-26T21:17:42.330154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352398+0000","last_change":"2024-04-26T21:17:42.338754+0000","last_active":"2024-04-26T21:17:44.352398+0000","last_peered":"2024-04-26T21:17:44.352398+0000","last_clean":"2024-04-26T21:17:44.352398+0000","last_became_active":"2024-04-26T21:17:42.338473+0000","last_became_peered":"2024-04-26T21:17:42.338473+0000","last_unstale":"2024-04-26T21:17:44.352398+0000","last_undegraded":"2024-04-26T21:17:44.352398+0000","last_fullsized":"2024-04-26T21:17:44.352398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:06.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324880+0000","last_change":"2024-04-26T21:17:42.324880+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324880+0000","last_undegraded":"2024-04-26T21:17:42.324880+0000","last_fullsized":"2024-04-26T21:17:42.324880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.347496+0000","last_change":"2024-04-26T21:17:42.343967+0000","last_active":"2024-04-26T21:17:42.347496+0000","last_peered":"2024-04-26T21:17:42.347496+0000","last_clean":"2024-04-26T21:17:42.347496+0000","last_became_active":"2024-04-26T21:17:42.343698+0000","last_became_peered":"2024-04-26T21:17:42.343698+0000","last_unstale":"2024-04-26T21:17:42.347496+0000","last_undegraded":"2024-04-26T21:17:42.347496+0000","last_fullsized":"2024-04-26T21:17:42.347496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322093+0000","last_change":"2024-04-26T21:17:42.322093+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322093+0000","last_undegraded":"2024-04-26T21:17:42.322093+0000","last_fullsized":"2024-04-26T21:17:42.322093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352335+0000","last_change":"2024-04-26T21:17:42.339504+0000","last_active":"2024-04-26T21:17:44.352335+0000","last_peered":"2024-04-26T21:17:44.352335+0000","last_clean":"2024-04-26T21:17:44.352335+0000","last_became_active":"2024-04-26T21:17:42.339252+0000","last_became_peered":"2024-04-26T21:17:42.339252+0000","last_unstale":"2024-04-26T21:17:44.352335+0000","last_undegraded":"2024-04-26T21:17:44.352335+0000","last_fullsized":"2024-04-26T21:17:44.352335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:05.142831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.320939+0000","last_change":"2024-04-26T21:17:42.320939+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.320939+0000","last_undegraded":"2024-04-26T21:17:42.320939+0000","last_fullsized":"2024-04-26T21:17:42.320939+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350409+0000","last_change":"2024-04-26T21:17:42.345973+0000","last_active":"2024-04-26T21:17:42.350409+0000","last_peered":"2024-04-26T21:17:42.350409+0000","last_clean":"2024-04-26T21:17:42.350409+0000","last_became_active":"2024-04-26T21:17:42.345147+0000","last_became_peered":"2024-04-26T21:17:42.345147+0000","last_unstale":"2024-04-26T21:17:42.350409+0000","last_undegraded":"2024-04-26T21:17:42.350409+0000","last_fullsized":"2024-04-26T21:17:42.350409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:01.319492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326548+0000","last_change":"2024-04-26T21:17:42.326548+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326548+0000","last_undegraded":"2024-04-26T21:17:42.326548+0000","last_fullsized":"2024-04-26T21:17:42.326548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.354116+0000","last_change":"2024-04-26T21:17:42.342526+0000","last_active":"2024-04-26T21:17:44.354116+0000","last_peered":"2024-04-26T21:17:44.354116+0000","last_clean":"2024-04-26T21:17:44.354116+0000","last_became_active":"2024-04-26T21:17:42.342262+0000","last_became_peered":"2024-04-26T21:17:42.342262+0000","last_unstale":"2024-04-26T21:17:44.354116+0000","last_undegraded":"2024-04-26T21:17:44.354116+0000","last_fullsized":"2024-04-26T21:17:44.354116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:02.905628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322086+0000","last_change":"2024-04-26T21:17:42.322086+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322086+0000","last_undegraded":"2024-04-26T21:17:42.322086+0000","last_fullsized":"2024-04-26T21:17:42.322086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.346178+0000","last_change":"2024-04-26T21:17:42.344849+0000","last_active":"2024-04-26T21:17:42.346178+0000","last_peered":"2024-04-26T21:17:42.346178+0000","last_clean":"2024-04-26T21:17:42.346178+0000","last_became_active":"2024-04-26T21:17:42.344569+0000","last_became_peered":"2024-04-26T21:17:42.344569+0000","last_unstale":"2024-04-26T21:17:42.346178+0000","last_undegraded":"2024-04-26T21:17:42.346178+0000","last_fullsized":"2024-04-26T21:17:42.346178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331323+0000","last_change":"2024-04-26T21:17:42.331323+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331323+0000","last_undegraded":"2024-04-26T21:17:42.331323+0000","last_fullsized":"2024-04-26T21:17:42.331323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345164+0000","last_change":"2024-04-26T21:17:42.343191+0000","last_active":"2024-04-26T21:17:42.345164+0000","last_peered":"2024-04-26T21:17:42.345164+0000","last_clean":"2024-04-26T21:17:42.345164+0000","last_became_active":"2024-04-26T21:17:42.342930+0000","last_became_peered":"2024-04-26T21:17:42.342930+0000","last_unstale":"2024-04-26T21:17:42.345164+0000","last_undegraded":"2024-04-26T21:17:42.345164+0000","last_fullsized":"2024-04-26T21:17:42.345164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.320868+0000","last_change":"2024-04-26T21:17:42.320868+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.320868+0000","last_undegraded":"2024-04-26T21:17:42.320868+0000","last_fullsized":"2024-04-26T21:17:42.320868+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350335+0000","last_change":"2024-04-26T21:17:42.343800+0000","last_active":"2024-04-26T21:17:42.350335+0000","last_peered":"2024-04-26T21:17:42.350335+0000","last_clean":"2024-04-26T21:17:42.350335+0000","last_became_active":"2024-04-26T21:17:42.343481+0000","last_became_peered":"2024-04-26T21:17:42.343481+0000","last_unstale":"2024-04-26T21:17:42.350335+0000","last_undegraded":"2024-04-26T21:17:42.350335+0000","last_fullsized":"2024-04-26T21:17:42.350335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:10.939610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325326+0000","last_change":"2024-04-26T21:17:42.325326+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325326+0000","last_undegraded":"2024-04-26T21:17:42.325326+0000","last_fullsized":"2024-04-26T21:17:42.325326+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.337852+0000","last_change":"2024-04-26T21:17:42.331930+0000","last_active":"2024-04-26T21:17:42.337852+0000","last_peered":"2024-04-26T21:17:42.337852+0000","last_clean":"2024-04-26T21:17:42.337852+0000","last_became_active":"2024-04-26T21:17:42.331650+0000","last_became_peered":"2024-04-26T21:17:42.331650+0000","last_unstale":"2024-04-26T21:17:42.337852+0000","last_undegraded":"2024-04-26T21:17:42.337852+0000","last_fullsized":"2024-04-26T21:17:42.337852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:27.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.329101+0000","last_change":"2024-04-26T21:17:42.329101+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.329101+0000","last_undegraded":"2024-04-26T21:17:42.329101+0000","last_fullsized":"2024-04-26T21:17:42.329101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.331666+0000","last_change":"2024-04-26T21:17:42.328692+0000","last_active":"2024-04-26T21:17:42.331666+0000","last_peered":"2024-04-26T21:17:42.331666+0000","last_clean":"2024-04-26T21:17:42.331666+0000","last_became_active":"2024-04-26T21:17:42.328387+0000","last_became_peered":"2024-04-26T21:17:42.328387+0000","last_unstale":"2024-04-26T21:17:42.331666+0000","last_undegraded":"2024-04-26T21:17:42.331666+0000","last_fullsized":"2024-04-26T21:17:42.331666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:07.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327465+0000","last_change":"2024-04-26T21:17:42.327465+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327465+0000","last_undegraded":"2024-04-26T21:17:42.327465+0000","last_fullsized":"2024-04-26T21:17:42.327465+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.347418+0000","last_change":"2024-04-26T21:17:42.342999+0000","last_active":"2024-04-26T21:17:42.347418+0000","last_peered":"2024-04-26T21:17:42.347418+0000","last_clean":"2024-04-26T21:17:42.347418+0000","last_became_active":"2024-04-26T21:17:42.342017+0000","last_became_peered":"2024-04-26T21:17:42.342017+0000","last_unstale":"2024-04-26T21:17:42.347418+0000","last_undegraded":"2024-04-26T21:17:42.347418+0000","last_fullsized":"2024-04-26T21:17:42.347418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.331878+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:17:42.331878+0000","last_peered":"2024-04-26T21:17:42.331878+0000","last_clean":"2024-04-26T21:17:42.331878+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:17:42.331878+0000","last_undegraded":"2024-04-26T21:17:42.331878+0000","last_fullsized":"2024-04-26T21:17:42.331878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":193715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:17:47.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:17:47.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f427b800640 1 Processor -- start 2024-04-26T21:17:47.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f427b800640 1 -- start start 2024-04-26T21:17:47.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f427b800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f427415f3d0 0x7f42740cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f427b800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42740d1d70 con 0x7f42740d37f0 2024-04-26T21:17:47.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f427b800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42740d2050 con 0x7f42740cdc50 2024-04-26T21:17:47.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f427b800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42740cd450 con 0x7f427415f3d0 2024-04-26T21:17:47.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f42740d37f0 0x7f42740cfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50924/0 (socket says 172.21.15.106:50924) 2024-04-26T21:17:47.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273e00640 1 -- 172.21.15.106:0/1694504257 learned_addr learned my addr 172.21.15.106:0/1694504257 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:47.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4278e00640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f427415f3d0 0x7f42740cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827852875 0 0) 0x7f42740d1d70 con 0x7f42740d37f0 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4258003530 con 0x7f42740d37f0 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2638627689 0 0) 0x7f4258003530 con 0x7f42740d37f0 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f427415f3d0 msgr2=0x7f42740cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f427415f3d0 0x7f42740cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 >> v1:172.21.15.112:6789/0 conn(0x7f42740cdc50 legacy=0x7f42740ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42740cd730 con 0x7f42740d37f0 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f4260001680 con 0x7f42740d37f0 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 >> v1:172.21.15.106:6789/0 conn(0x7f42740d37f0 legacy=0x7f42740cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42580039f0 0x7f4258003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42580043a0 0x7f4258004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f427415f3d0 0x7f42580050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f42740cd450 con 0x7f42580039f0 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f425800b9d0 con 0x7f42580043a0 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.966+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f425800bbd0 con 0x7f427415f3d0 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4278e00640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42580039f0 0x7f4258003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4273e00640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42580043a0 0x7f4258004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4279800640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f427415f3d0 0x7f42580050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4278e00640 1 -- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f427415f3d0 msgr2=0x7f42580050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4278e00640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f427415f3d0 0x7f42580050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4278e00640 1 -- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42580043a0 msgr2=0x7f4258004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4278e00640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42580043a0 0x7f4258004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4278e00640 1 -- 172.21.15.106:0/1694504257 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4258003530 con 0x7f42580039f0 2024-04-26T21:17:47.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4278e00640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42580039f0 0x7f4258003dd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4264009ae0 tx=0x7f426401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd427600f7ce55e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:47.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42640b2070 con 0x7f42580039f0 2024-04-26T21:17:47.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42640a5660 con 0x7f42580039f0 2024-04-26T21:17:47.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4273400640 1 -- 172.21.15.106:0/1694504257 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42640096b0 con 0x7f42580039f0 2024-04-26T21:17:47.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f427b800640 1 -- 172.21.15.106:0/1694504257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42580039f0 msgr2=0x7f4258003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f427b800640 1 --2- 172.21.15.106:0/1694504257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42580039f0 0x7f4258003dd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4264009ae0 tx=0x7f426401ca70 comp rx=0 tx=0).stop 2024-04-26T21:17:47.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.970+0000 7f4279800640 1 -- 172.21.15.106:0/1694504257 reap_dead start 2024-04-26T21:17:47.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 -- 172.21.15.106:0/1694504257 shutdown_connections 2024-04-26T21:17:47.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 -- 172.21.15.106:0/1694504257 >> 172.21.15.106:0/1694504257 conn(0x7f42740d2c60 msgr2=0x7f42740d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:47.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 -- 172.21.15.106:0/1694504257 shutdown_connections 2024-04-26T21:17:47.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 -- 172.21.15.106:0/1694504257 wait complete. 2024-04-26T21:17:47.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 Processor -- start 2024-04-26T21:17:47.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 -- start start 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42580039f0 0x7f4274151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4274161980 0x7f4274161e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42741f4ee0 0x7f42741f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f42740d02b0 con 0x7f42741f4ee0 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42740d0130 con 0x7f4274161980 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f42740cf4e0 con 0x7f42580039f0 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4279800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42741f4ee0 0x7f42741f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4279800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42741f4ee0 0x7f42741f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39078/0 (socket says 172.21.15.106:39078) 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4279800640 1 -- 172.21.15.106:0/1631404351 learned_addr learned my addr 172.21.15.106:0/1631404351 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4278e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42580039f0 0x7f4274151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4273e00640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4274161980 0x7f4274161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4279800640 1 -- 172.21.15.106:0/1631404351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42580039f0 msgr2=0x7f4274151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4279800640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42580039f0 0x7f4274151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4279800640 1 -- 172.21.15.106:0/1631404351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4274161980 msgr2=0x7f4274161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4279800640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4274161980 0x7f4274161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4279800640 1 -- 172.21.15.106:0/1631404351 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42741f5f30 con 0x7f42741f4ee0 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4279800640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42741f4ee0 0x7f42741f5360 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f426c0109d0 tx=0x7f426c010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4270c00640 1 -- 172.21.15.106:0/1631404351 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c003d90 con 0x7f42741f4ee0 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4270c00640 1 -- 172.21.15.106:0/1631404351 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426c019070 con 0x7f42741f4ee0 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f4270c00640 1 -- 172.21.15.106:0/1631404351 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c00ea40 con 0x7f42741f4ee0 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.974+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42741f6210 con 0x7f42741f4ee0 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.978+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42741f67d0 con 0x7f42741f4ee0 2024-04-26T21:17:47.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.978+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42741f69d0 con 0x7f42741f4ee0 2024-04-26T21:17:47.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.978+0000 7f4270c00640 1 -- 172.21.15.106:0/1631404351 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f426c013070 con 0x7f42741f4ee0 2024-04-26T21:17:47.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.978+0000 7f4270c00640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4254068380 0x7f425406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:47.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.978+0000 7f4270c00640 1 -- 172.21.15.106:0/1631404351 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f426c089810 con 0x7f42741f4ee0 2024-04-26T21:17:47.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.978+0000 7f4278e00640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4254068380 0x7f425406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:47.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.978+0000 7f4278e00640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4254068380 0x7f425406a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4264009ae0 tx=0x7f42640046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:47.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:47.982+0000 7f4270c00640 1 -- 172.21.15.106:0/1631404351 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f42741f69d0 con 0x7f42741f4ee0 2024-04-26T21:17:48.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.138+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4274069400 con 0x7f4254068380 2024-04-26T21:17:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.142+0000 7f4270c00640 1 -- 172.21.15.106:0/1631404351 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247143 (secure 0 0 0) 0x7f4274069400 con 0x7f4254068380 2024-04-26T21:17:48.149 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:17:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4254068380 msgr2=0x7f425406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4254068380 0x7f425406a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4264009ae0 tx=0x7f42640046d0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42741f4ee0 msgr2=0x7f42741f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42741f4ee0 0x7f42741f5360 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f426c0109d0 tx=0x7f426c010e90 comp rx=0 tx=0).stop 2024-04-26T21:17:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 shutdown_connections 2024-04-26T21:17:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4274161980 0x7f4274161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f4254068380 0x7f425406a840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42741f4ee0 0x7f42741f5360 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 --2- 172.21.15.106:0/1631404351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f42580039f0 0x7f4274151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 >> 172.21.15.106:0/1631404351 conn(0x7f42740d2c60 msgr2=0x7f42740c68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 shutdown_connections 2024-04-26T21:17:48.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.146+0000 7f427b800640 1 -- 172.21.15.106:0/1631404351 wait complete. 2024-04-26T21:17:48.170 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-26T21:17:46.307672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220716,"kb_used_data":4548,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754004,"statfs":{"total":773094113280,"available":772868100096,"internally_reserved":0,"allocated":4657152,"data_stored":2633128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.998078"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325971+0000","last_change":"2024-04-26T21:17:42.325971+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325971+0000","last_undegraded":"2024-04-26T21:17:42.325971+0000","last_fullsized":"2024-04-26T21:17:42.325971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324918+0000","last_change":"2024-04-26T21:17:42.324918+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324918+0000","last_undegraded":"2024-04-26T21:17:42.324918+0000","last_fullsized":"2024-04-26T21:17:42.324918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.334896+0000","last_change":"2024-04-26T21:17:42.334896+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.334896+0000","last_undegraded":"2024-04-26T21:17:42.334896+0000","last_fullsized":"2024-04-26T21:17:42.334896+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352639+0000","last_change":"2024-04-26T21:17:43.344118+0000","last_active":"2024-04-26T21:17:44.352639+0000","last_peered":"2024-04-26T21:17:44.352639+0000","last_clean":"2024-04-26T21:17:44.352639+0000","last_became_active":"2024-04-26T21:17:43.343673+0000","last_became_peered":"2024-04-26T21:17:43.343673+0000","last_unstale":"2024-04-26T21:17:44.352639+0000","last_undegraded":"2024-04-26T21:17:44.352639+0000","last_fullsized":"2024-04-26T21:17:44.352639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:28.124260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352497+0000","last_change":"2024-04-26T21:17:43.342242+0000","last_active":"2024-04-26T21:17:44.352497+0000","last_peered":"2024-04-26T21:17:44.352497+0000","last_clean":"2024-04-26T21:17:44.352497+0000","last_became_active":"2024-04-26T21:17:43.342000+0000","last_became_peered":"2024-04-26T21:17:43.342000+0000","last_unstale":"2024-04-26T21:17:44.352497+0000","last_undegraded":"2024-04-26T21:17:44.352497+0000","last_fullsized":"2024-04-26T21:17:44.352497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:43.733147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324327+0000","last_change":"2024-04-26T21:17:42.324327+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324327+0000","last_undegraded":"2024-04-26T21:17:42.324327+0000","last_fullsized":"2024-04-26T21:17:42.324327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327075+0000","last_change":"2024-04-26T21:17:42.327075+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327075+0000","last_undegraded":"2024-04-26T21:17:42.327075+0000","last_fullsized":"2024-04-26T21:17:42.327075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324934+0000","last_change":"2024-04-26T21:17:42.324934+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324934+0000","last_undegraded":"2024-04-26T21:17:42.324934+0000","last_fullsized":"2024-04-26T21:17:42.324934+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330824+0000","last_change":"2024-04-26T21:17:42.330824+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330824+0000","last_undegraded":"2024-04-26T21:17:42.330824+0000","last_fullsized":"2024-04-26T21:17:42.330824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326116+0000","last_change":"2024-04-26T21:17:42.326116+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326116+0000","last_undegraded":"2024-04-26T21:17:42.326116+0000","last_fullsized":"2024-04-26T21:17:42.326116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325217+0000","last_change":"2024-04-26T21:17:42.325217+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325217+0000","last_undegraded":"2024-04-26T21:17:42.325217+0000","last_fullsized":"2024-04-26T21:17:42.325217+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330256+0000","last_change":"2024-04-26T21:17:42.330256+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330256+0000","last_undegraded":"2024-04-26T21:17:42.330256+0000","last_fullsized":"2024-04-26T21:17:42.330256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325607+0000","last_change":"2024-04-26T21:17:42.325607+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325607+0000","last_undegraded":"2024-04-26T21:17:42.325607+0000","last_fullsized":"2024-04-26T21:17:42.325607+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325791+0000","last_change":"2024-04-26T21:17:42.325791+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325791+0000","last_undegraded":"2024-04-26T21:17:42.325791+0000","last_fullsized":"2024-04-26T21:17:42.325791+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326616+0000","last_change":"2024-04-26T21:17:42.326616+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326616+0000","last_undegraded":"2024-04-26T21:17:42.326616+0000","last_fullsized":"2024-04-26T21:17:42.326616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330187+0000","last_change":"2024-04-26T21:17:42.330187+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330187+0000","last_undegraded":"2024-04-26T21:17:42.330187+0000","last_fullsized":"2024-04-26T21:17:42.330187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330036+0000","last_change":"2024-04-26T21:17:42.330036+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330036+0000","last_undegraded":"2024-04-26T21:17:42.330036+0000","last_fullsized":"2024-04-26T21:17:42.330036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.329633+0000","last_change":"2024-04-26T21:17:42.329633+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.329633+0000","last_undegraded":"2024-04-26T21:17:42.329633+0000","last_fullsized":"2024-04-26T21:17:42.329633+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352564+0000","last_change":"2024-04-26T21:17:43.348983+0000","last_active":"2024-04-26T21:17:44.352564+0000","last_peered":"2024-04-26T21:17:44.352564+0000","last_clean":"2024-04-26T21:17:44.352564+0000","last_became_active":"2024-04-26T21:17:43.348709+0000","last_became_peered":"2024-04-26T21:17:43.348709+0000","last_unstale":"2024-04-26T21:17:44.352564+0000","last_undegraded":"2024-04-26T21:17:44.352564+0000","last_fullsized":"2024-04-26T21:17:44.352564+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:19.584578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330744+0000","last_change":"2024-04-26T21:17:42.330744+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330744+0000","last_undegraded":"2024-04-26T21:17:42.330744+0000","last_fullsized":"2024-04-26T21:17:42.330744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325194+0000","last_change":"2024-04-26T21:17:42.325194+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325194+0000","last_undegraded":"2024-04-26T21:17:42.325194+0000","last_fullsized":"2024-04-26T21:17:42.325194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324863+0000","last_change":"2024-04-26T21:17:42.324863+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324863+0000","last_undegraded":"2024-04-26T21:17:42.324863+0000","last_fullsized":"2024-04-26T21:17:42.324863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.332663+0000","last_change":"2024-04-26T21:17:42.332663+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.332663+0000","last_undegraded":"2024-04-26T21:17:42.332663+0000","last_fullsized":"2024-04-26T21:17:42.332663+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352349+0000","last_change":"2024-04-26T21:17:43.336925+0000","last_active":"2024-04-26T21:17:44.352349+0000","last_peered":"2024-04-26T21:17:44.352349+0000","last_clean":"2024-04-26T21:17:44.352349+0000","last_became_active":"2024-04-26T21:17:43.330141+0000","last_became_peered":"2024-04-26T21:17:43.330141+0000","last_unstale":"2024-04-26T21:17:44.352349+0000","last_undegraded":"2024-04-26T21:17:44.352349+0000","last_fullsized":"2024-04-26T21:17:44.352349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:22.996159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.332644+0000","last_change":"2024-04-26T21:17:42.332644+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.332644+0000","last_undegraded":"2024-04-26T21:17:42.332644+0000","last_fullsized":"2024-04-26T21:17:42.332644+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.323804+0000","last_change":"2024-04-26T21:17:42.323804+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.323804+0000","last_undegraded":"2024-04-26T21:17:42.323804+0000","last_fullsized":"2024-04-26T21:17:42.323804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331124+0000","last_change":"2024-04-26T21:17:42.331124+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331124+0000","last_undegraded":"2024-04-26T21:17:42.331124+0000","last_fullsized":"2024-04-26T21:17:42.331124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325768+0000","last_change":"2024-04-26T21:17:42.325768+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325768+0000","last_undegraded":"2024-04-26T21:17:42.325768+0000","last_fullsized":"2024-04-26T21:17:42.325768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330365+0000","last_change":"2024-04-26T21:17:42.330365+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330365+0000","last_undegraded":"2024-04-26T21:17:42.330365+0000","last_fullsized":"2024-04-26T21:17:42.330365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331956+0000","last_change":"2024-04-26T21:17:42.331956+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331956+0000","last_undegraded":"2024-04-26T21:17:42.331956+0000","last_fullsized":"2024-04-26T21:17:42.331956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331349+0000","last_change":"2024-04-26T21:17:42.331349+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331349+0000","last_undegraded":"2024-04-26T21:17:42.331349+0000","last_fullsized":"2024-04-26T21:17:42.331349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322372+0000","last_change":"2024-04-26T21:17:42.322372+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322372+0000","last_undegraded":"2024-04-26T21:17:42.322372+0000","last_fullsized":"2024-04-26T21:17:42.322372+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330396+0000","last_change":"2024-04-26T21:17:42.330396+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330396+0000","last_undegraded":"2024-04-26T21:17:42.330396+0000","last_fullsized":"2024-04-26T21:17:42.330396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350348+0000","last_change":"2024-04-26T21:17:42.343816+0000","last_active":"2024-04-26T21:17:42.350348+0000","last_peered":"2024-04-26T21:17:42.350348+0000","last_clean":"2024-04-26T21:17:42.350348+0000","last_became_active":"2024-04-26T21:17:42.342970+0000","last_became_peered":"2024-04-26T21:17:42.342970+0000","last_unstale":"2024-04-26T21:17:42.350348+0000","last_undegraded":"2024-04-26T21:17:42.350348+0000","last_fullsized":"2024-04-26T21:17:42.350348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.914925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.321717+0000","last_change":"2024-04-26T21:17:42.321717+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.321717+0000","last_undegraded":"2024-04-26T21:17:42.321717+0000","last_fullsized":"2024-04-26T21:17:42.321717+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.346639+0000","last_change":"2024-04-26T21:17:42.345983+0000","last_active":"2024-04-26T21:17:42.346639+0000","last_peered":"2024-04-26T21:17:42.346639+0000","last_clean":"2024-04-26T21:17:42.346639+0000","last_became_active":"2024-04-26T21:17:42.345713+0000","last_became_peered":"2024-04-26T21:17:42.345713+0000","last_unstale":"2024-04-26T21:17:42.346639+0000","last_undegraded":"2024-04-26T21:17:42.346639+0000","last_fullsized":"2024-04-26T21:17:42.346639+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326205+0000","last_change":"2024-04-26T21:17:42.326205+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326205+0000","last_undegraded":"2024-04-26T21:17:42.326205+0000","last_fullsized":"2024-04-26T21:17:42.326205+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.334767+0000","last_change":"2024-04-26T21:17:42.331607+0000","last_active":"2024-04-26T21:17:42.334767+0000","last_peered":"2024-04-26T21:17:42.334767+0000","last_clean":"2024-04-26T21:17:42.334767+0000","last_became_active":"2024-04-26T21:17:42.331352+0000","last_became_peered":"2024-04-26T21:17:42.331352+0000","last_unstale":"2024-04-26T21:17:42.334767+0000","last_undegraded":"2024-04-26T21:17:42.334767+0000","last_fullsized":"2024-04-26T21:17:42.334767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325541+0000","last_change":"2024-04-26T21:17:42.325541+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325541+0000","last_undegraded":"2024-04-26T21:17:42.325541+0000","last_fullsized":"2024-04-26T21:17:42.325541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.337829+0000","last_change":"2024-04-26T21:17:42.331626+0000","last_active":"2024-04-26T21:17:42.337829+0000","last_peered":"2024-04-26T21:17:42.337829+0000","last_clean":"2024-04-26T21:17:42.337829+0000","last_became_active":"2024-04-26T21:17:42.331295+0000","last_became_peered":"2024-04-26T21:17:42.331295+0000","last_unstale":"2024-04-26T21:17:42.337829+0000","last_undegraded":"2024-04-26T21:17:42.337829+0000","last_fullsized":"2024-04-26T21:17:42.337829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:08.843853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.336539+0000","last_change":"2024-04-26T21:17:42.336539+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.336539+0000","last_undegraded":"2024-04-26T21:17:42.336539+0000","last_fullsized":"2024-04-26T21:17:42.336539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345540+0000","last_change":"2024-04-26T21:17:42.341073+0000","last_active":"2024-04-26T21:17:42.345540+0000","last_peered":"2024-04-26T21:17:42.345540+0000","last_clean":"2024-04-26T21:17:42.345540+0000","last_became_active":"2024-04-26T21:17:42.340849+0000","last_became_peered":"2024-04-26T21:17:42.340849+0000","last_unstale":"2024-04-26T21:17:42.345540+0000","last_undegraded":"2024-04-26T21:17:42.345540+0000","last_fullsized":"2024-04-26T21:17:42.345540+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:59.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326170+0000","last_change":"2024-04-26T21:17:42.326170+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326170+0000","last_undegraded":"2024-04-26T21:17:42.326170+0000","last_fullsized":"2024-04-26T21:17:42.326170+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345701+0000","last_change":"2024-04-26T21:17:42.342767+0000","last_active":"2024-04-26T21:17:42.345701+0000","last_peered":"2024-04-26T21:17:42.345701+0000","last_clean":"2024-04-26T21:17:42.345701+0000","last_became_active":"2024-04-26T21:17:42.342487+0000","last_became_peered":"2024-04-26T21:17:42.342487+0000","last_unstale":"2024-04-26T21:17:42.345701+0000","last_undegraded":"2024-04-26T21:17:42.345701+0000","last_fullsized":"2024-04-26T21:17:42.345701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.323614+0000","last_change":"2024-04-26T21:17:42.323614+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.323614+0000","last_undegraded":"2024-04-26T21:17:42.323614+0000","last_fullsized":"2024-04-26T21:17:42.323614+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.337640+0000","last_change":"2024-04-26T21:17:42.335963+0000","last_active":"2024-04-26T21:17:42.337640+0000","last_peered":"2024-04-26T21:17:42.337640+0000","last_clean":"2024-04-26T21:17:42.337640+0000","last_became_active":"2024-04-26T21:17:42.335654+0000","last_became_peered":"2024-04-26T21:17:42.335654+0000","last_unstale":"2024-04-26T21:17:42.337640+0000","last_undegraded":"2024-04-26T21:17:42.337640+0000","last_fullsized":"2024-04-26T21:17:42.337640+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.328215+0000","last_change":"2024-04-26T21:17:42.328215+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.328215+0000","last_undegraded":"2024-04-26T21:17:42.328215+0000","last_fullsized":"2024-04-26T21:17:42.328215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.343466+0000","last_change":"2024-04-26T21:17:42.339198+0000","last_active":"2024-04-26T21:17:42.343466+0000","last_peered":"2024-04-26T21:17:42.343466+0000","last_clean":"2024-04-26T21:17:42.343466+0000","last_became_active":"2024-04-26T21:17:42.338880+0000","last_became_peered":"2024-04-26T21:17:42.338880+0000","last_unstale":"2024-04-26T21:17:42.343466+0000","last_undegraded":"2024-04-26T21:17:42.343466+0000","last_fullsized":"2024-04-26T21:17:42.343466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:22.514736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352642+0000","last_change":"2024-04-26T21:17:43.343916+0000","last_active":"2024-04-26T21:17:44.352642+0000","last_peered":"2024-04-26T21:17:44.352642+0000","last_clean":"2024-04-26T21:17:44.352642+0000","last_became_active":"2024-04-26T21:17:43.343321+0000","last_became_peered":"2024-04-26T21:17:43.343321+0000","last_unstale":"2024-04-26T21:17:44.352642+0000","last_undegraded":"2024-04-26T21:17:44.352642+0000","last_fullsized":"2024-04-26T21:17:44.352642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:59.139005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.339164+0000","last_change":"2024-04-26T21:17:42.331814+0000","last_active":"2024-04-26T21:17:42.339164+0000","last_peered":"2024-04-26T21:17:42.339164+0000","last_clean":"2024-04-26T21:17:42.339164+0000","last_became_active":"2024-04-26T21:17:42.329773+0000","last_became_peered":"2024-04-26T21:17:42.329773+0000","last_unstale":"2024-04-26T21:17:42.339164+0000","last_undegraded":"2024-04-26T21:17:42.339164+0000","last_fullsized":"2024-04-26T21:17:42.339164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:46.523068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327073+0000","last_change":"2024-04-26T21:17:42.327073+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327073+0000","last_undegraded":"2024-04-26T21:17:42.327073+0000","last_fullsized":"2024-04-26T21:17:42.327073+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.339240+0000","last_change":"2024-04-26T21:17:42.334519+0000","last_active":"2024-04-26T21:17:42.339240+0000","last_peered":"2024-04-26T21:17:42.339240+0000","last_clean":"2024-04-26T21:17:42.339240+0000","last_became_active":"2024-04-26T21:17:42.334204+0000","last_became_peered":"2024-04-26T21:17:42.334204+0000","last_unstale":"2024-04-26T21:17:42.339240+0000","last_undegraded":"2024-04-26T21:17:42.339240+0000","last_fullsized":"2024-04-26T21:17:42.339240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.333627+0000","last_change":"2024-04-26T21:17:42.333627+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.333627+0000","last_undegraded":"2024-04-26T21:17:42.333627+0000","last_fullsized":"2024-04-26T21:17:42.333627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345267+0000","last_change":"2024-04-26T21:17:42.340533+0000","last_active":"2024-04-26T21:17:42.345267+0000","last_peered":"2024-04-26T21:17:42.345267+0000","last_clean":"2024-04-26T21:17:42.345267+0000","last_became_active":"2024-04-26T21:17:42.340333+0000","last_became_peered":"2024-04-26T21:17:42.340333+0000","last_unstale":"2024-04-26T21:17:42.345267+0000","last_undegraded":"2024-04-26T21:17:42.345267+0000","last_fullsized":"2024-04-26T21:17:42.345267+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327145+0000","last_change":"2024-04-26T21:17:42.327145+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327145+0000","last_undegraded":"2024-04-26T21:17:42.327145+0000","last_fullsized":"2024-04-26T21:17:42.327145+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345613+0000","last_change":"2024-04-26T21:17:42.342883+0000","last_active":"2024-04-26T21:17:42.345613+0000","last_peered":"2024-04-26T21:17:42.345613+0000","last_clean":"2024-04-26T21:17:42.345613+0000","last_became_active":"2024-04-26T21:17:42.342378+0000","last_became_peered":"2024-04-26T21:17:42.342378+0000","last_unstale":"2024-04-26T21:17:42.345613+0000","last_undegraded":"2024-04-26T21:17:42.345613+0000","last_fullsized":"2024-04-26T21:17:42.345613+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:11.615397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.336159+0000","last_change":"2024-04-26T21:17:42.336159+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.336159+0000","last_undegraded":"2024-04-26T21:17:42.336159+0000","last_fullsized":"2024-04-26T21:17:42.336159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.343826+0000","last_change":"2024-04-26T21:17:42.341405+0000","last_active":"2024-04-26T21:17:42.343826+0000","last_peered":"2024-04-26T21:17:42.343826+0000","last_clean":"2024-04-26T21:17:42.343826+0000","last_became_active":"2024-04-26T21:17:42.340573+0000","last_became_peered":"2024-04-26T21:17:42.340573+0000","last_unstale":"2024-04-26T21:17:42.343826+0000","last_undegraded":"2024-04-26T21:17:42.343826+0000","last_fullsized":"2024-04-26T21:17:42.343826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:00.764821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.321696+0000","last_change":"2024-04-26T21:17:42.321696+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.321696+0000","last_undegraded":"2024-04-26T21:17:42.321696+0000","last_fullsized":"2024-04-26T21:17:42.321696+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.336725+0000","last_change":"2024-04-26T21:17:42.334314+0000","last_active":"2024-04-26T21:17:42.336725+0000","last_peered":"2024-04-26T21:17:42.336725+0000","last_clean":"2024-04-26T21:17:42.336725+0000","last_became_active":"2024-04-26T21:17:42.334063+0000","last_became_peered":"2024-04-26T21:17:42.334063+0000","last_unstale":"2024-04-26T21:17:42.336725+0000","last_undegraded":"2024-04-26T21:17:42.336725+0000","last_fullsized":"2024-04-26T21:17:42.336725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.328232+0000","last_change":"2024-04-26T21:17:42.328232+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.328232+0000","last_undegraded":"2024-04-26T21:17:42.328232+0000","last_fullsized":"2024-04-26T21:17:42.328232+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350267+0000","last_change":"2024-04-26T21:17:42.343295+0000","last_active":"2024-04-26T21:17:42.350267+0000","last_peered":"2024-04-26T21:17:42.350267+0000","last_clean":"2024-04-26T21:17:42.350267+0000","last_became_active":"2024-04-26T21:17:42.343005+0000","last_became_peered":"2024-04-26T21:17:42.343005+0000","last_unstale":"2024-04-26T21:17:42.350267+0000","last_undegraded":"2024-04-26T21:17:42.350267+0000","last_fullsized":"2024-04-26T21:17:42.350267+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:36.094637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324751+0000","last_change":"2024-04-26T21:17:42.324751+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324751+0000","last_undegraded":"2024-04-26T21:17:42.324751+0000","last_fullsized":"2024-04-26T21:17:42.324751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.347427+0000","last_change":"2024-04-26T21:17:42.343042+0000","last_active":"2024-04-26T21:17:42.347427+0000","last_peered":"2024-04-26T21:17:42.347427+0000","last_clean":"2024-04-26T21:17:42.347427+0000","last_became_active":"2024-04-26T21:17:42.342560+0000","last_became_peered":"2024-04-26T21:17:42.342560+0000","last_unstale":"2024-04-26T21:17:42.347427+0000","last_undegraded":"2024-04-26T21:17:42.347427+0000","last_fullsized":"2024-04-26T21:17:42.347427+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322102+0000","last_change":"2024-04-26T21:17:42.322102+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322102+0000","last_undegraded":"2024-04-26T21:17:42.322102+0000","last_fullsized":"2024-04-26T21:17:42.322102+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.346109+0000","last_change":"2024-04-26T21:17:42.339674+0000","last_active":"2024-04-26T21:17:42.346109+0000","last_peered":"2024-04-26T21:17:42.346109+0000","last_clean":"2024-04-26T21:17:42.346109+0000","last_became_active":"2024-04-26T21:17:42.339432+0000","last_became_peered":"2024-04-26T21:17:42.339432+0000","last_unstale":"2024-04-26T21:17:42.346109+0000","last_undegraded":"2024-04-26T21:17:42.346109+0000","last_fullsized":"2024-04-26T21:17:42.346109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324691+0000","last_change":"2024-04-26T21:17:42.324691+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324691+0000","last_undegraded":"2024-04-26T21:17:42.324691+0000","last_fullsized":"2024-04-26T21:17:42.324691+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.343500+0000","last_change":"2024-04-26T21:17:42.339219+0000","last_active":"2024-04-26T21:17:42.343500+0000","last_peered":"2024-04-26T21:17:42.343500+0000","last_clean":"2024-04-26T21:17:42.343500+0000","last_became_active":"2024-04-26T21:17:42.338644+0000","last_became_peered":"2024-04-26T21:17:42.338644+0000","last_unstale":"2024-04-26T21:17:42.343500+0000","last_undegraded":"2024-04-26T21:17:42.343500+0000","last_fullsized":"2024-04-26T21:17:42.343500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:43.477240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326636+0000","last_change":"2024-04-26T21:17:42.326636+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326636+0000","last_undegraded":"2024-04-26T21:17:42.326636+0000","last_fullsized":"2024-04-26T21:17:42.326636+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352602+0000","last_change":"2024-04-26T21:17:42.343539+0000","last_active":"2024-04-26T21:17:44.352602+0000","last_peered":"2024-04-26T21:17:44.352602+0000","last_clean":"2024-04-26T21:17:44.352602+0000","last_became_active":"2024-04-26T21:17:42.343185+0000","last_became_peered":"2024-04-26T21:17:42.343185+0000","last_unstale":"2024-04-26T21:17:44.352602+0000","last_undegraded":"2024-04-26T21:17:44.352602+0000","last_fullsized":"2024-04-26T21:17:44.352602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:09.794788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352739+0000","last_change":"2024-04-26T21:17:43.337701+0000","last_active":"2024-04-26T21:17:44.352739+0000","last_peered":"2024-04-26T21:17:44.352739+0000","last_clean":"2024-04-26T21:17:44.352739+0000","last_became_active":"2024-04-26T21:17:43.337408+0000","last_became_peered":"2024-04-26T21:17:43.337408+0000","last_unstale":"2024-04-26T21:17:44.352739+0000","last_undegraded":"2024-04-26T21:17:44.352739+0000","last_fullsized":"2024-04-26T21:17:44.352739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:24.993078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.336187+0000","last_change":"2024-04-26T21:17:42.332453+0000","last_active":"2024-04-26T21:17:42.336187+0000","last_peered":"2024-04-26T21:17:42.336187+0000","last_clean":"2024-04-26T21:17:42.336187+0000","last_became_active":"2024-04-26T21:17:42.332152+0000","last_became_peered":"2024-04-26T21:17:42.332152+0000","last_unstale":"2024-04-26T21:17:42.336187+0000","last_undegraded":"2024-04-26T21:17:42.336187+0000","last_fullsized":"2024-04-26T21:17:42.336187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.329729+0000","last_change":"2024-04-26T21:17:42.329729+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.329729+0000","last_undegraded":"2024-04-26T21:17:42.329729+0000","last_fullsized":"2024-04-26T21:17:42.329729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352455+0000","last_change":"2024-04-26T21:17:42.341816+0000","last_active":"2024-04-26T21:17:44.352455+0000","last_peered":"2024-04-26T21:17:44.352455+0000","last_clean":"2024-04-26T21:17:44.352455+0000","last_became_active":"2024-04-26T21:17:42.341562+0000","last_became_peered":"2024-04-26T21:17:42.341562+0000","last_unstale":"2024-04-26T21:17:44.352455+0000","last_undegraded":"2024-04-26T21:17:44.352455+0000","last_fullsized":"2024-04-26T21:17:44.352455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:36.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.330154+0000","last_change":"2024-04-26T21:17:42.330154+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.330154+0000","last_undegraded":"2024-04-26T21:17:42.330154+0000","last_fullsized":"2024-04-26T21:17:42.330154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352398+0000","last_change":"2024-04-26T21:17:42.338754+0000","last_active":"2024-04-26T21:17:44.352398+0000","last_peered":"2024-04-26T21:17:44.352398+0000","last_clean":"2024-04-26T21:17:44.352398+0000","last_became_active":"2024-04-26T21:17:42.338473+0000","last_became_peered":"2024-04-26T21:17:42.338473+0000","last_unstale":"2024-04-26T21:17:44.352398+0000","last_undegraded":"2024-04-26T21:17:44.352398+0000","last_fullsized":"2024-04-26T21:17:44.352398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:06.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.324880+0000","last_change":"2024-04-26T21:17:42.324880+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.324880+0000","last_undegraded":"2024-04-26T21:17:42.324880+0000","last_fullsized":"2024-04-26T21:17:42.324880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.347496+0000","last_change":"2024-04-26T21:17:42.343967+0000","last_active":"2024-04-26T21:17:42.347496+0000","last_peered":"2024-04-26T21:17:42.347496+0000","last_clean":"2024-04-26T21:17:42.347496+0000","last_became_active":"2024-04-26T21:17:42.343698+0000","last_became_peered":"2024-04-26T21:17:42.343698+0000","last_unstale":"2024-04-26T21:17:42.347496+0000","last_undegraded":"2024-04-26T21:17:42.347496+0000","last_fullsized":"2024-04-26T21:17:42.347496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322093+0000","last_change":"2024-04-26T21:17:42.322093+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322093+0000","last_undegraded":"2024-04-26T21:17:42.322093+0000","last_fullsized":"2024-04-26T21:17:42.322093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352335+0000","last_change":"2024-04-26T21:17:42.339504+0000","last_active":"2024-04-26T21:17:44.352335+0000","last_peered":"2024-04-26T21:17:44.352335+0000","last_clean":"2024-04-26T21:17:44.352335+0000","last_became_active":"2024-04-26T21:17:42.339252+0000","last_became_peered":"2024-04-26T21:17:42.339252+0000","last_unstale":"2024-04-26T21:17:44.352335+0000","last_undegraded":"2024-04-26T21:17:44.352335+0000","last_fullsized":"2024-04-26T21:17:44.352335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:05.142831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.320939+0000","last_change":"2024-04-26T21:17:42.320939+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.320939+0000","last_undegraded":"2024-04-26T21:17:42.320939+0000","last_fullsized":"2024-04-26T21:17:42.320939+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350409+0000","last_change":"2024-04-26T21:17:42.345973+0000","last_active":"2024-04-26T21:17:42.350409+0000","last_peered":"2024-04-26T21:17:42.350409+0000","last_clean":"2024-04-26T21:17:42.350409+0000","last_became_active":"2024-04-26T21:17:42.345147+0000","last_became_peered":"2024-04-26T21:17:42.345147+0000","last_unstale":"2024-04-26T21:17:42.350409+0000","last_undegraded":"2024-04-26T21:17:42.350409+0000","last_fullsized":"2024-04-26T21:17:42.350409+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:01.319492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.326548+0000","last_change":"2024-04-26T21:17:42.326548+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.326548+0000","last_undegraded":"2024-04-26T21:17:42.326548+0000","last_fullsized":"2024-04-26T21:17:42.326548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.354116+0000","last_change":"2024-04-26T21:17:42.342526+0000","last_active":"2024-04-26T21:17:44.354116+0000","last_peered":"2024-04-26T21:17:44.354116+0000","last_clean":"2024-04-26T21:17:44.354116+0000","last_became_active":"2024-04-26T21:17:42.342262+0000","last_became_peered":"2024-04-26T21:17:42.342262+0000","last_unstale":"2024-04-26T21:17:44.354116+0000","last_undegraded":"2024-04-26T21:17:44.354116+0000","last_fullsized":"2024-04-26T21:17:44.354116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:02.905628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.322086+0000","last_change":"2024-04-26T21:17:42.322086+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.322086+0000","last_undegraded":"2024-04-26T21:17:42.322086+0000","last_fullsized":"2024-04-26T21:17:42.322086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.346178+0000","last_change":"2024-04-26T21:17:42.344849+0000","last_active":"2024-04-26T21:17:42.346178+0000","last_peered":"2024-04-26T21:17:42.346178+0000","last_clean":"2024-04-26T21:17:42.346178+0000","last_became_active":"2024-04-26T21:17:42.344569+0000","last_became_peered":"2024-04-26T21:17:42.344569+0000","last_unstale":"2024-04-26T21:17:42.346178+0000","last_undegraded":"2024-04-26T21:17:42.346178+0000","last_fullsized":"2024-04-26T21:17:42.346178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.331323+0000","last_change":"2024-04-26T21:17:42.331323+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.331323+0000","last_undegraded":"2024-04-26T21:17:42.331323+0000","last_fullsized":"2024-04-26T21:17:42.331323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.345164+0000","last_change":"2024-04-26T21:17:42.343191+0000","last_active":"2024-04-26T21:17:42.345164+0000","last_peered":"2024-04-26T21:17:42.345164+0000","last_clean":"2024-04-26T21:17:42.345164+0000","last_became_active":"2024-04-26T21:17:42.342930+0000","last_became_peered":"2024-04-26T21:17:42.342930+0000","last_unstale":"2024-04-26T21:17:42.345164+0000","last_undegraded":"2024-04-26T21:17:42.345164+0000","last_fullsized":"2024-04-26T21:17:42.345164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.320868+0000","last_change":"2024-04-26T21:17:42.320868+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.320868+0000","last_undegraded":"2024-04-26T21:17:42.320868+0000","last_fullsized":"2024-04-26T21:17:42.320868+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.350335+0000","last_change":"2024-04-26T21:17:42.343800+0000","last_active":"2024-04-26T21:17:42.350335+0000","last_peered":"2024-04-26T21:17:42.350335+0000","last_clean":"2024-04-26T21:17:42.350335+0000","last_became_active":"2024-04-26T21:17:42.343481+0000","last_became_peered":"2024-04-26T21:17:42.343481+0000","last_unstale":"2024-04-26T21:17:42.350335+0000","last_undegraded":"2024-04-26T21:17:42.350335+0000","last_fullsized":"2024-04-26T21:17:42.350335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:10.939610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.325326+0000","last_change":"2024-04-26T21:17:42.325326+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.325326+0000","last_undegraded":"2024-04-26T21:17:42.325326+0000","last_fullsized":"2024-04-26T21:17:42.325326+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.337852+0000","last_change":"2024-04-26T21:17:42.331930+0000","last_active":"2024-04-26T21:17:42.337852+0000","last_peered":"2024-04-26T21:17:42.337852+0000","last_clean":"2024-04-26T21:17:42.337852+0000","last_became_active":"2024-04-26T21:17:42.331650+0000","last_became_peered":"2024-04-26T21:17:42.331650+0000","last_unstale":"2024-04-26T21:17:42.337852+0000","last_undegraded":"2024-04-26T21:17:42.337852+0000","last_fullsized":"2024-04-26T21:17:42.337852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:27.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.329101+0000","last_change":"2024-04-26T21:17:42.329101+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.329101+0000","last_undegraded":"2024-04-26T21:17:42.329101+0000","last_fullsized":"2024-04-26T21:17:42.329101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.331666+0000","last_change":"2024-04-26T21:17:42.328692+0000","last_active":"2024-04-26T21:17:42.331666+0000","last_peered":"2024-04-26T21:17:42.331666+0000","last_clean":"2024-04-26T21:17:42.331666+0000","last_became_active":"2024-04-26T21:17:42.328387+0000","last_became_peered":"2024-04-26T21:17:42.328387+0000","last_unstale":"2024-04-26T21:17:42.331666+0000","last_undegraded":"2024-04-26T21:17:42.331666+0000","last_fullsized":"2024-04-26T21:17:42.331666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:07.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-04-26T21:17:42.327465+0000","last_change":"2024-04-26T21:17:42.327465+0000","last_active":"2024-04-26T21:17:42.309709+0000","last_peered":"2024-04-26T21:17:42.309709+0000","last_clean":"2024-04-26T21:17:42.309709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:17:42.327465+0000","last_undegraded":"2024-04-26T21:17:42.327465+0000","last_fullsized":"2024-04-26T21:17:42.327465+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.347418+0000","last_change":"2024-04-26T21:17:42.342999+0000","last_active":"2024-04-26T21:17:42.347418+0000","last_peered":"2024-04-26T21:17:42.347418+0000","last_clean":"2024-04-26T21:17:42.347418+0000","last_became_active":"2024-04-26T21:17:42.342017+0000","last_became_peered":"2024-04-26T21:17:42.342017+0000","last_unstale":"2024-04-26T21:17:42.347418+0000","last_undegraded":"2024-04-26T21:17:42.347418+0000","last_fullsized":"2024-04-26T21:17:42.347418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T21:17:42.331878+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:17:42.331878+0000","last_peered":"2024-04-26T21:17:42.331878+0000","last_clean":"2024-04-26T21:17:42.331878+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:17:42.331878+0000","last_undegraded":"2024-04-26T21:17:42.331878+0000","last_fullsized":"2024-04-26T21:17:42.331878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":179811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":193715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:17:48.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-04-26T21:17:48.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.325971+0000', 'last_change': '2024-04-26T21:17:42.325971+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.325971+0000', 'last_undegraded': '2024-04-26T21:17:42.325971+0000', 'last_fullsized': '2024-04-26T21:17:42.325971+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-04-26T21:17:48.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.324918+0000', 'last_change': '2024-04-26T21:17:42.324918+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.324918+0000', 'last_undegraded': '2024-04-26T21:17:42.324918+0000', 'last_fullsized': '2024-04-26T21:17:42.324918+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.334896+0000', 'last_change': '2024-04-26T21:17:42.334896+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.334896+0000', 'last_undegraded': '2024-04-26T21:17:42.334896+0000', 'last_fullsized': '2024-04-26T21:17:42.334896+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.324327+0000', 'last_change': '2024-04-26T21:17:42.324327+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.324327+0000', 'last_undegraded': '2024-04-26T21:17:42.324327+0000', 'last_fullsized': '2024-04-26T21:17:42.324327+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.327075+0000', 'last_change': '2024-04-26T21:17:42.327075+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.327075+0000', 'last_undegraded': '2024-04-26T21:17:42.327075+0000', 'last_fullsized': '2024-04-26T21:17:42.327075+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.324934+0000', 'last_change': '2024-04-26T21:17:42.324934+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.324934+0000', 'last_undegraded': '2024-04-26T21:17:42.324934+0000', 'last_fullsized': '2024-04-26T21:17:42.324934+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-04-26T21:17:48.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.330824+0000', 'last_change': '2024-04-26T21:17:42.330824+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.330824+0000', 'last_undegraded': '2024-04-26T21:17:42.330824+0000', 'last_fullsized': '2024-04-26T21:17:42.330824+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.326116+0000', 'last_change': '2024-04-26T21:17:42.326116+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.326116+0000', 'last_undegraded': '2024-04-26T21:17:42.326116+0000', 'last_fullsized': '2024-04-26T21:17:42.326116+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.325217+0000', 'last_change': '2024-04-26T21:17:42.325217+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.325217+0000', 'last_undegraded': '2024-04-26T21:17:42.325217+0000', 'last_fullsized': '2024-04-26T21:17:42.325217+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.330256+0000', 'last_change': '2024-04-26T21:17:42.330256+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.330256+0000', 'last_undegraded': '2024-04-26T21:17:42.330256+0000', 'last_fullsized': '2024-04-26T21:17:42.330256+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.325607+0000', 'last_change': '2024-04-26T21:17:42.325607+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.325607+0000', 'last_undegraded': '2024-04-26T21:17:42.325607+0000', 'last_fullsized': '2024-04-26T21:17:42.325607+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.325791+0000', 'last_change': '2024-04-26T21:17:42.325791+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.325791+0000', 'last_undegraded': '2024-04-26T21:17:42.325791+0000', 'last_fullsized': '2024-04-26T21:17:42.325791+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-04-26T21:17:48.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.326616+0000', 'last_change': '2024-04-26T21:17:42.326616+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.326616+0000', 'last_undegraded': '2024-04-26T21:17:42.326616+0000', 'last_fullsized': '2024-04-26T21:17:42.326616+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.330187+0000', 'last_change': '2024-04-26T21:17:42.330187+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.330187+0000', 'last_undegraded': '2024-04-26T21:17:42.330187+0000', 'last_fullsized': '2024-04-26T21:17:42.330187+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.330036+0000', 'last_change': '2024-04-26T21:17:42.330036+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.330036+0000', 'last_undegraded': '2024-04-26T21:17:42.330036+0000', 'last_fullsized': '2024-04-26T21:17:42.330036+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.329633+0000', 'last_change': '2024-04-26T21:17:42.329633+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.329633+0000', 'last_undegraded': '2024-04-26T21:17:42.329633+0000', 'last_fullsized': '2024-04-26T21:17:42.329633+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.330744+0000', 'last_change': '2024-04-26T21:17:42.330744+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.330744+0000', 'last_undegraded': '2024-04-26T21:17:42.330744+0000', 'last_fullsized': '2024-04-26T21:17:42.330744+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-04-26T21:17:48.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.325194+0000', 'last_change': '2024-04-26T21:17:42.325194+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.325194+0000', 'last_undegraded': '2024-04-26T21:17:42.325194+0000', 'last_fullsized': '2024-04-26T21:17:42.325194+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.324863+0000', 'last_change': '2024-04-26T21:17:42.324863+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.324863+0000', 'last_undegraded': '2024-04-26T21:17:42.324863+0000', 'last_fullsized': '2024-04-26T21:17:42.324863+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.332663+0000', 'last_change': '2024-04-26T21:17:42.332663+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.332663+0000', 'last_undegraded': '2024-04-26T21:17:42.332663+0000', 'last_fullsized': '2024-04-26T21:17:42.332663+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.332644+0000', 'last_change': '2024-04-26T21:17:42.332644+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.332644+0000', 'last_undegraded': '2024-04-26T21:17:42.332644+0000', 'last_fullsized': '2024-04-26T21:17:42.332644+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.323804+0000', 'last_change': '2024-04-26T21:17:42.323804+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.323804+0000', 'last_undegraded': '2024-04-26T21:17:42.323804+0000', 'last_fullsized': '2024-04-26T21:17:42.323804+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.331124+0000', 'last_change': '2024-04-26T21:17:42.331124+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.331124+0000', 'last_undegraded': '2024-04-26T21:17:42.331124+0000', 'last_fullsized': '2024-04-26T21:17:42.331124+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-04-26T21:17:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.325768+0000', 'last_change': '2024-04-26T21:17:42.325768+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.325768+0000', 'last_undegraded': '2024-04-26T21:17:42.325768+0000', 'last_fullsized': '2024-04-26T21:17:42.325768+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.330365+0000', 'last_change': '2024-04-26T21:17:42.330365+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.330365+0000', 'last_undegraded': '2024-04-26T21:17:42.330365+0000', 'last_fullsized': '2024-04-26T21:17:42.330365+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.331956+0000', 'last_change': '2024-04-26T21:17:42.331956+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.331956+0000', 'last_undegraded': '2024-04-26T21:17:42.331956+0000', 'last_fullsized': '2024-04-26T21:17:42.331956+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.331349+0000', 'last_change': '2024-04-26T21:17:42.331349+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.331349+0000', 'last_undegraded': '2024-04-26T21:17:42.331349+0000', 'last_fullsized': '2024-04-26T21:17:42.331349+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.322372+0000', 'last_change': '2024-04-26T21:17:42.322372+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.322372+0000', 'last_undegraded': '2024-04-26T21:17:42.322372+0000', 'last_fullsized': '2024-04-26T21:17:42.322372+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.330396+0000', 'last_change': '2024-04-26T21:17:42.330396+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.330396+0000', 'last_undegraded': '2024-04-26T21:17:42.330396+0000', 'last_fullsized': '2024-04-26T21:17:42.330396+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-26T21:17:48.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.321717+0000', 'last_change': '2024-04-26T21:17:42.321717+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.321717+0000', 'last_undegraded': '2024-04-26T21:17:42.321717+0000', 'last_fullsized': '2024-04-26T21:17:42.321717+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.326205+0000', 'last_change': '2024-04-26T21:17:42.326205+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.326205+0000', 'last_undegraded': '2024-04-26T21:17:42.326205+0000', 'last_fullsized': '2024-04-26T21:17:42.326205+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.325541+0000', 'last_change': '2024-04-26T21:17:42.325541+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.325541+0000', 'last_undegraded': '2024-04-26T21:17:42.325541+0000', 'last_fullsized': '2024-04-26T21:17:42.325541+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.336539+0000', 'last_change': '2024-04-26T21:17:42.336539+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.336539+0000', 'last_undegraded': '2024-04-26T21:17:42.336539+0000', 'last_fullsized': '2024-04-26T21:17:42.336539+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.326170+0000', 'last_change': '2024-04-26T21:17:42.326170+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.326170+0000', 'last_undegraded': '2024-04-26T21:17:42.326170+0000', 'last_fullsized': '2024-04-26T21:17:42.326170+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.323614+0000', 'last_change': '2024-04-26T21:17:42.323614+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.323614+0000', 'last_undegraded': '2024-04-26T21:17:42.323614+0000', 'last_fullsized': '2024-04-26T21:17:42.323614+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-26T21:17:48.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.328215+0000', 'last_change': '2024-04-26T21:17:42.328215+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.328215+0000', 'last_undegraded': '2024-04-26T21:17:42.328215+0000', 'last_fullsized': '2024-04-26T21:17:42.328215+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.327073+0000', 'last_change': '2024-04-26T21:17:42.327073+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.327073+0000', 'last_undegraded': '2024-04-26T21:17:42.327073+0000', 'last_fullsized': '2024-04-26T21:17:42.327073+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.333627+0000', 'last_change': '2024-04-26T21:17:42.333627+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.333627+0000', 'last_undegraded': '2024-04-26T21:17:42.333627+0000', 'last_fullsized': '2024-04-26T21:17:42.333627+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.327145+0000', 'last_change': '2024-04-26T21:17:42.327145+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.327145+0000', 'last_undegraded': '2024-04-26T21:17:42.327145+0000', 'last_fullsized': '2024-04-26T21:17:42.327145+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.336159+0000', 'last_change': '2024-04-26T21:17:42.336159+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.336159+0000', 'last_undegraded': '2024-04-26T21:17:42.336159+0000', 'last_fullsized': '2024-04-26T21:17:42.336159+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.321696+0000', 'last_change': '2024-04-26T21:17:42.321696+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.321696+0000', 'last_undegraded': '2024-04-26T21:17:42.321696+0000', 'last_fullsized': '2024-04-26T21:17:42.321696+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-04-26T21:17:48.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.328232+0000', 'last_change': '2024-04-26T21:17:42.328232+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.328232+0000', 'last_undegraded': '2024-04-26T21:17:42.328232+0000', 'last_fullsized': '2024-04-26T21:17:42.328232+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.324751+0000', 'last_change': '2024-04-26T21:17:42.324751+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.324751+0000', 'last_undegraded': '2024-04-26T21:17:42.324751+0000', 'last_fullsized': '2024-04-26T21:17:42.324751+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.322102+0000', 'last_change': '2024-04-26T21:17:42.322102+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.322102+0000', 'last_undegraded': '2024-04-26T21:17:42.322102+0000', 'last_fullsized': '2024-04-26T21:17:42.322102+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.324691+0000', 'last_change': '2024-04-26T21:17:42.324691+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.324691+0000', 'last_undegraded': '2024-04-26T21:17:42.324691+0000', 'last_fullsized': '2024-04-26T21:17:42.324691+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.326636+0000', 'last_change': '2024-04-26T21:17:42.326636+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.326636+0000', 'last_undegraded': '2024-04-26T21:17:42.326636+0000', 'last_fullsized': '2024-04-26T21:17:42.326636+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.329729+0000', 'last_change': '2024-04-26T21:17:42.329729+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.329729+0000', 'last_undegraded': '2024-04-26T21:17:42.329729+0000', 'last_fullsized': '2024-04-26T21:17:42.329729+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-26T21:17:48.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.330154+0000', 'last_change': '2024-04-26T21:17:42.330154+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.330154+0000', 'last_undegraded': '2024-04-26T21:17:42.330154+0000', 'last_fullsized': '2024-04-26T21:17:42.330154+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.324880+0000', 'last_change': '2024-04-26T21:17:42.324880+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.324880+0000', 'last_undegraded': '2024-04-26T21:17:42.324880+0000', 'last_fullsized': '2024-04-26T21:17:42.324880+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.322093+0000', 'last_change': '2024-04-26T21:17:42.322093+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.322093+0000', 'last_undegraded': '2024-04-26T21:17:42.322093+0000', 'last_fullsized': '2024-04-26T21:17:42.322093+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.320939+0000', 'last_change': '2024-04-26T21:17:42.320939+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.320939+0000', 'last_undegraded': '2024-04-26T21:17:42.320939+0000', 'last_fullsized': '2024-04-26T21:17:42.320939+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.326548+0000', 'last_change': '2024-04-26T21:17:42.326548+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.326548+0000', 'last_undegraded': '2024-04-26T21:17:42.326548+0000', 'last_fullsized': '2024-04-26T21:17:42.326548+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.322086+0000', 'last_change': '2024-04-26T21:17:42.322086+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.322086+0000', 'last_undegraded': '2024-04-26T21:17:42.322086+0000', 'last_fullsized': '2024-04-26T21:17:42.322086+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:17:48.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-26T21:17:48.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.331323+0000', 'last_change': '2024-04-26T21:17:42.331323+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.331323+0000', 'last_undegraded': '2024-04-26T21:17:42.331323+0000', 'last_fullsized': '2024-04-26T21:17:42.331323+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:17:48.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-26T21:17:48.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.320868+0000', 'last_change': '2024-04-26T21:17:42.320868+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.320868+0000', 'last_undegraded': '2024-04-26T21:17:42.320868+0000', 'last_fullsized': '2024-04-26T21:17:42.320868+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:17:48.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-04-26T21:17:48.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.325326+0000', 'last_change': '2024-04-26T21:17:42.325326+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.325326+0000', 'last_undegraded': '2024-04-26T21:17:42.325326+0000', 'last_fullsized': '2024-04-26T21:17:42.325326+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:17:48.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-04-26T21:17:48.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.329101+0000', 'last_change': '2024-04-26T21:17:42.329101+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.329101+0000', 'last_undegraded': '2024-04-26T21:17:42.329101+0000', 'last_fullsized': '2024-04-26T21:17:42.329101+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:17:48.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-04-26T21:17:48.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:17:42.327465+0000', 'last_change': '2024-04-26T21:17:42.327465+0000', 'last_active': '2024-04-26T21:17:42.309709+0000', 'last_peered': '2024-04-26T21:17:42.309709+0000', 'last_clean': '2024-04-26T21:17:42.309709+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:17:42.327465+0000', 'last_undegraded': '2024-04-26T21:17:42.327465+0000', 'last_fullsized': '2024-04-26T21:17:42.327465+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'last_clean_scrub_stamp': '2024-04-26T21:17:42.309709+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:17:48.184 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T21:17:48.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.342+0000 7f0a08a00640 1 Processor -- start 2024-04-26T21:17:48.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.342+0000 7f0a08a00640 1 -- start start 2024-04-26T21:17:48.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.342+0000 7f0a08a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0a040708d0 0x7f0a0415f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.342+0000 7f0a08a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a040b6e00 con 0x7f0a0406d010 2024-04-26T21:17:48.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.342+0000 7f0a08a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0415cec0 con 0x7f0a0415cae0 2024-04-26T21:17:48.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.342+0000 7f0a08a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0a04160470 con 0x7f0a040708d0 2024-04-26T21:17:48.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.342+0000 7f0a03200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0a0406d010 0x7f0a04072db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50940/0 (socket says 172.21.15.106:50940) 2024-04-26T21:17:48.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.342+0000 7f0a03200640 1 -- 172.21.15.106:0/1426036861 learned_addr learned my addr 172.21.15.106:0/1426036861 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:48.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01e00640 1 --2- 172.21.15.106:0/1426036861 >> v2:172.21.15.112:3300/0 conn(0x7f0a040708d0 0x7f0a0415f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838127743 0 0) 0x7f09fc0014a0 con 0x7f0a0406d010 2024-04-26T21:17:48.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09e8003530 con 0x7f0a0406d010 2024-04-26T21:17:48.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2649684074 0 0) 0x7f09e8003530 con 0x7f0a0406d010 2024-04-26T21:17:48.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 >> v2:172.21.15.112:3300/0 conn(0x7f0a040708d0 msgr2=0x7f0a0415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:48.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 --2- 172.21.15.106:0/1426036861 >> v2:172.21.15.112:3300/0 conn(0x7f0a040708d0 0x7f0a0415f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 >> v1:172.21.15.112:6789/0 conn(0x7f0a0415cae0 legacy=0x7f0a040701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a04160190 con 0x7f0a0406d010 2024-04-26T21:17:48.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01e00640 1 --2- 172.21.15.106:0/1426036861 >> v2:172.21.15.112:3300/0 conn(0x7f0a040708d0 0x7f0a0415f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f09fc001bf0 con 0x7f0a0406d010 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 >> v1:172.21.15.106:6789/0 conn(0x7f0a0406d010 legacy=0x7f0a04072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80039c0 0x7f09e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09e80043c0 0x7f09e8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e8005130 0x7f09e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0a04160470 con 0x7f09e80043c0 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f09e800c070 con 0x7f09e80039c0 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f09e800c270 con 0x7f09e8005130 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01e00640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09e80043c0 0x7f09e8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a02800640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80039c0 0x7f09e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a03200640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e8005130 0x7f09e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01e00640 1 -- 172.21.15.106:0/1426036861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e8005130 msgr2=0x7f09e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01e00640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09e8005130 0x7f09e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01e00640 1 -- 172.21.15.106:0/1426036861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80039c0 msgr2=0x7f09e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:48.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01e00640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80039c0 0x7f09e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a01e00640 1 -- 172.21.15.106:0/1426036861 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e8003530 con 0x7f09e80043c0 2024-04-26T21:17:48.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a02800640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80039c0 0x7f09e8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:48.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.346+0000 7f0a03200640 1 -- 172.21.15.106:0/1426036861 reap_dead start 2024-04-26T21:17:48.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a01e00640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09e80043c0 0x7f09e8004890 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009c90 tx=0x7f09f001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58c24edd16b9046 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:48.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f00b2070 con 0x7f09e80043c0 2024-04-26T21:17:48.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f00a58b0 con 0x7f09e80043c0 2024-04-26T21:17:48.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a01400640 1 -- 172.21.15.106:0/1426036861 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0009860 con 0x7f09e80043c0 2024-04-26T21:17:48.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a08a00640 1 -- 172.21.15.106:0/1426036861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09e80043c0 msgr2=0x7f09e8004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a08a00640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09e80043c0 0x7f09e8004890 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009c90 tx=0x7f09f001cbf0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a08a00640 1 -- 172.21.15.106:0/1426036861 shutdown_connections 2024-04-26T21:17:48.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a08a00640 1 --2- 172.21.15.106:0/1426036861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09e80043c0 0x7f09e8004890 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a08a00640 1 -- 172.21.15.106:0/1426036861 >> 172.21.15.106:0/1426036861 conn(0x7f0a040b37b0 msgr2=0x7f0a040b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:48.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a08a00640 1 -- 172.21.15.106:0/1426036861 shutdown_connections 2024-04-26T21:17:48.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a08a00640 1 -- 172.21.15.106:0/1426036861 wait complete. 2024-04-26T21:17:48.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a08a00640 1 Processor -- start 2024-04-26T21:17:48.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.350+0000 7f0a08a00640 1 -- start start 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a08a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80043c0 0x7f0a04162d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a08a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04162010 0x7f0a0414c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a08a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a04156450 0x7f0a0415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a08a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0406caf0 con 0x7f0a04162010 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a08a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0406c810 con 0x7f09e80043c0 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a08a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0a040701c0 con 0x7f0a04156450 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a01e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04162010 0x7f0a0414c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a01e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04162010 0x7f0a0414c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39096/0 (socket says 172.21.15.106:39096) 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a01e00640 1 -- 172.21.15.106:0/2757942134 learned_addr learned my addr 172.21.15.106:0/2757942134 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:48.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a02800640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80043c0 0x7f0a04162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a03200640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a04156450 0x7f0a0415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a01e00640 1 -- 172.21.15.106:0/2757942134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a04156450 msgr2=0x7f0a0415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a01e00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a04156450 0x7f0a0415a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a01e00640 1 -- 172.21.15.106:0/2757942134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80043c0 msgr2=0x7f0a04162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a01e00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80043c0 0x7f0a04162d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a01e00640 1 -- 172.21.15.106:0/2757942134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a04160fb0 con 0x7f0a04162010 2024-04-26T21:17:48.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a01e00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04162010 0x7f0a0414c3e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009c90 tx=0x7f09f0019990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:48.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f09faa00640 1 -- 172.21.15.106:0/2757942134 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f00b2040 con 0x7f0a04162010 2024-04-26T21:17:48.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f09faa00640 1 -- 172.21.15.106:0/2757942134 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f00bd070 con 0x7f0a04162010 2024-04-26T21:17:48.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f09faa00640 1 -- 172.21.15.106:0/2757942134 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f00b88b0 con 0x7f0a04162010 2024-04-26T21:17:48.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a04161250 con 0x7f0a04162010 2024-04-26T21:17:48.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a04161810 con 0x7f0a04162010 2024-04-26T21:17:48.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a04069400 con 0x7f0a04162010 2024-04-26T21:17:48.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.354+0000 7f09faa00640 1 -- 172.21.15.106:0/2757942134 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09f00b8a50 con 0x7f0a04162010 2024-04-26T21:17:48.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.358+0000 7f09faa00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f09e40683b0 0x7f09e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.358+0000 7f09faa00640 1 -- 172.21.15.106:0/2757942134 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f09f0121380 con 0x7f0a04162010 2024-04-26T21:17:48.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.358+0000 7f0a02800640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f09e40683b0 0x7f09e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.358+0000 7f0a02800640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f09e40683b0 0x7f09e406a870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f09f4007ad0 tx=0x7f09f400aa60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:48.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.362+0000 7f09faa00640 1 -- 172.21.15.106:0/2757942134 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f09f0016900 con 0x7f0a04162010 2024-04-26T21:17:48.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.570+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0a040b2280 con 0x7f0a04162010 2024-04-26T21:17:48.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f09faa00640 1 -- 172.21.15.106:0/2757942134 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7f09f00f1150 con 0x7f0a04162010 2024-04-26T21:17:48.576 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:48.576 INFO:teuthology.orchestra.run.smithi106.stdout:{"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":113,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1714166167,"num_in_osds":8,"osd_in_since":1714166157,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":226365440,"bytes_avail":772867747840,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5469}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-04-26T21:17:26.304519+0000","services":{}},"progress_events":{}} 2024-04-26T21:17:48.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f09e40683b0 msgr2=0x7f09e406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f09e40683b0 0x7f09e406a870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f09f4007ad0 tx=0x7f09f400aa60 comp rx=0 tx=0).stop 2024-04-26T21:17:48.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04162010 msgr2=0x7f0a0414c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04162010 0x7f0a0414c3e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009c90 tx=0x7f09f0019990 comp rx=0 tx=0).stop 2024-04-26T21:17:48.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 shutdown_connections 2024-04-26T21:17:48.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f09e40683b0 0x7f09e406a870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0a04156450 0x7f0a0415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04162010 0x7f0a0414c3e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 --2- 172.21.15.106:0/2757942134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09e80043c0 0x7f0a04162d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 >> 172.21.15.106:0/2757942134 conn(0x7f0a040b37b0 msgr2=0x7f0a040b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:48.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 shutdown_connections 2024-04-26T21:17:48.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.574+0000 7f0a08a00640 1 -- 172.21.15.106:0/2757942134 wait complete. 2024-04-26T21:17:48.597 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T21:17:48.597 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:17:48.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd494000640 1 Processor -- start 2024-04-26T21:17:48.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd494000640 1 -- start start 2024-04-26T21:17:48.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd494000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0aeae0 0x7fd48c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd494000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd48c0b3820 0x7fd48c06f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd494000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd48c0b55e0 con 0x7fd48c1624a0 2024-04-26T21:17:48.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd494000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd48c0b58c0 con 0x7fd48c0b3820 2024-04-26T21:17:48.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd494000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd48c0b5ba0 con 0x7fd48c0aeae0 2024-04-26T21:17:48.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd492000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd48c0b3820 0x7fd48c06f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd490c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0aeae0 0x7fd48c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd492000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd48c0b3820 0x7fd48c06f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:37966/0 (socket says 172.21.15.106:37966) 2024-04-26T21:17:48.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd492000640 1 -- 172.21.15.106:0/2504000315 learned_addr learned my addr 172.21.15.106:0/2504000315 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:48.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd490c00640 1 -- 172.21.15.106:0/2504000315 >> v2:172.21.15.112:3300/0 conn(0x7fd48c0b3820 msgr2=0x7fd48c06f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:48.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd490c00640 1 --2- 172.21.15.106:0/2504000315 >> v2:172.21.15.112:3300/0 conn(0x7fd48c0b3820 0x7fd48c06f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd490c00640 1 -- 172.21.15.106:0/2504000315 >> v1:172.21.15.112:6789/0 conn(0x7fd48c1624a0 legacy=0x7fd48c0b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd490c00640 1 -- 172.21.15.106:0/2504000315 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c06e810 con 0x7fd48c0aeae0 2024-04-26T21:17:48.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.730+0000 7fd492000640 1 --2- 172.21.15.106:0/2504000315 >> v2:172.21.15.112:3300/0 conn(0x7fd48c0b3820 0x7fd48c06f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:48.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd490c00640 1 --2- 172.21.15.106:0/2504000315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0aeae0 0x7fd48c0b32e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd4780097c0 tx=0x7fd47801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c096e6cae3bbac12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:48.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd48be00640 1 -- 172.21.15.106:0/2504000315 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4780b1070 con 0x7fd48c0aeae0 2024-04-26T21:17:48.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd48be00640 1 -- 172.21.15.106:0/2504000315 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4780ac410 con 0x7fd48c0aeae0 2024-04-26T21:17:48.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd48be00640 1 -- 172.21.15.106:0/2504000315 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4780ac7e0 con 0x7fd48c0aeae0 2024-04-26T21:17:48.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd494000640 1 -- 172.21.15.106:0/2504000315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0aeae0 msgr2=0x7fd48c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd494000640 1 --2- 172.21.15.106:0/2504000315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0aeae0 0x7fd48c0b32e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd4780097c0 tx=0x7fd47801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd494000640 1 -- 172.21.15.106:0/2504000315 shutdown_connections 2024-04-26T21:17:48.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd494000640 1 --2- 172.21.15.106:0/2504000315 >> v2:172.21.15.112:3300/0 conn(0x7fd48c0b3820 0x7fd48c06f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd494000640 1 --2- 172.21.15.106:0/2504000315 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0aeae0 0x7fd48c0b32e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd494000640 1 -- 172.21.15.106:0/2504000315 >> 172.21.15.106:0/2504000315 conn(0x7fd48c06c5d0 msgr2=0x7fd48c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:48.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd494000640 1 -- 172.21.15.106:0/2504000315 shutdown_connections 2024-04-26T21:17:48.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.734+0000 7fd494000640 1 -- 172.21.15.106:0/2504000315 wait complete. 2024-04-26T21:17:48.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 Processor -- start 2024-04-26T21:17:48.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 -- start start 2024-04-26T21:17:48.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0aeae0 0x7fd48c14d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0b3820 0x7fd48c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd48c1624a0 0x7fd48c157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c070130 con 0x7fd48c1624a0 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c06ffb0 con 0x7fd48c0aeae0 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd48c0702b0 con 0x7fd48c0b3820 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd492000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd48c1624a0 0x7fd48c157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd492000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd48c1624a0 0x7fd48c157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39098/0 (socket says 172.21.15.106:39098) 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd492000640 1 -- 172.21.15.106:0/225803810 learned_addr learned my addr 172.21.15.106:0/225803810 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd490c00640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0b3820 0x7fd48c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd491600640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0aeae0 0x7fd48c14d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd492000640 1 -- 172.21.15.106:0/225803810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0b3820 msgr2=0x7fd48c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd492000640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0b3820 0x7fd48c0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd492000640 1 -- 172.21.15.106:0/225803810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0aeae0 msgr2=0x7fd48c14d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd492000640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0aeae0 0x7fd48c14d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd492000640 1 -- 172.21.15.106:0/225803810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c0b1f30 con 0x7fd48c1624a0 2024-04-26T21:17:48.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd492000640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd48c1624a0 0x7fd48c157890 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd48400efc0 tx=0x7fd48400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:48.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd489600640 1 -- 172.21.15.106:0/225803810 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48400cbe0 con 0x7fd48c1624a0 2024-04-26T21:17:48.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd489600640 1 -- 172.21.15.106:0/225803810 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48400cd80 con 0x7fd48c1624a0 2024-04-26T21:17:48.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48c0b2210 con 0x7fd48c1624a0 2024-04-26T21:17:48.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd489600640 1 -- 172.21.15.106:0/225803810 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484003bc0 con 0x7fd48c1624a0 2024-04-26T21:17:48.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48c0b27d0 con 0x7fd48c1624a0 2024-04-26T21:17:48.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.738+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48c069400 con 0x7fd48c1624a0 2024-04-26T21:17:48.744 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:17:48.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.742+0000 7fd489600640 1 -- 172.21.15.106:0/225803810 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd48401b030 con 0x7fd48c1624a0 2024-04-26T21:17:48.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.742+0000 7fd489600640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd46c068380 0x7fd46c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:48.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.742+0000 7fd489600640 1 -- 172.21.15.106:0/225803810 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd484086e80 con 0x7fd48c1624a0 2024-04-26T21:17:48.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.742+0000 7fd491600640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd46c068380 0x7fd46c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:48.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.742+0000 7fd491600640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd46c068380 0x7fd46c06a840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd48c1fb2d0 tx=0x7fd480009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:48.747 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:17:48.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.746+0000 7fd489600640 1 -- 172.21.15.106:0/225803810 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd484022020 con 0x7fd48c1624a0 2024-04-26T21:17:48.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.902+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd48c0d1c40 con 0x7fd46c068380 2024-04-26T21:17:48.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.906+0000 7fd489600640 1 -- 172.21.15.106:0/225803810 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fd48c0d1c40 con 0x7fd46c068380 2024-04-26T21:17:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:48.915 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:17:48.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd46c068380 msgr2=0x7fd46c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd46c068380 0x7fd46c06a840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd48c1fb2d0 tx=0x7fd480009040 comp rx=0 tx=0).stop 2024-04-26T21:17:48.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd48c1624a0 msgr2=0x7fd48c157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:48.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd48c1624a0 0x7fd48c157890 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd48400efc0 tx=0x7fd48400c490 comp rx=0 tx=0).stop 2024-04-26T21:17:48.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 shutdown_connections 2024-04-26T21:17:48.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd46c068380 0x7fd46c06a840 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd48c1624a0 0x7fd48c157890 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd48c0b3820 0x7fd48c0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 --2- 172.21.15.106:0/225803810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd48c0aeae0 0x7fd48c14d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:48.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 >> 172.21.15.106:0/225803810 conn(0x7fd48c06c5d0 msgr2=0x7fd48c159340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:48.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 shutdown_connections 2024-04-26T21:17:48.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:48.910+0000 7fd494000640 1 -- 172.21.15.106:0/225803810 wait complete. 2024-04-26T21:17:48.933 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-04-26T21:17:48.308044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221060,"kb_used_data":4860,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753660,"statfs":{"total":773094113280,"available":772867747840,"internally_reserved":0,"allocated":4976640,"data_stored":2781560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001031"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801966+0000","last_change":"2024-04-26T21:17:43.340568+0000","last_active":"2024-04-26T21:17:44.801966+0000","last_peered":"2024-04-26T21:17:44.801966+0000","last_clean":"2024-04-26T21:17:44.801966+0000","last_became_active":"2024-04-26T21:17:43.340250+0000","last_became_peered":"2024-04-26T21:17:43.340250+0000","last_unstale":"2024-04-26T21:17:44.801966+0000","last_undegraded":"2024-04-26T21:17:44.801966+0000","last_fullsized":"2024-04-26T21:17:44.801966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:26.282204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801806+0000","last_change":"2024-04-26T21:17:43.339005+0000","last_active":"2024-04-26T21:17:44.801806+0000","last_peered":"2024-04-26T21:17:44.801806+0000","last_clean":"2024-04-26T21:17:44.801806+0000","last_became_active":"2024-04-26T21:17:43.338724+0000","last_became_peered":"2024-04-26T21:17:43.338724+0000","last_unstale":"2024-04-26T21:17:44.801806+0000","last_undegraded":"2024-04-26T21:17:44.801806+0000","last_fullsized":"2024-04-26T21:17:44.801806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:41.566356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800988+0000","last_change":"2024-04-26T21:17:43.357149+0000","last_active":"2024-04-26T21:17:44.800988+0000","last_peered":"2024-04-26T21:17:44.800988+0000","last_clean":"2024-04-26T21:17:44.800988+0000","last_became_active":"2024-04-26T21:17:43.356871+0000","last_became_peered":"2024-04-26T21:17:43.356871+0000","last_unstale":"2024-04-26T21:17:44.800988+0000","last_undegraded":"2024-04-26T21:17:44.800988+0000","last_fullsized":"2024-04-26T21:17:44.800988+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:05.084092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352639+0000","last_change":"2024-04-26T21:17:43.344118+0000","last_active":"2024-04-26T21:17:44.352639+0000","last_peered":"2024-04-26T21:17:44.352639+0000","last_clean":"2024-04-26T21:17:44.352639+0000","last_became_active":"2024-04-26T21:17:43.343673+0000","last_became_peered":"2024-04-26T21:17:43.343673+0000","last_unstale":"2024-04-26T21:17:44.352639+0000","last_undegraded":"2024-04-26T21:17:44.352639+0000","last_fullsized":"2024-04-26T21:17:44.352639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:28.124260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352497+0000","last_change":"2024-04-26T21:17:43.342242+0000","last_active":"2024-04-26T21:17:44.352497+0000","last_peered":"2024-04-26T21:17:44.352497+0000","last_clean":"2024-04-26T21:17:44.352497+0000","last_became_active":"2024-04-26T21:17:43.342000+0000","last_became_peered":"2024-04-26T21:17:43.342000+0000","last_unstale":"2024-04-26T21:17:44.352497+0000","last_undegraded":"2024-04-26T21:17:44.352497+0000","last_fullsized":"2024-04-26T21:17:44.352497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:43.733147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336867+0000","last_change":"2024-04-26T21:17:43.338500+0000","last_active":"2024-04-26T21:17:44.336867+0000","last_peered":"2024-04-26T21:17:44.336867+0000","last_clean":"2024-04-26T21:17:44.336867+0000","last_became_active":"2024-04-26T21:17:43.338199+0000","last_became_peered":"2024-04-26T21:17:43.338199+0000","last_unstale":"2024-04-26T21:17:44.336867+0000","last_undegraded":"2024-04-26T21:17:44.336867+0000","last_fullsized":"2024-04-26T21:17:44.336867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:15.933036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355340+0000","last_change":"2024-04-26T21:17:43.352246+0000","last_active":"2024-04-26T21:17:44.355340+0000","last_peered":"2024-04-26T21:17:44.355340+0000","last_clean":"2024-04-26T21:17:44.355340+0000","last_became_active":"2024-04-26T21:17:43.351964+0000","last_became_peered":"2024-04-26T21:17:43.351964+0000","last_unstale":"2024-04-26T21:17:44.355340+0000","last_undegraded":"2024-04-26T21:17:44.355340+0000","last_fullsized":"2024-04-26T21:17:44.355340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:18.213018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800931+0000","last_change":"2024-04-26T21:17:43.345901+0000","last_active":"2024-04-26T21:17:44.800931+0000","last_peered":"2024-04-26T21:17:44.800931+0000","last_clean":"2024-04-26T21:17:44.800931+0000","last_became_active":"2024-04-26T21:17:43.345304+0000","last_became_peered":"2024-04-26T21:17:43.345304+0000","last_unstale":"2024-04-26T21:17:44.800931+0000","last_undegraded":"2024-04-26T21:17:44.800931+0000","last_fullsized":"2024-04-26T21:17:44.800931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:18.213018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801265+0000","last_change":"2024-04-26T21:17:43.356375+0000","last_active":"2024-04-26T21:17:44.801265+0000","last_peered":"2024-04-26T21:17:44.801265+0000","last_clean":"2024-04-26T21:17:44.801265+0000","last_became_active":"2024-04-26T21:17:43.356110+0000","last_became_peered":"2024-04-26T21:17:43.356110+0000","last_unstale":"2024-04-26T21:17:44.801265+0000","last_undegraded":"2024-04-26T21:17:44.801265+0000","last_fullsized":"2024-04-26T21:17:44.801265+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:15.599954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355799+0000","last_change":"2024-04-26T21:17:43.348917+0000","last_active":"2024-04-26T21:17:44.355799+0000","last_peered":"2024-04-26T21:17:44.355799+0000","last_clean":"2024-04-26T21:17:44.355799+0000","last_became_active":"2024-04-26T21:17:43.348367+0000","last_became_peered":"2024-04-26T21:17:43.348367+0000","last_unstale":"2024-04-26T21:17:44.355799+0000","last_undegraded":"2024-04-26T21:17:44.355799+0000","last_fullsized":"2024-04-26T21:17:44.355799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:41.566356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355799+0000","last_change":"2024-04-26T21:17:43.350148+0000","last_active":"2024-04-26T21:17:44.355799+0000","last_peered":"2024-04-26T21:17:44.355799+0000","last_clean":"2024-04-26T21:17:44.355799+0000","last_became_active":"2024-04-26T21:17:43.349659+0000","last_became_peered":"2024-04-26T21:17:43.349659+0000","last_unstale":"2024-04-26T21:17:44.355799+0000","last_undegraded":"2024-04-26T21:17:44.355799+0000","last_fullsized":"2024-04-26T21:17:44.355799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:04.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800903+0000","last_change":"2024-04-26T21:17:43.350393+0000","last_active":"2024-04-26T21:17:44.800903+0000","last_peered":"2024-04-26T21:17:44.800903+0000","last_clean":"2024-04-26T21:17:44.800903+0000","last_became_active":"2024-04-26T21:17:43.349581+0000","last_became_peered":"2024-04-26T21:17:43.349581+0000","last_unstale":"2024-04-26T21:17:44.800903+0000","last_undegraded":"2024-04-26T21:17:44.800903+0000","last_fullsized":"2024-04-26T21:17:44.800903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:15.933036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355425+0000","last_change":"2024-04-26T21:17:43.346155+0000","last_active":"2024-04-26T21:17:44.355425+0000","last_peered":"2024-04-26T21:17:44.355425+0000","last_clean":"2024-04-26T21:17:44.355425+0000","last_became_active":"2024-04-26T21:17:43.345877+0000","last_became_peered":"2024-04-26T21:17:43.345877+0000","last_unstale":"2024-04-26T21:17:44.355425+0000","last_undegraded":"2024-04-26T21:17:44.355425+0000","last_fullsized":"2024-04-26T21:17:44.355425+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:37.616169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801447+0000","last_change":"2024-04-26T21:17:43.344246+0000","last_active":"2024-04-26T21:17:44.801447+0000","last_peered":"2024-04-26T21:17:44.801447+0000","last_clean":"2024-04-26T21:17:44.801447+0000","last_became_active":"2024-04-26T21:17:43.343907+0000","last_became_peered":"2024-04-26T21:17:43.343907+0000","last_unstale":"2024-04-26T21:17:44.801447+0000","last_undegraded":"2024-04-26T21:17:44.801447+0000","last_fullsized":"2024-04-26T21:17:44.801447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:32.010081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355340+0000","last_change":"2024-04-26T21:17:43.352976+0000","last_active":"2024-04-26T21:17:44.355340+0000","last_peered":"2024-04-26T21:17:44.355340+0000","last_clean":"2024-04-26T21:17:44.355340+0000","last_became_active":"2024-04-26T21:17:43.352351+0000","last_became_peered":"2024-04-26T21:17:43.352351+0000","last_unstale":"2024-04-26T21:17:44.355340+0000","last_undegraded":"2024-04-26T21:17:44.355340+0000","last_fullsized":"2024-04-26T21:17:44.355340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:10.074177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339947+0000","last_change":"2024-04-26T21:17:43.347118+0000","last_active":"2024-04-26T21:17:44.339947+0000","last_peered":"2024-04-26T21:17:44.339947+0000","last_clean":"2024-04-26T21:17:44.339947+0000","last_became_active":"2024-04-26T21:17:43.346766+0000","last_became_peered":"2024-04-26T21:17:43.346766+0000","last_unstale":"2024-04-26T21:17:44.339947+0000","last_undegraded":"2024-04-26T21:17:44.339947+0000","last_fullsized":"2024-04-26T21:17:44.339947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:05.084092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340121+0000","last_change":"2024-04-26T21:17:43.353327+0000","last_active":"2024-04-26T21:17:44.340121+0000","last_peered":"2024-04-26T21:17:44.340121+0000","last_clean":"2024-04-26T21:17:44.340121+0000","last_became_active":"2024-04-26T21:17:43.352893+0000","last_became_peered":"2024-04-26T21:17:43.352893+0000","last_unstale":"2024-04-26T21:17:44.340121+0000","last_undegraded":"2024-04-26T21:17:44.340121+0000","last_fullsized":"2024-04-26T21:17:44.340121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:15.599954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339279+0000","last_change":"2024-04-26T21:17:43.339145+0000","last_active":"2024-04-26T21:17:44.339279+0000","last_peered":"2024-04-26T21:17:44.339279+0000","last_clean":"2024-04-26T21:17:44.339279+0000","last_became_active":"2024-04-26T21:17:43.333774+0000","last_became_peered":"2024-04-26T21:17:43.333774+0000","last_unstale":"2024-04-26T21:17:44.339279+0000","last_undegraded":"2024-04-26T21:17:44.339279+0000","last_fullsized":"2024-04-26T21:17:44.339279+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:47.530896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352564+0000","last_change":"2024-04-26T21:17:43.348983+0000","last_active":"2024-04-26T21:17:44.352564+0000","last_peered":"2024-04-26T21:17:44.352564+0000","last_clean":"2024-04-26T21:17:44.352564+0000","last_became_active":"2024-04-26T21:17:43.348709+0000","last_became_peered":"2024-04-26T21:17:43.348709+0000","last_unstale":"2024-04-26T21:17:44.352564+0000","last_undegraded":"2024-04-26T21:17:44.352564+0000","last_fullsized":"2024-04-26T21:17:44.352564+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:19.584578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339060+0000","last_change":"2024-04-26T21:17:43.335371+0000","last_active":"2024-04-26T21:17:44.339060+0000","last_peered":"2024-04-26T21:17:44.339060+0000","last_clean":"2024-04-26T21:17:44.339060+0000","last_became_active":"2024-04-26T21:17:43.335022+0000","last_became_peered":"2024-04-26T21:17:43.335022+0000","last_unstale":"2024-04-26T21:17:44.339060+0000","last_undegraded":"2024-04-26T21:17:44.339060+0000","last_fullsized":"2024-04-26T21:17:44.339060+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:08.792756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355477+0000","last_change":"2024-04-26T21:17:43.346131+0000","last_active":"2024-04-26T21:17:44.355477+0000","last_peered":"2024-04-26T21:17:44.355477+0000","last_clean":"2024-04-26T21:17:44.355477+0000","last_became_active":"2024-04-26T21:17:43.345823+0000","last_became_peered":"2024-04-26T21:17:43.345823+0000","last_unstale":"2024-04-26T21:17:44.355477+0000","last_undegraded":"2024-04-26T21:17:44.355477+0000","last_fullsized":"2024-04-26T21:17:44.355477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:04.773126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801751+0000","last_change":"2024-04-26T21:17:43.343832+0000","last_active":"2024-04-26T21:17:44.801751+0000","last_peered":"2024-04-26T21:17:44.801751+0000","last_clean":"2024-04-26T21:17:44.801751+0000","last_became_active":"2024-04-26T21:17:43.343515+0000","last_became_peered":"2024-04-26T21:17:43.343515+0000","last_unstale":"2024-04-26T21:17:44.801751+0000","last_undegraded":"2024-04-26T21:17:44.801751+0000","last_fullsized":"2024-04-26T21:17:44.801751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:10.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339959+0000","last_change":"2024-04-26T21:17:43.342118+0000","last_active":"2024-04-26T21:17:44.339959+0000","last_peered":"2024-04-26T21:17:44.339959+0000","last_clean":"2024-04-26T21:17:44.339959+0000","last_became_active":"2024-04-26T21:17:43.341808+0000","last_became_peered":"2024-04-26T21:17:43.341808+0000","last_unstale":"2024-04-26T21:17:44.339959+0000","last_undegraded":"2024-04-26T21:17:44.339959+0000","last_fullsized":"2024-04-26T21:17:44.339959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:40.436468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352349+0000","last_change":"2024-04-26T21:17:43.336925+0000","last_active":"2024-04-26T21:17:44.352349+0000","last_peered":"2024-04-26T21:17:44.352349+0000","last_clean":"2024-04-26T21:17:44.352349+0000","last_became_active":"2024-04-26T21:17:43.330141+0000","last_became_peered":"2024-04-26T21:17:43.330141+0000","last_unstale":"2024-04-26T21:17:44.352349+0000","last_undegraded":"2024-04-26T21:17:44.352349+0000","last_fullsized":"2024-04-26T21:17:44.352349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:22.996159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339357+0000","last_change":"2024-04-26T21:17:43.341686+0000","last_active":"2024-04-26T21:17:44.339357+0000","last_peered":"2024-04-26T21:17:44.339357+0000","last_clean":"2024-04-26T21:17:44.339357+0000","last_became_active":"2024-04-26T21:17:43.340125+0000","last_became_peered":"2024-04-26T21:17:43.340125+0000","last_unstale":"2024-04-26T21:17:44.339357+0000","last_undegraded":"2024-04-26T21:17:44.339357+0000","last_fullsized":"2024-04-26T21:17:44.339357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:12.623224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.337090+0000","last_change":"2024-04-26T21:17:43.354079+0000","last_active":"2024-04-26T21:17:44.337090+0000","last_peered":"2024-04-26T21:17:44.337090+0000","last_clean":"2024-04-26T21:17:44.337090+0000","last_became_active":"2024-04-26T21:17:43.353816+0000","last_became_peered":"2024-04-26T21:17:43.353816+0000","last_unstale":"2024-04-26T21:17:44.337090+0000","last_undegraded":"2024-04-26T21:17:44.337090+0000","last_fullsized":"2024-04-26T21:17:44.337090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:05.084092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339301+0000","last_change":"2024-04-26T21:17:43.340288+0000","last_active":"2024-04-26T21:17:44.339301+0000","last_peered":"2024-04-26T21:17:44.339301+0000","last_clean":"2024-04-26T21:17:44.339301+0000","last_became_active":"2024-04-26T21:17:43.339960+0000","last_became_peered":"2024-04-26T21:17:43.339960+0000","last_unstale":"2024-04-26T21:17:44.339301+0000","last_undegraded":"2024-04-26T21:17:44.339301+0000","last_fullsized":"2024-04-26T21:17:44.339301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:01.772648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355613+0000","last_change":"2024-04-26T21:17:43.352685+0000","last_active":"2024-04-26T21:17:44.355613+0000","last_peered":"2024-04-26T21:17:44.355613+0000","last_clean":"2024-04-26T21:17:44.355613+0000","last_became_active":"2024-04-26T21:17:43.351931+0000","last_became_peered":"2024-04-26T21:17:43.351931+0000","last_unstale":"2024-04-26T21:17:44.355613+0000","last_undegraded":"2024-04-26T21:17:44.355613+0000","last_fullsized":"2024-04-26T21:17:44.355613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:39.791507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339001+0000","last_change":"2024-04-26T21:17:43.328512+0000","last_active":"2024-04-26T21:17:44.339001+0000","last_peered":"2024-04-26T21:17:44.339001+0000","last_clean":"2024-04-26T21:17:44.339001+0000","last_became_active":"2024-04-26T21:17:43.328232+0000","last_became_peered":"2024-04-26T21:17:43.328232+0000","last_unstale":"2024-04-26T21:17:44.339001+0000","last_undegraded":"2024-04-26T21:17:44.339001+0000","last_fullsized":"2024-04-26T21:17:44.339001+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:00.960623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339057+0000","last_change":"2024-04-26T21:17:43.332524+0000","last_active":"2024-04-26T21:17:44.339057+0000","last_peered":"2024-04-26T21:17:44.339057+0000","last_clean":"2024-04-26T21:17:44.339057+0000","last_became_active":"2024-04-26T21:17:43.331930+0000","last_became_peered":"2024-04-26T21:17:43.331930+0000","last_unstale":"2024-04-26T21:17:44.339057+0000","last_undegraded":"2024-04-26T21:17:44.339057+0000","last_fullsized":"2024-04-26T21:17:44.339057+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:02.327320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340021+0000","last_change":"2024-04-26T21:17:43.339808+0000","last_active":"2024-04-26T21:17:44.340021+0000","last_peered":"2024-04-26T21:17:44.340021+0000","last_clean":"2024-04-26T21:17:44.340021+0000","last_became_active":"2024-04-26T21:17:43.339443+0000","last_became_peered":"2024-04-26T21:17:43.339443+0000","last_unstale":"2024-04-26T21:17:44.340021+0000","last_undegraded":"2024-04-26T21:17:44.340021+0000","last_fullsized":"2024-04-26T21:17:44.340021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:18.213018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336695+0000","last_change":"2024-04-26T21:17:43.339050+0000","last_active":"2024-04-26T21:17:44.336695+0000","last_peered":"2024-04-26T21:17:44.336695+0000","last_clean":"2024-04-26T21:17:44.336695+0000","last_became_active":"2024-04-26T21:17:43.338704+0000","last_became_peered":"2024-04-26T21:17:43.338704+0000","last_unstale":"2024-04-26T21:17:44.336695+0000","last_undegraded":"2024-04-26T21:17:44.336695+0000","last_fullsized":"2024-04-26T21:17:44.336695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:16.657312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340167+0000","last_change":"2024-04-26T21:17:43.353702+0000","last_active":"2024-04-26T21:17:44.340167+0000","last_peered":"2024-04-26T21:17:44.340167+0000","last_clean":"2024-04-26T21:17:44.340167+0000","last_became_active":"2024-04-26T21:17:43.352813+0000","last_became_peered":"2024-04-26T21:17:43.352813+0000","last_unstale":"2024-04-26T21:17:44.340167+0000","last_undegraded":"2024-04-26T21:17:44.340167+0000","last_fullsized":"2024-04-26T21:17:44.340167+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:10.074177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339447+0000","last_change":"2024-04-26T21:17:42.343816+0000","last_active":"2024-04-26T21:17:44.339447+0000","last_peered":"2024-04-26T21:17:44.339447+0000","last_clean":"2024-04-26T21:17:44.339447+0000","last_became_active":"2024-04-26T21:17:42.342970+0000","last_became_peered":"2024-04-26T21:17:42.342970+0000","last_unstale":"2024-04-26T21:17:44.339447+0000","last_undegraded":"2024-04-26T21:17:44.339447+0000","last_fullsized":"2024-04-26T21:17:44.339447+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:27.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.337095+0000","last_change":"2024-04-26T21:17:43.354278+0000","last_active":"2024-04-26T21:17:44.337095+0000","last_peered":"2024-04-26T21:17:44.337095+0000","last_clean":"2024-04-26T21:17:44.337095+0000","last_became_active":"2024-04-26T21:17:43.354026+0000","last_became_peered":"2024-04-26T21:17:43.354026+0000","last_unstale":"2024-04-26T21:17:44.337095+0000","last_undegraded":"2024-04-26T21:17:44.337095+0000","last_fullsized":"2024-04-26T21:17:44.337095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:39.848625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800877+0000","last_change":"2024-04-26T21:17:42.345983+0000","last_active":"2024-04-26T21:17:44.800877+0000","last_peered":"2024-04-26T21:17:44.800877+0000","last_clean":"2024-04-26T21:17:44.800877+0000","last_became_active":"2024-04-26T21:17:42.345713+0000","last_became_peered":"2024-04-26T21:17:42.345713+0000","last_unstale":"2024-04-26T21:17:44.800877+0000","last_undegraded":"2024-04-26T21:17:44.800877+0000","last_fullsized":"2024-04-26T21:17:44.800877+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:59.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801803+0000","last_change":"2024-04-26T21:17:43.344401+0000","last_active":"2024-04-26T21:17:44.801803+0000","last_peered":"2024-04-26T21:17:44.801803+0000","last_clean":"2024-04-26T21:17:44.801803+0000","last_became_active":"2024-04-26T21:17:43.344012+0000","last_became_peered":"2024-04-26T21:17:43.344012+0000","last_unstale":"2024-04-26T21:17:44.801803+0000","last_undegraded":"2024-04-26T21:17:44.801803+0000","last_fullsized":"2024-04-26T21:17:44.801803+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:15.933036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.337156+0000","last_change":"2024-04-26T21:17:42.331607+0000","last_active":"2024-04-26T21:17:44.337156+0000","last_peered":"2024-04-26T21:17:44.337156+0000","last_clean":"2024-04-26T21:17:44.337156+0000","last_became_active":"2024-04-26T21:17:42.331352+0000","last_became_peered":"2024-04-26T21:17:42.331352+0000","last_unstale":"2024-04-26T21:17:44.337156+0000","last_undegraded":"2024-04-26T21:17:44.337156+0000","last_fullsized":"2024-04-26T21:17:44.337156+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:46.523068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801931+0000","last_change":"2024-04-26T21:17:43.340287+0000","last_active":"2024-04-26T21:17:44.801931+0000","last_peered":"2024-04-26T21:17:44.801931+0000","last_clean":"2024-04-26T21:17:44.801931+0000","last_became_active":"2024-04-26T21:17:43.339942+0000","last_became_peered":"2024-04-26T21:17:43.339942+0000","last_unstale":"2024-04-26T21:17:44.801931+0000","last_undegraded":"2024-04-26T21:17:44.801931+0000","last_fullsized":"2024-04-26T21:17:44.801931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:04.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801666+0000","last_change":"2024-04-26T21:17:42.331626+0000","last_active":"2024-04-26T21:17:44.801666+0000","last_peered":"2024-04-26T21:17:44.801666+0000","last_clean":"2024-04-26T21:17:44.801666+0000","last_became_active":"2024-04-26T21:17:42.331295+0000","last_became_peered":"2024-04-26T21:17:42.331295+0000","last_unstale":"2024-04-26T21:17:44.801666+0000","last_undegraded":"2024-04-26T21:17:44.801666+0000","last_fullsized":"2024-04-26T21:17:44.801666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800792+0000","last_change":"2024-04-26T21:17:43.347575+0000","last_active":"2024-04-26T21:17:44.800792+0000","last_peered":"2024-04-26T21:17:44.800792+0000","last_clean":"2024-04-26T21:17:44.800792+0000","last_became_active":"2024-04-26T21:17:43.343004+0000","last_became_peered":"2024-04-26T21:17:43.343004+0000","last_unstale":"2024-04-26T21:17:44.800792+0000","last_undegraded":"2024-04-26T21:17:44.800792+0000","last_fullsized":"2024-04-26T21:17:44.800792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:10.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355527+0000","last_change":"2024-04-26T21:17:42.341073+0000","last_active":"2024-04-26T21:17:44.355527+0000","last_peered":"2024-04-26T21:17:44.355527+0000","last_clean":"2024-04-26T21:17:44.355527+0000","last_became_active":"2024-04-26T21:17:42.340849+0000","last_became_peered":"2024-04-26T21:17:42.340849+0000","last_unstale":"2024-04-26T21:17:44.355527+0000","last_undegraded":"2024-04-26T21:17:44.355527+0000","last_fullsized":"2024-04-26T21:17:44.355527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:00.764821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355501+0000","last_change":"2024-04-26T21:17:43.345115+0000","last_active":"2024-04-26T21:17:44.355501+0000","last_peered":"2024-04-26T21:17:44.355501+0000","last_clean":"2024-04-26T21:17:44.355501+0000","last_became_active":"2024-04-26T21:17:43.344840+0000","last_became_peered":"2024-04-26T21:17:43.344840+0000","last_unstale":"2024-04-26T21:17:44.355501+0000","last_undegraded":"2024-04-26T21:17:44.355501+0000","last_fullsized":"2024-04-26T21:17:44.355501+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:56.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340312+0000","last_change":"2024-04-26T21:17:42.342767+0000","last_active":"2024-04-26T21:17:44.340312+0000","last_peered":"2024-04-26T21:17:44.340312+0000","last_clean":"2024-04-26T21:17:44.340312+0000","last_became_active":"2024-04-26T21:17:42.342487+0000","last_became_peered":"2024-04-26T21:17:42.342487+0000","last_unstale":"2024-04-26T21:17:44.340312+0000","last_undegraded":"2024-04-26T21:17:44.340312+0000","last_fullsized":"2024-04-26T21:17:44.340312+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:59.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801769+0000","last_change":"2024-04-26T21:17:43.351377+0000","last_active":"2024-04-26T21:17:44.801769+0000","last_peered":"2024-04-26T21:17:44.801769+0000","last_clean":"2024-04-26T21:17:44.801769+0000","last_became_active":"2024-04-26T21:17:43.351086+0000","last_became_peered":"2024-04-26T21:17:43.351086+0000","last_unstale":"2024-04-26T21:17:44.801769+0000","last_undegraded":"2024-04-26T21:17:44.801769+0000","last_fullsized":"2024-04-26T21:17:44.801769+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:16.657312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336661+0000","last_change":"2024-04-26T21:17:42.335963+0000","last_active":"2024-04-26T21:17:44.336661+0000","last_peered":"2024-04-26T21:17:44.336661+0000","last_clean":"2024-04-26T21:17:44.336661+0000","last_became_active":"2024-04-26T21:17:42.335654+0000","last_became_peered":"2024-04-26T21:17:42.335654+0000","last_unstale":"2024-04-26T21:17:44.336661+0000","last_undegraded":"2024-04-26T21:17:44.336661+0000","last_fullsized":"2024-04-26T21:17:44.336661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:59.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801449+0000","last_change":"2024-04-26T21:17:43.330154+0000","last_active":"2024-04-26T21:17:44.801449+0000","last_peered":"2024-04-26T21:17:44.801449+0000","last_clean":"2024-04-26T21:17:44.801449+0000","last_became_active":"2024-04-26T21:17:43.329582+0000","last_became_peered":"2024-04-26T21:17:43.329582+0000","last_unstale":"2024-04-26T21:17:44.801449+0000","last_undegraded":"2024-04-26T21:17:44.801449+0000","last_fullsized":"2024-04-26T21:17:44.801449+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:37.616169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801341+0000","last_change":"2024-04-26T21:17:42.339198+0000","last_active":"2024-04-26T21:17:44.801341+0000","last_peered":"2024-04-26T21:17:44.801341+0000","last_clean":"2024-04-26T21:17:44.801341+0000","last_became_active":"2024-04-26T21:17:42.338880+0000","last_became_peered":"2024-04-26T21:17:42.338880+0000","last_unstale":"2024-04-26T21:17:44.801341+0000","last_undegraded":"2024-04-26T21:17:44.801341+0000","last_fullsized":"2024-04-26T21:17:44.801341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352642+0000","last_change":"2024-04-26T21:17:43.343916+0000","last_active":"2024-04-26T21:17:44.352642+0000","last_peered":"2024-04-26T21:17:44.352642+0000","last_clean":"2024-04-26T21:17:44.352642+0000","last_became_active":"2024-04-26T21:17:43.343321+0000","last_became_peered":"2024-04-26T21:17:43.343321+0000","last_unstale":"2024-04-26T21:17:44.352642+0000","last_undegraded":"2024-04-26T21:17:44.352642+0000","last_fullsized":"2024-04-26T21:17:44.352642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:59.139005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801983+0000","last_change":"2024-04-26T21:17:42.331814+0000","last_active":"2024-04-26T21:17:44.801983+0000","last_peered":"2024-04-26T21:17:44.801983+0000","last_clean":"2024-04-26T21:17:44.801983+0000","last_became_active":"2024-04-26T21:17:42.329773+0000","last_became_peered":"2024-04-26T21:17:42.329773+0000","last_unstale":"2024-04-26T21:17:44.801983+0000","last_undegraded":"2024-04-26T21:17:44.801983+0000","last_fullsized":"2024-04-26T21:17:44.801983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:28.261589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340288+0000","last_change":"2024-04-26T21:17:43.335163+0000","last_active":"2024-04-26T21:17:44.340288+0000","last_peered":"2024-04-26T21:17:44.340288+0000","last_clean":"2024-04-26T21:17:44.340288+0000","last_became_active":"2024-04-26T21:17:43.334847+0000","last_became_peered":"2024-04-26T21:17:43.334847+0000","last_unstale":"2024-04-26T21:17:44.340288+0000","last_undegraded":"2024-04-26T21:17:44.340288+0000","last_fullsized":"2024-04-26T21:17:44.340288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:04.773126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355868+0000","last_change":"2024-04-26T21:17:42.334519+0000","last_active":"2024-04-26T21:17:44.355868+0000","last_peered":"2024-04-26T21:17:44.355868+0000","last_clean":"2024-04-26T21:17:44.355868+0000","last_became_active":"2024-04-26T21:17:42.334204+0000","last_became_peered":"2024-04-26T21:17:42.334204+0000","last_unstale":"2024-04-26T21:17:44.355868+0000","last_undegraded":"2024-04-26T21:17:44.355868+0000","last_fullsized":"2024-04-26T21:17:44.355868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:31.002253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800950+0000","last_change":"2024-04-26T21:17:43.344465+0000","last_active":"2024-04-26T21:17:44.800950+0000","last_peered":"2024-04-26T21:17:44.800950+0000","last_clean":"2024-04-26T21:17:44.800950+0000","last_became_active":"2024-04-26T21:17:43.344106+0000","last_became_peered":"2024-04-26T21:17:43.344106+0000","last_unstale":"2024-04-26T21:17:44.800950+0000","last_undegraded":"2024-04-26T21:17:44.800950+0000","last_fullsized":"2024-04-26T21:17:44.800950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:22.978572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355910+0000","last_change":"2024-04-26T21:17:42.340533+0000","last_active":"2024-04-26T21:17:44.355910+0000","last_peered":"2024-04-26T21:17:44.355910+0000","last_clean":"2024-04-26T21:17:44.355910+0000","last_became_active":"2024-04-26T21:17:42.340333+0000","last_became_peered":"2024-04-26T21:17:42.340333+0000","last_unstale":"2024-04-26T21:17:44.355910+0000","last_undegraded":"2024-04-26T21:17:44.355910+0000","last_fullsized":"2024-04-26T21:17:44.355910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:46.523068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801971+0000","last_change":"2024-04-26T21:17:43.340841+0000","last_active":"2024-04-26T21:17:44.801971+0000","last_peered":"2024-04-26T21:17:44.801971+0000","last_clean":"2024-04-26T21:17:44.801971+0000","last_became_active":"2024-04-26T21:17:43.340583+0000","last_became_peered":"2024-04-26T21:17:43.340583+0000","last_unstale":"2024-04-26T21:17:44.801971+0000","last_undegraded":"2024-04-26T21:17:44.801971+0000","last_fullsized":"2024-04-26T21:17:44.801971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:22.978572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801743+0000","last_change":"2024-04-26T21:17:42.342883+0000","last_active":"2024-04-26T21:17:44.801743+0000","last_peered":"2024-04-26T21:17:44.801743+0000","last_clean":"2024-04-26T21:17:44.801743+0000","last_became_active":"2024-04-26T21:17:42.342378+0000","last_became_peered":"2024-04-26T21:17:42.342378+0000","last_unstale":"2024-04-26T21:17:44.801743+0000","last_undegraded":"2024-04-26T21:17:44.801743+0000","last_fullsized":"2024-04-26T21:17:44.801743+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:31.002253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800793+0000","last_change":"2024-04-26T21:17:43.356086+0000","last_active":"2024-04-26T21:17:44.800793+0000","last_peered":"2024-04-26T21:17:44.800793+0000","last_clean":"2024-04-26T21:17:44.800793+0000","last_became_active":"2024-04-26T21:17:43.355791+0000","last_became_peered":"2024-04-26T21:17:43.355791+0000","last_unstale":"2024-04-26T21:17:44.800793+0000","last_undegraded":"2024-04-26T21:17:44.800793+0000","last_fullsized":"2024-04-26T21:17:44.800793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:16.657312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801631+0000","last_change":"2024-04-26T21:17:42.341405+0000","last_active":"2024-04-26T21:17:44.801631+0000","last_peered":"2024-04-26T21:17:44.801631+0000","last_clean":"2024-04-26T21:17:44.801631+0000","last_became_active":"2024-04-26T21:17:42.340573+0000","last_became_peered":"2024-04-26T21:17:42.340573+0000","last_unstale":"2024-04-26T21:17:44.801631+0000","last_undegraded":"2024-04-26T21:17:44.801631+0000","last_fullsized":"2024-04-26T21:17:44.801631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:11.278136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801318+0000","last_change":"2024-04-26T21:17:43.336063+0000","last_active":"2024-04-26T21:17:44.801318+0000","last_peered":"2024-04-26T21:17:44.801318+0000","last_clean":"2024-04-26T21:17:44.801318+0000","last_became_active":"2024-04-26T21:17:43.335799+0000","last_became_peered":"2024-04-26T21:17:43.335799+0000","last_unstale":"2024-04-26T21:17:44.801318+0000","last_undegraded":"2024-04-26T21:17:44.801318+0000","last_fullsized":"2024-04-26T21:17:44.801318+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:15.490238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336808+0000","last_change":"2024-04-26T21:17:42.334314+0000","last_active":"2024-04-26T21:17:44.336808+0000","last_peered":"2024-04-26T21:17:44.336808+0000","last_clean":"2024-04-26T21:17:44.336808+0000","last_became_active":"2024-04-26T21:17:42.334063+0000","last_became_peered":"2024-04-26T21:17:42.334063+0000","last_unstale":"2024-04-26T21:17:44.336808+0000","last_undegraded":"2024-04-26T21:17:44.336808+0000","last_fullsized":"2024-04-26T21:17:44.336808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:01.319492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339985+0000","last_change":"2024-04-26T21:17:43.341147+0000","last_active":"2024-04-26T21:17:44.339985+0000","last_peered":"2024-04-26T21:17:44.339985+0000","last_clean":"2024-04-26T21:17:44.339985+0000","last_became_active":"2024-04-26T21:17:43.340889+0000","last_became_peered":"2024-04-26T21:17:43.340889+0000","last_unstale":"2024-04-26T21:17:44.339985+0000","last_undegraded":"2024-04-26T21:17:44.339985+0000","last_fullsized":"2024-04-26T21:17:44.339985+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:56.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.338819+0000","last_change":"2024-04-26T21:17:42.343295+0000","last_active":"2024-04-26T21:17:44.338819+0000","last_peered":"2024-04-26T21:17:44.338819+0000","last_clean":"2024-04-26T21:17:44.338819+0000","last_became_active":"2024-04-26T21:17:42.343005+0000","last_became_peered":"2024-04-26T21:17:42.343005+0000","last_unstale":"2024-04-26T21:17:44.338819+0000","last_undegraded":"2024-04-26T21:17:44.338819+0000","last_fullsized":"2024-04-26T21:17:44.338819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:56.915272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801494+0000","last_change":"2024-04-26T21:17:43.340568+0000","last_active":"2024-04-26T21:17:44.801494+0000","last_peered":"2024-04-26T21:17:44.801494+0000","last_clean":"2024-04-26T21:17:44.801494+0000","last_became_active":"2024-04-26T21:17:43.340209+0000","last_became_peered":"2024-04-26T21:17:43.340209+0000","last_unstale":"2024-04-26T21:17:44.801494+0000","last_undegraded":"2024-04-26T21:17:44.801494+0000","last_fullsized":"2024-04-26T21:17:44.801494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:04.773126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340050+0000","last_change":"2024-04-26T21:17:42.343042+0000","last_active":"2024-04-26T21:17:44.340050+0000","last_peered":"2024-04-26T21:17:44.340050+0000","last_clean":"2024-04-26T21:17:44.340050+0000","last_became_active":"2024-04-26T21:17:42.342560+0000","last_became_peered":"2024-04-26T21:17:42.342560+0000","last_unstale":"2024-04-26T21:17:44.340050+0000","last_undegraded":"2024-04-26T21:17:44.340050+0000","last_fullsized":"2024-04-26T21:17:44.340050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:01.319492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801768+0000","last_change":"2024-04-26T21:17:43.341617+0000","last_active":"2024-04-26T21:17:44.801768+0000","last_peered":"2024-04-26T21:17:44.801768+0000","last_clean":"2024-04-26T21:17:44.801768+0000","last_became_active":"2024-04-26T21:17:43.341318+0000","last_became_peered":"2024-04-26T21:17:43.341318+0000","last_unstale":"2024-04-26T21:17:44.801768+0000","last_undegraded":"2024-04-26T21:17:44.801768+0000","last_fullsized":"2024-04-26T21:17:44.801768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:39.791507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355889+0000","last_change":"2024-04-26T21:17:42.339674+0000","last_active":"2024-04-26T21:17:44.355889+0000","last_peered":"2024-04-26T21:17:44.355889+0000","last_clean":"2024-04-26T21:17:44.355889+0000","last_became_active":"2024-04-26T21:17:42.339432+0000","last_became_peered":"2024-04-26T21:17:42.339432+0000","last_unstale":"2024-04-26T21:17:44.355889+0000","last_undegraded":"2024-04-26T21:17:44.355889+0000","last_fullsized":"2024-04-26T21:17:44.355889+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:11.615397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355812+0000","last_change":"2024-04-26T21:17:43.352571+0000","last_active":"2024-04-26T21:17:44.355812+0000","last_peered":"2024-04-26T21:17:44.355812+0000","last_clean":"2024-04-26T21:17:44.355812+0000","last_became_active":"2024-04-26T21:17:43.352249+0000","last_became_peered":"2024-04-26T21:17:43.352249+0000","last_unstale":"2024-04-26T21:17:44.355812+0000","last_undegraded":"2024-04-26T21:17:44.355812+0000","last_fullsized":"2024-04-26T21:17:44.355812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:16.960167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801827+0000","last_change":"2024-04-26T21:17:42.339219+0000","last_active":"2024-04-26T21:17:44.801827+0000","last_peered":"2024-04-26T21:17:44.801827+0000","last_clean":"2024-04-26T21:17:44.801827+0000","last_became_active":"2024-04-26T21:17:42.338644+0000","last_became_peered":"2024-04-26T21:17:42.338644+0000","last_unstale":"2024-04-26T21:17:44.801827+0000","last_undegraded":"2024-04-26T21:17:44.801827+0000","last_fullsized":"2024-04-26T21:17:44.801827+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801752+0000","last_change":"2024-04-26T21:17:43.340362+0000","last_active":"2024-04-26T21:17:44.801752+0000","last_peered":"2024-04-26T21:17:44.801752+0000","last_clean":"2024-04-26T21:17:44.801752+0000","last_became_active":"2024-04-26T21:17:43.340088+0000","last_became_peered":"2024-04-26T21:17:43.340088+0000","last_unstale":"2024-04-26T21:17:44.801752+0000","last_undegraded":"2024-04-26T21:17:44.801752+0000","last_fullsized":"2024-04-26T21:17:44.801752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:29.269416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352602+0000","last_change":"2024-04-26T21:17:42.343539+0000","last_active":"2024-04-26T21:17:44.352602+0000","last_peered":"2024-04-26T21:17:44.352602+0000","last_clean":"2024-04-26T21:17:44.352602+0000","last_became_active":"2024-04-26T21:17:42.343185+0000","last_became_peered":"2024-04-26T21:17:42.343185+0000","last_unstale":"2024-04-26T21:17:44.352602+0000","last_undegraded":"2024-04-26T21:17:44.352602+0000","last_fullsized":"2024-04-26T21:17:44.352602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:09.794788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352739+0000","last_change":"2024-04-26T21:17:43.337701+0000","last_active":"2024-04-26T21:17:44.352739+0000","last_peered":"2024-04-26T21:17:44.352739+0000","last_clean":"2024-04-26T21:17:44.352739+0000","last_became_active":"2024-04-26T21:17:43.337408+0000","last_became_peered":"2024-04-26T21:17:43.337408+0000","last_unstale":"2024-04-26T21:17:44.352739+0000","last_undegraded":"2024-04-26T21:17:44.352739+0000","last_fullsized":"2024-04-26T21:17:44.352739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:24.993078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336864+0000","last_change":"2024-04-26T21:17:42.332453+0000","last_active":"2024-04-26T21:17:44.336864+0000","last_peered":"2024-04-26T21:17:44.336864+0000","last_clean":"2024-04-26T21:17:44.336864+0000","last_became_active":"2024-04-26T21:17:42.332152+0000","last_became_peered":"2024-04-26T21:17:42.332152+0000","last_unstale":"2024-04-26T21:17:44.336864+0000","last_undegraded":"2024-04-26T21:17:44.336864+0000","last_fullsized":"2024-04-26T21:17:44.336864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:07.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340210+0000","last_change":"2024-04-26T21:17:43.341141+0000","last_active":"2024-04-26T21:17:44.340210+0000","last_peered":"2024-04-26T21:17:44.340210+0000","last_clean":"2024-04-26T21:17:44.340210+0000","last_became_active":"2024-04-26T21:17:43.340820+0000","last_became_peered":"2024-04-26T21:17:43.340820+0000","last_unstale":"2024-04-26T21:17:44.340210+0000","last_undegraded":"2024-04-26T21:17:44.340210+0000","last_fullsized":"2024-04-26T21:17:44.340210+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:15.490238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352455+0000","last_change":"2024-04-26T21:17:42.341816+0000","last_active":"2024-04-26T21:17:44.352455+0000","last_peered":"2024-04-26T21:17:44.352455+0000","last_clean":"2024-04-26T21:17:44.352455+0000","last_became_active":"2024-04-26T21:17:42.341562+0000","last_became_peered":"2024-04-26T21:17:42.341562+0000","last_unstale":"2024-04-26T21:17:44.352455+0000","last_undegraded":"2024-04-26T21:17:44.352455+0000","last_fullsized":"2024-04-26T21:17:44.352455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:36.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801117+0000","last_change":"2024-04-26T21:17:43.337861+0000","last_active":"2024-04-26T21:17:44.801117+0000","last_peered":"2024-04-26T21:17:44.801117+0000","last_clean":"2024-04-26T21:17:44.801117+0000","last_became_active":"2024-04-26T21:17:43.337619+0000","last_became_peered":"2024-04-26T21:17:43.337619+0000","last_unstale":"2024-04-26T21:17:44.801117+0000","last_undegraded":"2024-04-26T21:17:44.801117+0000","last_fullsized":"2024-04-26T21:17:44.801117+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:40.436468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352398+0000","last_change":"2024-04-26T21:17:42.338754+0000","last_active":"2024-04-26T21:17:44.352398+0000","last_peered":"2024-04-26T21:17:44.352398+0000","last_clean":"2024-04-26T21:17:44.352398+0000","last_became_active":"2024-04-26T21:17:42.338473+0000","last_became_peered":"2024-04-26T21:17:42.338473+0000","last_unstale":"2024-04-26T21:17:44.352398+0000","last_undegraded":"2024-04-26T21:17:44.352398+0000","last_fullsized":"2024-04-26T21:17:44.352398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:06.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355389+0000","last_change":"2024-04-26T21:17:43.350457+0000","last_active":"2024-04-26T21:17:44.355389+0000","last_peered":"2024-04-26T21:17:44.355389+0000","last_clean":"2024-04-26T21:17:44.355389+0000","last_became_active":"2024-04-26T21:17:43.350204+0000","last_became_peered":"2024-04-26T21:17:43.350204+0000","last_unstale":"2024-04-26T21:17:44.355389+0000","last_undegraded":"2024-04-26T21:17:44.355389+0000","last_fullsized":"2024-04-26T21:17:44.355389+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:15.490238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340092+0000","last_change":"2024-04-26T21:17:42.343967+0000","last_active":"2024-04-26T21:17:44.340092+0000","last_peered":"2024-04-26T21:17:44.340092+0000","last_clean":"2024-04-26T21:17:44.340092+0000","last_became_active":"2024-04-26T21:17:42.343698+0000","last_became_peered":"2024-04-26T21:17:42.343698+0000","last_unstale":"2024-04-26T21:17:44.340092+0000","last_undegraded":"2024-04-26T21:17:44.340092+0000","last_fullsized":"2024-04-26T21:17:44.340092+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:07.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801594+0000","last_change":"2024-04-26T21:17:43.329903+0000","last_active":"2024-04-26T21:17:44.801594+0000","last_peered":"2024-04-26T21:17:44.801594+0000","last_clean":"2024-04-26T21:17:44.801594+0000","last_became_active":"2024-04-26T21:17:43.329146+0000","last_became_peered":"2024-04-26T21:17:43.329146+0000","last_unstale":"2024-04-26T21:17:44.801594+0000","last_undegraded":"2024-04-26T21:17:44.801594+0000","last_fullsized":"2024-04-26T21:17:44.801594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:56.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352335+0000","last_change":"2024-04-26T21:17:42.339504+0000","last_active":"2024-04-26T21:17:44.352335+0000","last_peered":"2024-04-26T21:17:44.352335+0000","last_clean":"2024-04-26T21:17:44.352335+0000","last_became_active":"2024-04-26T21:17:42.339252+0000","last_became_peered":"2024-04-26T21:17:42.339252+0000","last_unstale":"2024-04-26T21:17:44.352335+0000","last_undegraded":"2024-04-26T21:17:44.352335+0000","last_fullsized":"2024-04-26T21:17:44.352335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:05.142831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336918+0000","last_change":"2024-04-26T21:17:43.355141+0000","last_active":"2024-04-26T21:17:44.336918+0000","last_peered":"2024-04-26T21:17:44.336918+0000","last_clean":"2024-04-26T21:17:44.336918+0000","last_became_active":"2024-04-26T21:17:43.354914+0000","last_became_peered":"2024-04-26T21:17:43.354914+0000","last_unstale":"2024-04-26T21:17:44.336918+0000","last_undegraded":"2024-04-26T21:17:44.336918+0000","last_fullsized":"2024-04-26T21:17:44.336918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:22.978572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355972+0000","last_change":"2024-04-26T21:17:42.345973+0000","last_active":"2024-04-26T21:17:44.355972+0000","last_peered":"2024-04-26T21:17:44.355972+0000","last_clean":"2024-04-26T21:17:44.355972+0000","last_became_active":"2024-04-26T21:17:42.345147+0000","last_became_peered":"2024-04-26T21:17:42.345147+0000","last_unstale":"2024-04-26T21:17:44.355972+0000","last_undegraded":"2024-04-26T21:17:44.355972+0000","last_fullsized":"2024-04-26T21:17:44.355972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:11.302817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340288+0000","last_change":"2024-04-26T21:17:43.335059+0000","last_active":"2024-04-26T21:17:44.340288+0000","last_peered":"2024-04-26T21:17:44.340288+0000","last_clean":"2024-04-26T21:17:44.340288+0000","last_became_active":"2024-04-26T21:17:43.334762+0000","last_became_peered":"2024-04-26T21:17:43.334762+0000","last_unstale":"2024-04-26T21:17:44.340288+0000","last_undegraded":"2024-04-26T21:17:44.340288+0000","last_fullsized":"2024-04-26T21:17:44.340288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:37.616169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.354116+0000","last_change":"2024-04-26T21:17:42.342526+0000","last_active":"2024-04-26T21:17:44.354116+0000","last_peered":"2024-04-26T21:17:44.354116+0000","last_clean":"2024-04-26T21:17:44.354116+0000","last_became_active":"2024-04-26T21:17:42.342262+0000","last_became_peered":"2024-04-26T21:17:42.342262+0000","last_unstale":"2024-04-26T21:17:44.354116+0000","last_undegraded":"2024-04-26T21:17:44.354116+0000","last_fullsized":"2024-04-26T21:17:44.354116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:02.905628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801861+0000","last_change":"2024-04-26T21:17:43.342322+0000","last_active":"2024-04-26T21:17:44.801861+0000","last_peered":"2024-04-26T21:17:44.801861+0000","last_clean":"2024-04-26T21:17:44.801861+0000","last_became_active":"2024-04-26T21:17:43.342026+0000","last_became_peered":"2024-04-26T21:17:43.342026+0000","last_unstale":"2024-04-26T21:17:44.801861+0000","last_undegraded":"2024-04-26T21:17:44.801861+0000","last_fullsized":"2024-04-26T21:17:44.801861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:16.960167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800950+0000","last_change":"2024-04-26T21:17:42.344849+0000","last_active":"2024-04-26T21:17:44.800950+0000","last_peered":"2024-04-26T21:17:44.800950+0000","last_clean":"2024-04-26T21:17:44.800950+0000","last_became_active":"2024-04-26T21:17:42.344569+0000","last_became_peered":"2024-04-26T21:17:42.344569+0000","last_unstale":"2024-04-26T21:17:44.800950+0000","last_undegraded":"2024-04-26T21:17:44.800950+0000","last_fullsized":"2024-04-26T21:17:44.800950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:01.319492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800978+0000","last_change":"2024-04-26T21:17:43.336097+0000","last_active":"2024-04-26T21:17:44.800978+0000","last_peered":"2024-04-26T21:17:44.800978+0000","last_clean":"2024-04-26T21:17:44.800978+0000","last_became_active":"2024-04-26T21:17:43.335811+0000","last_became_peered":"2024-04-26T21:17:43.335811+0000","last_unstale":"2024-04-26T21:17:44.800978+0000","last_undegraded":"2024-04-26T21:17:44.800978+0000","last_fullsized":"2024-04-26T21:17:44.800978+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:39.848625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801323+0000","last_change":"2024-04-26T21:17:42.343191+0000","last_active":"2024-04-26T21:17:44.801323+0000","last_peered":"2024-04-26T21:17:44.801323+0000","last_clean":"2024-04-26T21:17:44.801323+0000","last_became_active":"2024-04-26T21:17:42.342930+0000","last_became_peered":"2024-04-26T21:17:42.342930+0000","last_unstale":"2024-04-26T21:17:44.801323+0000","last_undegraded":"2024-04-26T21:17:44.801323+0000","last_fullsized":"2024-04-26T21:17:44.801323+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336675+0000","last_change":"2024-04-26T21:17:43.337140+0000","last_active":"2024-04-26T21:17:44.336675+0000","last_peered":"2024-04-26T21:17:44.336675+0000","last_clean":"2024-04-26T21:17:44.336675+0000","last_became_active":"2024-04-26T21:17:43.336896+0000","last_became_peered":"2024-04-26T21:17:43.336896+0000","last_unstale":"2024-04-26T21:17:44.336675+0000","last_undegraded":"2024-04-26T21:17:44.336675+0000","last_fullsized":"2024-04-26T21:17:44.336675+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:10.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339095+0000","last_change":"2024-04-26T21:17:42.343800+0000","last_active":"2024-04-26T21:17:44.339095+0000","last_peered":"2024-04-26T21:17:44.339095+0000","last_clean":"2024-04-26T21:17:44.339095+0000","last_became_active":"2024-04-26T21:17:42.343481+0000","last_became_peered":"2024-04-26T21:17:42.343481+0000","last_unstale":"2024-04-26T21:17:44.339095+0000","last_undegraded":"2024-04-26T21:17:44.339095+0000","last_fullsized":"2024-04-26T21:17:44.339095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:08.843853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801471+0000","last_change":"2024-04-26T21:17:43.343086+0000","last_active":"2024-04-26T21:17:44.801471+0000","last_peered":"2024-04-26T21:17:44.801471+0000","last_clean":"2024-04-26T21:17:44.801471+0000","last_became_active":"2024-04-26T21:17:43.342889+0000","last_became_peered":"2024-04-26T21:17:43.342889+0000","last_unstale":"2024-04-26T21:17:44.801471+0000","last_undegraded":"2024-04-26T21:17:44.801471+0000","last_fullsized":"2024-04-26T21:17:44.801471+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:12.285964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801348+0000","last_change":"2024-04-26T21:17:42.331930+0000","last_active":"2024-04-26T21:17:44.801348+0000","last_peered":"2024-04-26T21:17:44.801348+0000","last_clean":"2024-04-26T21:17:44.801348+0000","last_became_active":"2024-04-26T21:17:42.331650+0000","last_became_peered":"2024-04-26T21:17:42.331650+0000","last_unstale":"2024-04-26T21:17:44.801348+0000","last_undegraded":"2024-04-26T21:17:44.801348+0000","last_fullsized":"2024-04-26T21:17:44.801348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340175+0000","last_change":"2024-04-26T21:17:43.335039+0000","last_active":"2024-04-26T21:17:44.340175+0000","last_peered":"2024-04-26T21:17:44.340175+0000","last_clean":"2024-04-26T21:17:44.340175+0000","last_became_active":"2024-04-26T21:17:43.334736+0000","last_became_peered":"2024-04-26T21:17:43.334736+0000","last_unstale":"2024-04-26T21:17:44.340175+0000","last_undegraded":"2024-04-26T21:17:44.340175+0000","last_fullsized":"2024-04-26T21:17:44.340175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:59.876847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800998+0000","last_change":"2024-04-26T21:17:42.328692+0000","last_active":"2024-04-26T21:17:44.800998+0000","last_peered":"2024-04-26T21:17:44.800998+0000","last_clean":"2024-04-26T21:17:44.800998+0000","last_became_active":"2024-04-26T21:17:42.328387+0000","last_became_peered":"2024-04-26T21:17:42.328387+0000","last_unstale":"2024-04-26T21:17:44.800998+0000","last_undegraded":"2024-04-26T21:17:44.800998+0000","last_fullsized":"2024-04-26T21:17:44.800998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:11.302817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355877+0000","last_change":"2024-04-26T21:17:43.352453+0000","last_active":"2024-04-26T21:17:44.355877+0000","last_peered":"2024-04-26T21:17:44.355877+0000","last_clean":"2024-04-26T21:17:44.355877+0000","last_became_active":"2024-04-26T21:17:43.352155+0000","last_became_peered":"2024-04-26T21:17:43.352155+0000","last_unstale":"2024-04-26T21:17:44.355877+0000","last_undegraded":"2024-04-26T21:17:44.355877+0000","last_fullsized":"2024-04-26T21:17:44.355877+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:26.282204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340285+0000","last_change":"2024-04-26T21:17:42.342999+0000","last_active":"2024-04-26T21:17:44.340285+0000","last_peered":"2024-04-26T21:17:44.340285+0000","last_clean":"2024-04-26T21:17:44.340285+0000","last_became_active":"2024-04-26T21:17:42.342017+0000","last_became_peered":"2024-04-26T21:17:42.342017+0000","last_unstale":"2024-04-26T21:17:44.340285+0000","last_undegraded":"2024-04-26T21:17:44.340285+0000","last_fullsized":"2024-04-26T21:17:44.340285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:46.523068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":206,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340328+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:17:44.340328+0000","last_peered":"2024-04-26T21:17:44.340328+0000","last_clean":"2024-04-26T21:17:44.340328+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:17:44.340328+0000","last_undegraded":"2024-04-26T21:17:44.340328+0000","last_fullsized":"2024-04-26T21:17:44.340328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":792387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":200449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":200941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":201983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":790739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":193715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:17:51.937 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:17:52.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd4200640 1 Processor -- start 2024-04-26T21:17:52.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd4200640 1 -- start start 2024-04-26T21:17:52.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd4200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fedcc0703f0 0x7fedcc167e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd4200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedcc15e690 con 0x7fedcc15e180 2024-04-26T21:17:52.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd4200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedcc0ceb50 con 0x7fedcc15acc0 2024-04-26T21:17:52.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd4200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fedcc0cba60 con 0x7fedcc0703f0 2024-04-26T21:17:52.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd0e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fedcc15e180 0x7fedcc06fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50942/0 (socket says 172.21.15.106:50942) 2024-04-26T21:17:52.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd0e00640 1 -- 172.21.15.106:0/2951668091 learned_addr learned my addr 172.21.15.106:0/2951668091 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:52.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd2200640 1 --2- 172.21.15.106:0/2951668091 >> v2:172.21.15.106:3300/0 conn(0x7fedcc0703f0 0x7fedcc167e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedcbe00640 1 -- 172.21.15.106:0/2951668091 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898558450 0 0) 0x7fedcc15e690 con 0x7fedcc15e180 2024-04-26T21:17:52.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedcbe00640 1 -- 172.21.15.106:0/2951668091 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedb4003530 con 0x7fedcc15e180 2024-04-26T21:17:52.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd2200640 1 -- 172.21.15.106:0/2951668091 >> v1:172.21.15.112:6789/0 conn(0x7fedcc15acc0 legacy=0x7fedcc0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:52.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd2200640 1 -- 172.21.15.106:0/2951668091 >> v1:172.21.15.106:6789/0 conn(0x7fedcc15e180 legacy=0x7fedcc06fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.078+0000 7fedd2200640 1 -- 172.21.15.106:0/2951668091 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc0ce2b0 con 0x7fedcc0703f0 2024-04-26T21:17:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedd2200640 1 --2- 172.21.15.106:0/2951668091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 0x7fedcc167e50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009d90 tx=0x7fedc401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f830886293dac5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedcbe00640 1 -- 172.21.15.106:0/2951668091 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc40b2070 con 0x7fedcc0703f0 2024-04-26T21:17:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedcbe00640 1 -- 172.21.15.106:0/2951668091 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc40a58d0 con 0x7fedcc0703f0 2024-04-26T21:17:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedcbe00640 1 -- 172.21.15.106:0/2951668091 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc40a5ca0 con 0x7fedcc0703f0 2024-04-26T21:17:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedd4200640 1 -- 172.21.15.106:0/2951668091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 msgr2=0x7fedcc167e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedd4200640 1 --2- 172.21.15.106:0/2951668091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 0x7fedcc167e50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009d90 tx=0x7fedc401c900 comp rx=0 tx=0).stop 2024-04-26T21:17:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedd4200640 1 -- 172.21.15.106:0/2951668091 shutdown_connections 2024-04-26T21:17:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedd4200640 1 --2- 172.21.15.106:0/2951668091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 0x7fedcc167e50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedd4200640 1 -- 172.21.15.106:0/2951668091 >> 172.21.15.106:0/2951668091 conn(0x7fedcc073af0 msgr2=0x7fedcc073f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedd4200640 1 -- 172.21.15.106:0/2951668091 shutdown_connections 2024-04-26T21:17:52.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.082+0000 7fedd4200640 1 -- 172.21.15.106:0/2951668091 wait complete. 2024-04-26T21:17:52.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 Processor -- start 2024-04-26T21:17:52.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 -- start start 2024-04-26T21:17:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 0x7fedcc1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc15acc0 0x7fedcc0b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc15e180 0x7fedcc0b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc16ad30 con 0x7fedcc0703f0 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc16abb0 con 0x7fedcc15acc0 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fedcc16aeb0 con 0x7fedcc15e180 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd1800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 0x7fedcc1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd1800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 0x7fedcc1565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39130/0 (socket says 172.21.15.106:39130) 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd1800640 1 -- 172.21.15.106:0/814372449 learned_addr learned my addr 172.21.15.106:0/814372449 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd2200640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc15e180 0x7fedcc0b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd0e00640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc15acc0 0x7fedcc0b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd1800640 1 -- 172.21.15.106:0/814372449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc15e180 msgr2=0x7fedcc0b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd1800640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc15e180 0x7fedcc0b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd1800640 1 -- 172.21.15.106:0/814372449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc15acc0 msgr2=0x7fedcc0b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd1800640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc15acc0 0x7fedcc0b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd1800640 1 -- 172.21.15.106:0/814372449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc0cf960 con 0x7fedcc0703f0 2024-04-26T21:17:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd1800640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 0x7fedcc1565e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fedc000b410 tx=0x7fedc000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedc9600640 1 -- 172.21.15.106:0/814372449 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0015030 con 0x7fedcc0703f0 2024-04-26T21:17:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedc9600640 1 -- 172.21.15.106:0/814372449 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc0004020 con 0x7fedcc0703f0 2024-04-26T21:17:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedc9600640 1 -- 172.21.15.106:0/814372449 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0004450 con 0x7fedcc0703f0 2024-04-26T21:17:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedcc0cfc20 con 0x7fedcc0703f0 2024-04-26T21:17:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.086+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedcc0c6920 con 0x7fedcc0703f0 2024-04-26T21:17:52.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.090+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedcc0c6740 con 0x7fedcc0703f0 2024-04-26T21:17:52.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.090+0000 7fedc9600640 1 -- 172.21.15.106:0/814372449 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fedc0018070 con 0x7fedcc0703f0 2024-04-26T21:17:52.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.090+0000 7fedc9600640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac068380 0x7fedac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.090+0000 7fedc9600640 1 -- 172.21.15.106:0/814372449 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fedc00866a0 con 0x7fedcc0703f0 2024-04-26T21:17:52.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.090+0000 7fedd0e00640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac068380 0x7fedac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.090+0000 7fedd0e00640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac068380 0x7fedac06a840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0b68b0 tx=0x7fedb8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.094+0000 7fedc9600640 1 -- 172.21.15.106:0/814372449 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fedcc0c6740 con 0x7fedcc0703f0 2024-04-26T21:17:52.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.246+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedcc069400 con 0x7fedac068380 2024-04-26T21:17:52.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.254+0000 7fedc9600640 1 -- 172.21.15.106:0/814372449 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7fedcc069400 con 0x7fedac068380 2024-04-26T21:17:52.260 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:52.261 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:17:52.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac068380 msgr2=0x7fedac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac068380 0x7fedac06a840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0b68b0 tx=0x7fedb8009040 comp rx=0 tx=0).stop 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 msgr2=0x7fedcc1565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 0x7fedcc1565e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fedc000b410 tx=0x7fedc000b8d0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 shutdown_connections 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedcc15acc0 0x7fedcc0b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fedac068380 0x7fedac06a840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fedcc15e180 0x7fedcc0b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 --2- 172.21.15.106:0/814372449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0703f0 0x7fedcc1565e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 >> 172.21.15.106:0/814372449 conn(0x7fedcc073af0 msgr2=0x7fedcc0cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 shutdown_connections 2024-04-26T21:17:52.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.258+0000 7fedd4200640 1 -- 172.21.15.106:0/814372449 wait complete. 2024-04-26T21:17:52.280 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-04-26T21:17:50.308616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221064,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753656,"statfs":{"total":773094113280,"available":772867743744,"internally_reserved":0,"allocated":4988928,"data_stored":2788252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.992514"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801966+0000","last_change":"2024-04-26T21:17:43.340568+0000","last_active":"2024-04-26T21:17:44.801966+0000","last_peered":"2024-04-26T21:17:44.801966+0000","last_clean":"2024-04-26T21:17:44.801966+0000","last_became_active":"2024-04-26T21:17:43.340250+0000","last_became_peered":"2024-04-26T21:17:43.340250+0000","last_unstale":"2024-04-26T21:17:44.801966+0000","last_undegraded":"2024-04-26T21:17:44.801966+0000","last_fullsized":"2024-04-26T21:17:44.801966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:26.282204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801806+0000","last_change":"2024-04-26T21:17:43.339005+0000","last_active":"2024-04-26T21:17:44.801806+0000","last_peered":"2024-04-26T21:17:44.801806+0000","last_clean":"2024-04-26T21:17:44.801806+0000","last_became_active":"2024-04-26T21:17:43.338724+0000","last_became_peered":"2024-04-26T21:17:43.338724+0000","last_unstale":"2024-04-26T21:17:44.801806+0000","last_undegraded":"2024-04-26T21:17:44.801806+0000","last_fullsized":"2024-04-26T21:17:44.801806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:41.566356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800988+0000","last_change":"2024-04-26T21:17:43.357149+0000","last_active":"2024-04-26T21:17:44.800988+0000","last_peered":"2024-04-26T21:17:44.800988+0000","last_clean":"2024-04-26T21:17:44.800988+0000","last_became_active":"2024-04-26T21:17:43.356871+0000","last_became_peered":"2024-04-26T21:17:43.356871+0000","last_unstale":"2024-04-26T21:17:44.800988+0000","last_undegraded":"2024-04-26T21:17:44.800988+0000","last_fullsized":"2024-04-26T21:17:44.800988+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:05.084092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352639+0000","last_change":"2024-04-26T21:17:43.344118+0000","last_active":"2024-04-26T21:17:44.352639+0000","last_peered":"2024-04-26T21:17:44.352639+0000","last_clean":"2024-04-26T21:17:44.352639+0000","last_became_active":"2024-04-26T21:17:43.343673+0000","last_became_peered":"2024-04-26T21:17:43.343673+0000","last_unstale":"2024-04-26T21:17:44.352639+0000","last_undegraded":"2024-04-26T21:17:44.352639+0000","last_fullsized":"2024-04-26T21:17:44.352639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:28.124260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352497+0000","last_change":"2024-04-26T21:17:43.342242+0000","last_active":"2024-04-26T21:17:44.352497+0000","last_peered":"2024-04-26T21:17:44.352497+0000","last_clean":"2024-04-26T21:17:44.352497+0000","last_became_active":"2024-04-26T21:17:43.342000+0000","last_became_peered":"2024-04-26T21:17:43.342000+0000","last_unstale":"2024-04-26T21:17:44.352497+0000","last_undegraded":"2024-04-26T21:17:44.352497+0000","last_fullsized":"2024-04-26T21:17:44.352497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:43.733147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336867+0000","last_change":"2024-04-26T21:17:43.338500+0000","last_active":"2024-04-26T21:17:44.336867+0000","last_peered":"2024-04-26T21:17:44.336867+0000","last_clean":"2024-04-26T21:17:44.336867+0000","last_became_active":"2024-04-26T21:17:43.338199+0000","last_became_peered":"2024-04-26T21:17:43.338199+0000","last_unstale":"2024-04-26T21:17:44.336867+0000","last_undegraded":"2024-04-26T21:17:44.336867+0000","last_fullsized":"2024-04-26T21:17:44.336867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:15.933036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355340+0000","last_change":"2024-04-26T21:17:43.352246+0000","last_active":"2024-04-26T21:17:44.355340+0000","last_peered":"2024-04-26T21:17:44.355340+0000","last_clean":"2024-04-26T21:17:44.355340+0000","last_became_active":"2024-04-26T21:17:43.351964+0000","last_became_peered":"2024-04-26T21:17:43.351964+0000","last_unstale":"2024-04-26T21:17:44.355340+0000","last_undegraded":"2024-04-26T21:17:44.355340+0000","last_fullsized":"2024-04-26T21:17:44.355340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:18.213018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800931+0000","last_change":"2024-04-26T21:17:43.345901+0000","last_active":"2024-04-26T21:17:44.800931+0000","last_peered":"2024-04-26T21:17:44.800931+0000","last_clean":"2024-04-26T21:17:44.800931+0000","last_became_active":"2024-04-26T21:17:43.345304+0000","last_became_peered":"2024-04-26T21:17:43.345304+0000","last_unstale":"2024-04-26T21:17:44.800931+0000","last_undegraded":"2024-04-26T21:17:44.800931+0000","last_fullsized":"2024-04-26T21:17:44.800931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:18.213018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801265+0000","last_change":"2024-04-26T21:17:43.356375+0000","last_active":"2024-04-26T21:17:44.801265+0000","last_peered":"2024-04-26T21:17:44.801265+0000","last_clean":"2024-04-26T21:17:44.801265+0000","last_became_active":"2024-04-26T21:17:43.356110+0000","last_became_peered":"2024-04-26T21:17:43.356110+0000","last_unstale":"2024-04-26T21:17:44.801265+0000","last_undegraded":"2024-04-26T21:17:44.801265+0000","last_fullsized":"2024-04-26T21:17:44.801265+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:15.599954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355799+0000","last_change":"2024-04-26T21:17:43.348917+0000","last_active":"2024-04-26T21:17:44.355799+0000","last_peered":"2024-04-26T21:17:44.355799+0000","last_clean":"2024-04-26T21:17:44.355799+0000","last_became_active":"2024-04-26T21:17:43.348367+0000","last_became_peered":"2024-04-26T21:17:43.348367+0000","last_unstale":"2024-04-26T21:17:44.355799+0000","last_undegraded":"2024-04-26T21:17:44.355799+0000","last_fullsized":"2024-04-26T21:17:44.355799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:41.566356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355799+0000","last_change":"2024-04-26T21:17:43.350148+0000","last_active":"2024-04-26T21:17:44.355799+0000","last_peered":"2024-04-26T21:17:44.355799+0000","last_clean":"2024-04-26T21:17:44.355799+0000","last_became_active":"2024-04-26T21:17:43.349659+0000","last_became_peered":"2024-04-26T21:17:43.349659+0000","last_unstale":"2024-04-26T21:17:44.355799+0000","last_undegraded":"2024-04-26T21:17:44.355799+0000","last_fullsized":"2024-04-26T21:17:44.355799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:04.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800903+0000","last_change":"2024-04-26T21:17:43.350393+0000","last_active":"2024-04-26T21:17:44.800903+0000","last_peered":"2024-04-26T21:17:44.800903+0000","last_clean":"2024-04-26T21:17:44.800903+0000","last_became_active":"2024-04-26T21:17:43.349581+0000","last_became_peered":"2024-04-26T21:17:43.349581+0000","last_unstale":"2024-04-26T21:17:44.800903+0000","last_undegraded":"2024-04-26T21:17:44.800903+0000","last_fullsized":"2024-04-26T21:17:44.800903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:15.933036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355425+0000","last_change":"2024-04-26T21:17:43.346155+0000","last_active":"2024-04-26T21:17:44.355425+0000","last_peered":"2024-04-26T21:17:44.355425+0000","last_clean":"2024-04-26T21:17:44.355425+0000","last_became_active":"2024-04-26T21:17:43.345877+0000","last_became_peered":"2024-04-26T21:17:43.345877+0000","last_unstale":"2024-04-26T21:17:44.355425+0000","last_undegraded":"2024-04-26T21:17:44.355425+0000","last_fullsized":"2024-04-26T21:17:44.355425+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:37.616169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801447+0000","last_change":"2024-04-26T21:17:43.344246+0000","last_active":"2024-04-26T21:17:44.801447+0000","last_peered":"2024-04-26T21:17:44.801447+0000","last_clean":"2024-04-26T21:17:44.801447+0000","last_became_active":"2024-04-26T21:17:43.343907+0000","last_became_peered":"2024-04-26T21:17:43.343907+0000","last_unstale":"2024-04-26T21:17:44.801447+0000","last_undegraded":"2024-04-26T21:17:44.801447+0000","last_fullsized":"2024-04-26T21:17:44.801447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:32.010081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355340+0000","last_change":"2024-04-26T21:17:43.352976+0000","last_active":"2024-04-26T21:17:44.355340+0000","last_peered":"2024-04-26T21:17:44.355340+0000","last_clean":"2024-04-26T21:17:44.355340+0000","last_became_active":"2024-04-26T21:17:43.352351+0000","last_became_peered":"2024-04-26T21:17:43.352351+0000","last_unstale":"2024-04-26T21:17:44.355340+0000","last_undegraded":"2024-04-26T21:17:44.355340+0000","last_fullsized":"2024-04-26T21:17:44.355340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:10.074177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339947+0000","last_change":"2024-04-26T21:17:43.347118+0000","last_active":"2024-04-26T21:17:44.339947+0000","last_peered":"2024-04-26T21:17:44.339947+0000","last_clean":"2024-04-26T21:17:44.339947+0000","last_became_active":"2024-04-26T21:17:43.346766+0000","last_became_peered":"2024-04-26T21:17:43.346766+0000","last_unstale":"2024-04-26T21:17:44.339947+0000","last_undegraded":"2024-04-26T21:17:44.339947+0000","last_fullsized":"2024-04-26T21:17:44.339947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:05.084092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340121+0000","last_change":"2024-04-26T21:17:43.353327+0000","last_active":"2024-04-26T21:17:44.340121+0000","last_peered":"2024-04-26T21:17:44.340121+0000","last_clean":"2024-04-26T21:17:44.340121+0000","last_became_active":"2024-04-26T21:17:43.352893+0000","last_became_peered":"2024-04-26T21:17:43.352893+0000","last_unstale":"2024-04-26T21:17:44.340121+0000","last_undegraded":"2024-04-26T21:17:44.340121+0000","last_fullsized":"2024-04-26T21:17:44.340121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:15.599954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339279+0000","last_change":"2024-04-26T21:17:43.339145+0000","last_active":"2024-04-26T21:17:44.339279+0000","last_peered":"2024-04-26T21:17:44.339279+0000","last_clean":"2024-04-26T21:17:44.339279+0000","last_became_active":"2024-04-26T21:17:43.333774+0000","last_became_peered":"2024-04-26T21:17:43.333774+0000","last_unstale":"2024-04-26T21:17:44.339279+0000","last_undegraded":"2024-04-26T21:17:44.339279+0000","last_fullsized":"2024-04-26T21:17:44.339279+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:47.530896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352564+0000","last_change":"2024-04-26T21:17:43.348983+0000","last_active":"2024-04-26T21:17:44.352564+0000","last_peered":"2024-04-26T21:17:44.352564+0000","last_clean":"2024-04-26T21:17:44.352564+0000","last_became_active":"2024-04-26T21:17:43.348709+0000","last_became_peered":"2024-04-26T21:17:43.348709+0000","last_unstale":"2024-04-26T21:17:44.352564+0000","last_undegraded":"2024-04-26T21:17:44.352564+0000","last_fullsized":"2024-04-26T21:17:44.352564+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:19.584578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339060+0000","last_change":"2024-04-26T21:17:43.335371+0000","last_active":"2024-04-26T21:17:44.339060+0000","last_peered":"2024-04-26T21:17:44.339060+0000","last_clean":"2024-04-26T21:17:44.339060+0000","last_became_active":"2024-04-26T21:17:43.335022+0000","last_became_peered":"2024-04-26T21:17:43.335022+0000","last_unstale":"2024-04-26T21:17:44.339060+0000","last_undegraded":"2024-04-26T21:17:44.339060+0000","last_fullsized":"2024-04-26T21:17:44.339060+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:08.792756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355477+0000","last_change":"2024-04-26T21:17:43.346131+0000","last_active":"2024-04-26T21:17:44.355477+0000","last_peered":"2024-04-26T21:17:44.355477+0000","last_clean":"2024-04-26T21:17:44.355477+0000","last_became_active":"2024-04-26T21:17:43.345823+0000","last_became_peered":"2024-04-26T21:17:43.345823+0000","last_unstale":"2024-04-26T21:17:44.355477+0000","last_undegraded":"2024-04-26T21:17:44.355477+0000","last_fullsized":"2024-04-26T21:17:44.355477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:04.773126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801751+0000","last_change":"2024-04-26T21:17:43.343832+0000","last_active":"2024-04-26T21:17:44.801751+0000","last_peered":"2024-04-26T21:17:44.801751+0000","last_clean":"2024-04-26T21:17:44.801751+0000","last_became_active":"2024-04-26T21:17:43.343515+0000","last_became_peered":"2024-04-26T21:17:43.343515+0000","last_unstale":"2024-04-26T21:17:44.801751+0000","last_undegraded":"2024-04-26T21:17:44.801751+0000","last_fullsized":"2024-04-26T21:17:44.801751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:10.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339959+0000","last_change":"2024-04-26T21:17:43.342118+0000","last_active":"2024-04-26T21:17:44.339959+0000","last_peered":"2024-04-26T21:17:44.339959+0000","last_clean":"2024-04-26T21:17:44.339959+0000","last_became_active":"2024-04-26T21:17:43.341808+0000","last_became_peered":"2024-04-26T21:17:43.341808+0000","last_unstale":"2024-04-26T21:17:44.339959+0000","last_undegraded":"2024-04-26T21:17:44.339959+0000","last_fullsized":"2024-04-26T21:17:44.339959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:40.436468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352349+0000","last_change":"2024-04-26T21:17:43.336925+0000","last_active":"2024-04-26T21:17:44.352349+0000","last_peered":"2024-04-26T21:17:44.352349+0000","last_clean":"2024-04-26T21:17:44.352349+0000","last_became_active":"2024-04-26T21:17:43.330141+0000","last_became_peered":"2024-04-26T21:17:43.330141+0000","last_unstale":"2024-04-26T21:17:44.352349+0000","last_undegraded":"2024-04-26T21:17:44.352349+0000","last_fullsized":"2024-04-26T21:17:44.352349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:36:22.996159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339357+0000","last_change":"2024-04-26T21:17:43.341686+0000","last_active":"2024-04-26T21:17:44.339357+0000","last_peered":"2024-04-26T21:17:44.339357+0000","last_clean":"2024-04-26T21:17:44.339357+0000","last_became_active":"2024-04-26T21:17:43.340125+0000","last_became_peered":"2024-04-26T21:17:43.340125+0000","last_unstale":"2024-04-26T21:17:44.339357+0000","last_undegraded":"2024-04-26T21:17:44.339357+0000","last_fullsized":"2024-04-26T21:17:44.339357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:12.623224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.337090+0000","last_change":"2024-04-26T21:17:43.354079+0000","last_active":"2024-04-26T21:17:44.337090+0000","last_peered":"2024-04-26T21:17:44.337090+0000","last_clean":"2024-04-26T21:17:44.337090+0000","last_became_active":"2024-04-26T21:17:43.353816+0000","last_became_peered":"2024-04-26T21:17:43.353816+0000","last_unstale":"2024-04-26T21:17:44.337090+0000","last_undegraded":"2024-04-26T21:17:44.337090+0000","last_fullsized":"2024-04-26T21:17:44.337090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:05.084092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339301+0000","last_change":"2024-04-26T21:17:43.340288+0000","last_active":"2024-04-26T21:17:44.339301+0000","last_peered":"2024-04-26T21:17:44.339301+0000","last_clean":"2024-04-26T21:17:44.339301+0000","last_became_active":"2024-04-26T21:17:43.339960+0000","last_became_peered":"2024-04-26T21:17:43.339960+0000","last_unstale":"2024-04-26T21:17:44.339301+0000","last_undegraded":"2024-04-26T21:17:44.339301+0000","last_fullsized":"2024-04-26T21:17:44.339301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:01.772648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355613+0000","last_change":"2024-04-26T21:17:43.352685+0000","last_active":"2024-04-26T21:17:44.355613+0000","last_peered":"2024-04-26T21:17:44.355613+0000","last_clean":"2024-04-26T21:17:44.355613+0000","last_became_active":"2024-04-26T21:17:43.351931+0000","last_became_peered":"2024-04-26T21:17:43.351931+0000","last_unstale":"2024-04-26T21:17:44.355613+0000","last_undegraded":"2024-04-26T21:17:44.355613+0000","last_fullsized":"2024-04-26T21:17:44.355613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:39.791507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339001+0000","last_change":"2024-04-26T21:17:43.328512+0000","last_active":"2024-04-26T21:17:44.339001+0000","last_peered":"2024-04-26T21:17:44.339001+0000","last_clean":"2024-04-26T21:17:44.339001+0000","last_became_active":"2024-04-26T21:17:43.328232+0000","last_became_peered":"2024-04-26T21:17:43.328232+0000","last_unstale":"2024-04-26T21:17:44.339001+0000","last_undegraded":"2024-04-26T21:17:44.339001+0000","last_fullsized":"2024-04-26T21:17:44.339001+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:00.960623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339057+0000","last_change":"2024-04-26T21:17:43.332524+0000","last_active":"2024-04-26T21:17:44.339057+0000","last_peered":"2024-04-26T21:17:44.339057+0000","last_clean":"2024-04-26T21:17:44.339057+0000","last_became_active":"2024-04-26T21:17:43.331930+0000","last_became_peered":"2024-04-26T21:17:43.331930+0000","last_unstale":"2024-04-26T21:17:44.339057+0000","last_undegraded":"2024-04-26T21:17:44.339057+0000","last_fullsized":"2024-04-26T21:17:44.339057+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:02.327320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340021+0000","last_change":"2024-04-26T21:17:43.339808+0000","last_active":"2024-04-26T21:17:44.340021+0000","last_peered":"2024-04-26T21:17:44.340021+0000","last_clean":"2024-04-26T21:17:44.340021+0000","last_became_active":"2024-04-26T21:17:43.339443+0000","last_became_peered":"2024-04-26T21:17:43.339443+0000","last_unstale":"2024-04-26T21:17:44.340021+0000","last_undegraded":"2024-04-26T21:17:44.340021+0000","last_fullsized":"2024-04-26T21:17:44.340021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:18.213018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336695+0000","last_change":"2024-04-26T21:17:43.339050+0000","last_active":"2024-04-26T21:17:44.336695+0000","last_peered":"2024-04-26T21:17:44.336695+0000","last_clean":"2024-04-26T21:17:44.336695+0000","last_became_active":"2024-04-26T21:17:43.338704+0000","last_became_peered":"2024-04-26T21:17:43.338704+0000","last_unstale":"2024-04-26T21:17:44.336695+0000","last_undegraded":"2024-04-26T21:17:44.336695+0000","last_fullsized":"2024-04-26T21:17:44.336695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:16.657312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340167+0000","last_change":"2024-04-26T21:17:43.353702+0000","last_active":"2024-04-26T21:17:44.340167+0000","last_peered":"2024-04-26T21:17:44.340167+0000","last_clean":"2024-04-26T21:17:44.340167+0000","last_became_active":"2024-04-26T21:17:43.352813+0000","last_became_peered":"2024-04-26T21:17:43.352813+0000","last_unstale":"2024-04-26T21:17:44.340167+0000","last_undegraded":"2024-04-26T21:17:44.340167+0000","last_fullsized":"2024-04-26T21:17:44.340167+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:10.074177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339447+0000","last_change":"2024-04-26T21:17:42.343816+0000","last_active":"2024-04-26T21:17:44.339447+0000","last_peered":"2024-04-26T21:17:44.339447+0000","last_clean":"2024-04-26T21:17:44.339447+0000","last_became_active":"2024-04-26T21:17:42.342970+0000","last_became_peered":"2024-04-26T21:17:42.342970+0000","last_unstale":"2024-04-26T21:17:44.339447+0000","last_undegraded":"2024-04-26T21:17:44.339447+0000","last_fullsized":"2024-04-26T21:17:44.339447+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:27.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.337095+0000","last_change":"2024-04-26T21:17:43.354278+0000","last_active":"2024-04-26T21:17:44.337095+0000","last_peered":"2024-04-26T21:17:44.337095+0000","last_clean":"2024-04-26T21:17:44.337095+0000","last_became_active":"2024-04-26T21:17:43.354026+0000","last_became_peered":"2024-04-26T21:17:43.354026+0000","last_unstale":"2024-04-26T21:17:44.337095+0000","last_undegraded":"2024-04-26T21:17:44.337095+0000","last_fullsized":"2024-04-26T21:17:44.337095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:39.848625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800877+0000","last_change":"2024-04-26T21:17:42.345983+0000","last_active":"2024-04-26T21:17:44.800877+0000","last_peered":"2024-04-26T21:17:44.800877+0000","last_clean":"2024-04-26T21:17:44.800877+0000","last_became_active":"2024-04-26T21:17:42.345713+0000","last_became_peered":"2024-04-26T21:17:42.345713+0000","last_unstale":"2024-04-26T21:17:44.800877+0000","last_undegraded":"2024-04-26T21:17:44.800877+0000","last_fullsized":"2024-04-26T21:17:44.800877+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:59.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801803+0000","last_change":"2024-04-26T21:17:43.344401+0000","last_active":"2024-04-26T21:17:44.801803+0000","last_peered":"2024-04-26T21:17:44.801803+0000","last_clean":"2024-04-26T21:17:44.801803+0000","last_became_active":"2024-04-26T21:17:43.344012+0000","last_became_peered":"2024-04-26T21:17:43.344012+0000","last_unstale":"2024-04-26T21:17:44.801803+0000","last_undegraded":"2024-04-26T21:17:44.801803+0000","last_fullsized":"2024-04-26T21:17:44.801803+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:15.933036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.337156+0000","last_change":"2024-04-26T21:17:42.331607+0000","last_active":"2024-04-26T21:17:44.337156+0000","last_peered":"2024-04-26T21:17:44.337156+0000","last_clean":"2024-04-26T21:17:44.337156+0000","last_became_active":"2024-04-26T21:17:42.331352+0000","last_became_peered":"2024-04-26T21:17:42.331352+0000","last_unstale":"2024-04-26T21:17:44.337156+0000","last_undegraded":"2024-04-26T21:17:44.337156+0000","last_fullsized":"2024-04-26T21:17:44.337156+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:46.523068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801931+0000","last_change":"2024-04-26T21:17:43.340287+0000","last_active":"2024-04-26T21:17:44.801931+0000","last_peered":"2024-04-26T21:17:44.801931+0000","last_clean":"2024-04-26T21:17:44.801931+0000","last_became_active":"2024-04-26T21:17:43.339942+0000","last_became_peered":"2024-04-26T21:17:43.339942+0000","last_unstale":"2024-04-26T21:17:44.801931+0000","last_undegraded":"2024-04-26T21:17:44.801931+0000","last_fullsized":"2024-04-26T21:17:44.801931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:04.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801666+0000","last_change":"2024-04-26T21:17:42.331626+0000","last_active":"2024-04-26T21:17:44.801666+0000","last_peered":"2024-04-26T21:17:44.801666+0000","last_clean":"2024-04-26T21:17:44.801666+0000","last_became_active":"2024-04-26T21:17:42.331295+0000","last_became_peered":"2024-04-26T21:17:42.331295+0000","last_unstale":"2024-04-26T21:17:44.801666+0000","last_undegraded":"2024-04-26T21:17:44.801666+0000","last_fullsized":"2024-04-26T21:17:44.801666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800792+0000","last_change":"2024-04-26T21:17:43.347575+0000","last_active":"2024-04-26T21:17:44.800792+0000","last_peered":"2024-04-26T21:17:44.800792+0000","last_clean":"2024-04-26T21:17:44.800792+0000","last_became_active":"2024-04-26T21:17:43.343004+0000","last_became_peered":"2024-04-26T21:17:43.343004+0000","last_unstale":"2024-04-26T21:17:44.800792+0000","last_undegraded":"2024-04-26T21:17:44.800792+0000","last_fullsized":"2024-04-26T21:17:44.800792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:10.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355527+0000","last_change":"2024-04-26T21:17:42.341073+0000","last_active":"2024-04-26T21:17:44.355527+0000","last_peered":"2024-04-26T21:17:44.355527+0000","last_clean":"2024-04-26T21:17:44.355527+0000","last_became_active":"2024-04-26T21:17:42.340849+0000","last_became_peered":"2024-04-26T21:17:42.340849+0000","last_unstale":"2024-04-26T21:17:44.355527+0000","last_undegraded":"2024-04-26T21:17:44.355527+0000","last_fullsized":"2024-04-26T21:17:44.355527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:00.764821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355501+0000","last_change":"2024-04-26T21:17:43.345115+0000","last_active":"2024-04-26T21:17:44.355501+0000","last_peered":"2024-04-26T21:17:44.355501+0000","last_clean":"2024-04-26T21:17:44.355501+0000","last_became_active":"2024-04-26T21:17:43.344840+0000","last_became_peered":"2024-04-26T21:17:43.344840+0000","last_unstale":"2024-04-26T21:17:44.355501+0000","last_undegraded":"2024-04-26T21:17:44.355501+0000","last_fullsized":"2024-04-26T21:17:44.355501+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:56.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340312+0000","last_change":"2024-04-26T21:17:42.342767+0000","last_active":"2024-04-26T21:17:44.340312+0000","last_peered":"2024-04-26T21:17:44.340312+0000","last_clean":"2024-04-26T21:17:44.340312+0000","last_became_active":"2024-04-26T21:17:42.342487+0000","last_became_peered":"2024-04-26T21:17:42.342487+0000","last_unstale":"2024-04-26T21:17:44.340312+0000","last_undegraded":"2024-04-26T21:17:44.340312+0000","last_fullsized":"2024-04-26T21:17:44.340312+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:59.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801769+0000","last_change":"2024-04-26T21:17:43.351377+0000","last_active":"2024-04-26T21:17:44.801769+0000","last_peered":"2024-04-26T21:17:44.801769+0000","last_clean":"2024-04-26T21:17:44.801769+0000","last_became_active":"2024-04-26T21:17:43.351086+0000","last_became_peered":"2024-04-26T21:17:43.351086+0000","last_unstale":"2024-04-26T21:17:44.801769+0000","last_undegraded":"2024-04-26T21:17:44.801769+0000","last_fullsized":"2024-04-26T21:17:44.801769+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:16.657312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336661+0000","last_change":"2024-04-26T21:17:42.335963+0000","last_active":"2024-04-26T21:17:44.336661+0000","last_peered":"2024-04-26T21:17:44.336661+0000","last_clean":"2024-04-26T21:17:44.336661+0000","last_became_active":"2024-04-26T21:17:42.335654+0000","last_became_peered":"2024-04-26T21:17:42.335654+0000","last_unstale":"2024-04-26T21:17:44.336661+0000","last_undegraded":"2024-04-26T21:17:44.336661+0000","last_fullsized":"2024-04-26T21:17:44.336661+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:59.952796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801449+0000","last_change":"2024-04-26T21:17:43.330154+0000","last_active":"2024-04-26T21:17:44.801449+0000","last_peered":"2024-04-26T21:17:44.801449+0000","last_clean":"2024-04-26T21:17:44.801449+0000","last_became_active":"2024-04-26T21:17:43.329582+0000","last_became_peered":"2024-04-26T21:17:43.329582+0000","last_unstale":"2024-04-26T21:17:44.801449+0000","last_undegraded":"2024-04-26T21:17:44.801449+0000","last_fullsized":"2024-04-26T21:17:44.801449+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:37.616169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801341+0000","last_change":"2024-04-26T21:17:42.339198+0000","last_active":"2024-04-26T21:17:44.801341+0000","last_peered":"2024-04-26T21:17:44.801341+0000","last_clean":"2024-04-26T21:17:44.801341+0000","last_became_active":"2024-04-26T21:17:42.338880+0000","last_became_peered":"2024-04-26T21:17:42.338880+0000","last_unstale":"2024-04-26T21:17:44.801341+0000","last_undegraded":"2024-04-26T21:17:44.801341+0000","last_fullsized":"2024-04-26T21:17:44.801341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:05.873123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352642+0000","last_change":"2024-04-26T21:17:43.343916+0000","last_active":"2024-04-26T21:17:44.352642+0000","last_peered":"2024-04-26T21:17:44.352642+0000","last_clean":"2024-04-26T21:17:44.352642+0000","last_became_active":"2024-04-26T21:17:43.343321+0000","last_became_peered":"2024-04-26T21:17:43.343321+0000","last_unstale":"2024-04-26T21:17:44.352642+0000","last_undegraded":"2024-04-26T21:17:44.352642+0000","last_fullsized":"2024-04-26T21:17:44.352642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:59.139005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801983+0000","last_change":"2024-04-26T21:17:42.331814+0000","last_active":"2024-04-26T21:17:44.801983+0000","last_peered":"2024-04-26T21:17:44.801983+0000","last_clean":"2024-04-26T21:17:44.801983+0000","last_became_active":"2024-04-26T21:17:42.329773+0000","last_became_peered":"2024-04-26T21:17:42.329773+0000","last_unstale":"2024-04-26T21:17:44.801983+0000","last_undegraded":"2024-04-26T21:17:44.801983+0000","last_fullsized":"2024-04-26T21:17:44.801983+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:28.261589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340288+0000","last_change":"2024-04-26T21:17:43.335163+0000","last_active":"2024-04-26T21:17:44.340288+0000","last_peered":"2024-04-26T21:17:44.340288+0000","last_clean":"2024-04-26T21:17:44.340288+0000","last_became_active":"2024-04-26T21:17:43.334847+0000","last_became_peered":"2024-04-26T21:17:43.334847+0000","last_unstale":"2024-04-26T21:17:44.340288+0000","last_undegraded":"2024-04-26T21:17:44.340288+0000","last_fullsized":"2024-04-26T21:17:44.340288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:04.773126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355868+0000","last_change":"2024-04-26T21:17:42.334519+0000","last_active":"2024-04-26T21:17:44.355868+0000","last_peered":"2024-04-26T21:17:44.355868+0000","last_clean":"2024-04-26T21:17:44.355868+0000","last_became_active":"2024-04-26T21:17:42.334204+0000","last_became_peered":"2024-04-26T21:17:42.334204+0000","last_unstale":"2024-04-26T21:17:44.355868+0000","last_undegraded":"2024-04-26T21:17:44.355868+0000","last_fullsized":"2024-04-26T21:17:44.355868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:31.002253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800950+0000","last_change":"2024-04-26T21:17:43.344465+0000","last_active":"2024-04-26T21:17:44.800950+0000","last_peered":"2024-04-26T21:17:44.800950+0000","last_clean":"2024-04-26T21:17:44.800950+0000","last_became_active":"2024-04-26T21:17:43.344106+0000","last_became_peered":"2024-04-26T21:17:43.344106+0000","last_unstale":"2024-04-26T21:17:44.800950+0000","last_undegraded":"2024-04-26T21:17:44.800950+0000","last_fullsized":"2024-04-26T21:17:44.800950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:22.978572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355910+0000","last_change":"2024-04-26T21:17:42.340533+0000","last_active":"2024-04-26T21:17:44.355910+0000","last_peered":"2024-04-26T21:17:44.355910+0000","last_clean":"2024-04-26T21:17:44.355910+0000","last_became_active":"2024-04-26T21:17:42.340333+0000","last_became_peered":"2024-04-26T21:17:42.340333+0000","last_unstale":"2024-04-26T21:17:44.355910+0000","last_undegraded":"2024-04-26T21:17:44.355910+0000","last_fullsized":"2024-04-26T21:17:44.355910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:46.523068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801971+0000","last_change":"2024-04-26T21:17:43.340841+0000","last_active":"2024-04-26T21:17:44.801971+0000","last_peered":"2024-04-26T21:17:44.801971+0000","last_clean":"2024-04-26T21:17:44.801971+0000","last_became_active":"2024-04-26T21:17:43.340583+0000","last_became_peered":"2024-04-26T21:17:43.340583+0000","last_unstale":"2024-04-26T21:17:44.801971+0000","last_undegraded":"2024-04-26T21:17:44.801971+0000","last_fullsized":"2024-04-26T21:17:44.801971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:22.978572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801743+0000","last_change":"2024-04-26T21:17:42.342883+0000","last_active":"2024-04-26T21:17:44.801743+0000","last_peered":"2024-04-26T21:17:44.801743+0000","last_clean":"2024-04-26T21:17:44.801743+0000","last_became_active":"2024-04-26T21:17:42.342378+0000","last_became_peered":"2024-04-26T21:17:42.342378+0000","last_unstale":"2024-04-26T21:17:44.801743+0000","last_undegraded":"2024-04-26T21:17:44.801743+0000","last_fullsized":"2024-04-26T21:17:44.801743+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:31.002253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800793+0000","last_change":"2024-04-26T21:17:43.356086+0000","last_active":"2024-04-26T21:17:44.800793+0000","last_peered":"2024-04-26T21:17:44.800793+0000","last_clean":"2024-04-26T21:17:44.800793+0000","last_became_active":"2024-04-26T21:17:43.355791+0000","last_became_peered":"2024-04-26T21:17:43.355791+0000","last_unstale":"2024-04-26T21:17:44.800793+0000","last_undegraded":"2024-04-26T21:17:44.800793+0000","last_fullsized":"2024-04-26T21:17:44.800793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:16.657312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801631+0000","last_change":"2024-04-26T21:17:42.341405+0000","last_active":"2024-04-26T21:17:44.801631+0000","last_peered":"2024-04-26T21:17:44.801631+0000","last_clean":"2024-04-26T21:17:44.801631+0000","last_became_active":"2024-04-26T21:17:42.340573+0000","last_became_peered":"2024-04-26T21:17:42.340573+0000","last_unstale":"2024-04-26T21:17:44.801631+0000","last_undegraded":"2024-04-26T21:17:44.801631+0000","last_fullsized":"2024-04-26T21:17:44.801631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:11.278136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801318+0000","last_change":"2024-04-26T21:17:43.336063+0000","last_active":"2024-04-26T21:17:44.801318+0000","last_peered":"2024-04-26T21:17:44.801318+0000","last_clean":"2024-04-26T21:17:44.801318+0000","last_became_active":"2024-04-26T21:17:43.335799+0000","last_became_peered":"2024-04-26T21:17:43.335799+0000","last_unstale":"2024-04-26T21:17:44.801318+0000","last_undegraded":"2024-04-26T21:17:44.801318+0000","last_fullsized":"2024-04-26T21:17:44.801318+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:15.490238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336808+0000","last_change":"2024-04-26T21:17:42.334314+0000","last_active":"2024-04-26T21:17:44.336808+0000","last_peered":"2024-04-26T21:17:44.336808+0000","last_clean":"2024-04-26T21:17:44.336808+0000","last_became_active":"2024-04-26T21:17:42.334063+0000","last_became_peered":"2024-04-26T21:17:42.334063+0000","last_unstale":"2024-04-26T21:17:44.336808+0000","last_undegraded":"2024-04-26T21:17:44.336808+0000","last_fullsized":"2024-04-26T21:17:44.336808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:01.319492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339985+0000","last_change":"2024-04-26T21:17:43.341147+0000","last_active":"2024-04-26T21:17:44.339985+0000","last_peered":"2024-04-26T21:17:44.339985+0000","last_clean":"2024-04-26T21:17:44.339985+0000","last_became_active":"2024-04-26T21:17:43.340889+0000","last_became_peered":"2024-04-26T21:17:43.340889+0000","last_unstale":"2024-04-26T21:17:44.339985+0000","last_undegraded":"2024-04-26T21:17:44.339985+0000","last_fullsized":"2024-04-26T21:17:44.339985+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:56.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.338819+0000","last_change":"2024-04-26T21:17:42.343295+0000","last_active":"2024-04-26T21:17:44.338819+0000","last_peered":"2024-04-26T21:17:44.338819+0000","last_clean":"2024-04-26T21:17:44.338819+0000","last_became_active":"2024-04-26T21:17:42.343005+0000","last_became_peered":"2024-04-26T21:17:42.343005+0000","last_unstale":"2024-04-26T21:17:44.338819+0000","last_undegraded":"2024-04-26T21:17:44.338819+0000","last_fullsized":"2024-04-26T21:17:44.338819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:56.915272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801494+0000","last_change":"2024-04-26T21:17:43.340568+0000","last_active":"2024-04-26T21:17:44.801494+0000","last_peered":"2024-04-26T21:17:44.801494+0000","last_clean":"2024-04-26T21:17:44.801494+0000","last_became_active":"2024-04-26T21:17:43.340209+0000","last_became_peered":"2024-04-26T21:17:43.340209+0000","last_unstale":"2024-04-26T21:17:44.801494+0000","last_undegraded":"2024-04-26T21:17:44.801494+0000","last_fullsized":"2024-04-26T21:17:44.801494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:04.773126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340050+0000","last_change":"2024-04-26T21:17:42.343042+0000","last_active":"2024-04-26T21:17:44.340050+0000","last_peered":"2024-04-26T21:17:44.340050+0000","last_clean":"2024-04-26T21:17:44.340050+0000","last_became_active":"2024-04-26T21:17:42.342560+0000","last_became_peered":"2024-04-26T21:17:42.342560+0000","last_unstale":"2024-04-26T21:17:44.340050+0000","last_undegraded":"2024-04-26T21:17:44.340050+0000","last_fullsized":"2024-04-26T21:17:44.340050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:01.319492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801768+0000","last_change":"2024-04-26T21:17:43.341617+0000","last_active":"2024-04-26T21:17:44.801768+0000","last_peered":"2024-04-26T21:17:44.801768+0000","last_clean":"2024-04-26T21:17:44.801768+0000","last_became_active":"2024-04-26T21:17:43.341318+0000","last_became_peered":"2024-04-26T21:17:43.341318+0000","last_unstale":"2024-04-26T21:17:44.801768+0000","last_undegraded":"2024-04-26T21:17:44.801768+0000","last_fullsized":"2024-04-26T21:17:44.801768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:39.791507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355889+0000","last_change":"2024-04-26T21:17:42.339674+0000","last_active":"2024-04-26T21:17:44.355889+0000","last_peered":"2024-04-26T21:17:44.355889+0000","last_clean":"2024-04-26T21:17:44.355889+0000","last_became_active":"2024-04-26T21:17:42.339432+0000","last_became_peered":"2024-04-26T21:17:42.339432+0000","last_unstale":"2024-04-26T21:17:44.355889+0000","last_undegraded":"2024-04-26T21:17:44.355889+0000","last_fullsized":"2024-04-26T21:17:44.355889+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:11.615397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355812+0000","last_change":"2024-04-26T21:17:43.352571+0000","last_active":"2024-04-26T21:17:44.355812+0000","last_peered":"2024-04-26T21:17:44.355812+0000","last_clean":"2024-04-26T21:17:44.355812+0000","last_became_active":"2024-04-26T21:17:43.352249+0000","last_became_peered":"2024-04-26T21:17:43.352249+0000","last_unstale":"2024-04-26T21:17:44.355812+0000","last_undegraded":"2024-04-26T21:17:44.355812+0000","last_fullsized":"2024-04-26T21:17:44.355812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:16.960167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801827+0000","last_change":"2024-04-26T21:17:42.339219+0000","last_active":"2024-04-26T21:17:44.801827+0000","last_peered":"2024-04-26T21:17:44.801827+0000","last_clean":"2024-04-26T21:17:44.801827+0000","last_became_active":"2024-04-26T21:17:42.338644+0000","last_became_peered":"2024-04-26T21:17:42.338644+0000","last_unstale":"2024-04-26T21:17:44.801827+0000","last_undegraded":"2024-04-26T21:17:44.801827+0000","last_fullsized":"2024-04-26T21:17:44.801827+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:37:01.558974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801752+0000","last_change":"2024-04-26T21:17:43.340362+0000","last_active":"2024-04-26T21:17:44.801752+0000","last_peered":"2024-04-26T21:17:44.801752+0000","last_clean":"2024-04-26T21:17:44.801752+0000","last_became_active":"2024-04-26T21:17:43.340088+0000","last_became_peered":"2024-04-26T21:17:43.340088+0000","last_unstale":"2024-04-26T21:17:44.801752+0000","last_undegraded":"2024-04-26T21:17:44.801752+0000","last_fullsized":"2024-04-26T21:17:44.801752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:29.269416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352602+0000","last_change":"2024-04-26T21:17:42.343539+0000","last_active":"2024-04-26T21:17:44.352602+0000","last_peered":"2024-04-26T21:17:44.352602+0000","last_clean":"2024-04-26T21:17:44.352602+0000","last_became_active":"2024-04-26T21:17:42.343185+0000","last_became_peered":"2024-04-26T21:17:42.343185+0000","last_unstale":"2024-04-26T21:17:44.352602+0000","last_undegraded":"2024-04-26T21:17:44.352602+0000","last_fullsized":"2024-04-26T21:17:44.352602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:09.794788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352739+0000","last_change":"2024-04-26T21:17:43.337701+0000","last_active":"2024-04-26T21:17:44.352739+0000","last_peered":"2024-04-26T21:17:44.352739+0000","last_clean":"2024-04-26T21:17:44.352739+0000","last_became_active":"2024-04-26T21:17:43.337408+0000","last_became_peered":"2024-04-26T21:17:43.337408+0000","last_unstale":"2024-04-26T21:17:44.352739+0000","last_undegraded":"2024-04-26T21:17:44.352739+0000","last_fullsized":"2024-04-26T21:17:44.352739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:24.993078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336864+0000","last_change":"2024-04-26T21:17:42.332453+0000","last_active":"2024-04-26T21:17:44.336864+0000","last_peered":"2024-04-26T21:17:44.336864+0000","last_clean":"2024-04-26T21:17:44.336864+0000","last_became_active":"2024-04-26T21:17:42.332152+0000","last_became_peered":"2024-04-26T21:17:42.332152+0000","last_unstale":"2024-04-26T21:17:44.336864+0000","last_undegraded":"2024-04-26T21:17:44.336864+0000","last_fullsized":"2024-04-26T21:17:44.336864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:07.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340210+0000","last_change":"2024-04-26T21:17:43.341141+0000","last_active":"2024-04-26T21:17:44.340210+0000","last_peered":"2024-04-26T21:17:44.340210+0000","last_clean":"2024-04-26T21:17:44.340210+0000","last_became_active":"2024-04-26T21:17:43.340820+0000","last_became_peered":"2024-04-26T21:17:43.340820+0000","last_unstale":"2024-04-26T21:17:44.340210+0000","last_undegraded":"2024-04-26T21:17:44.340210+0000","last_fullsized":"2024-04-26T21:17:44.340210+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:15.490238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352455+0000","last_change":"2024-04-26T21:17:42.341816+0000","last_active":"2024-04-26T21:17:44.352455+0000","last_peered":"2024-04-26T21:17:44.352455+0000","last_clean":"2024-04-26T21:17:44.352455+0000","last_became_active":"2024-04-26T21:17:42.341562+0000","last_became_peered":"2024-04-26T21:17:42.341562+0000","last_unstale":"2024-04-26T21:17:44.352455+0000","last_undegraded":"2024-04-26T21:17:44.352455+0000","last_fullsized":"2024-04-26T21:17:44.352455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:36.701215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801117+0000","last_change":"2024-04-26T21:17:43.337861+0000","last_active":"2024-04-26T21:17:44.801117+0000","last_peered":"2024-04-26T21:17:44.801117+0000","last_clean":"2024-04-26T21:17:44.801117+0000","last_became_active":"2024-04-26T21:17:43.337619+0000","last_became_peered":"2024-04-26T21:17:43.337619+0000","last_unstale":"2024-04-26T21:17:44.801117+0000","last_undegraded":"2024-04-26T21:17:44.801117+0000","last_fullsized":"2024-04-26T21:17:44.801117+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:40.436468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352398+0000","last_change":"2024-04-26T21:17:42.338754+0000","last_active":"2024-04-26T21:17:44.352398+0000","last_peered":"2024-04-26T21:17:44.352398+0000","last_clean":"2024-04-26T21:17:44.352398+0000","last_became_active":"2024-04-26T21:17:42.338473+0000","last_became_peered":"2024-04-26T21:17:42.338473+0000","last_unstale":"2024-04-26T21:17:44.352398+0000","last_undegraded":"2024-04-26T21:17:44.352398+0000","last_fullsized":"2024-04-26T21:17:44.352398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:06.221489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355389+0000","last_change":"2024-04-26T21:17:43.350457+0000","last_active":"2024-04-26T21:17:44.355389+0000","last_peered":"2024-04-26T21:17:44.355389+0000","last_clean":"2024-04-26T21:17:44.355389+0000","last_became_active":"2024-04-26T21:17:43.350204+0000","last_became_peered":"2024-04-26T21:17:43.350204+0000","last_unstale":"2024-04-26T21:17:44.355389+0000","last_undegraded":"2024-04-26T21:17:44.355389+0000","last_fullsized":"2024-04-26T21:17:44.355389+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:15.490238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340092+0000","last_change":"2024-04-26T21:17:42.343967+0000","last_active":"2024-04-26T21:17:44.340092+0000","last_peered":"2024-04-26T21:17:44.340092+0000","last_clean":"2024-04-26T21:17:44.340092+0000","last_became_active":"2024-04-26T21:17:42.343698+0000","last_became_peered":"2024-04-26T21:17:42.343698+0000","last_unstale":"2024-04-26T21:17:44.340092+0000","last_undegraded":"2024-04-26T21:17:44.340092+0000","last_fullsized":"2024-04-26T21:17:44.340092+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:07.784929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801594+0000","last_change":"2024-04-26T21:17:43.329903+0000","last_active":"2024-04-26T21:17:44.801594+0000","last_peered":"2024-04-26T21:17:44.801594+0000","last_clean":"2024-04-26T21:17:44.801594+0000","last_became_active":"2024-04-26T21:17:43.329146+0000","last_became_peered":"2024-04-26T21:17:43.329146+0000","last_unstale":"2024-04-26T21:17:44.801594+0000","last_undegraded":"2024-04-26T21:17:44.801594+0000","last_fullsized":"2024-04-26T21:17:44.801594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:56.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.352335+0000","last_change":"2024-04-26T21:17:42.339504+0000","last_active":"2024-04-26T21:17:44.352335+0000","last_peered":"2024-04-26T21:17:44.352335+0000","last_clean":"2024-04-26T21:17:44.352335+0000","last_became_active":"2024-04-26T21:17:42.339252+0000","last_became_peered":"2024-04-26T21:17:42.339252+0000","last_unstale":"2024-04-26T21:17:44.352335+0000","last_undegraded":"2024-04-26T21:17:44.352335+0000","last_fullsized":"2024-04-26T21:17:44.352335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:05.142831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336918+0000","last_change":"2024-04-26T21:17:43.355141+0000","last_active":"2024-04-26T21:17:44.336918+0000","last_peered":"2024-04-26T21:17:44.336918+0000","last_clean":"2024-04-26T21:17:44.336918+0000","last_became_active":"2024-04-26T21:17:43.354914+0000","last_became_peered":"2024-04-26T21:17:43.354914+0000","last_unstale":"2024-04-26T21:17:44.336918+0000","last_undegraded":"2024-04-26T21:17:44.336918+0000","last_fullsized":"2024-04-26T21:17:44.336918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:22.978572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355972+0000","last_change":"2024-04-26T21:17:42.345973+0000","last_active":"2024-04-26T21:17:44.355972+0000","last_peered":"2024-04-26T21:17:44.355972+0000","last_clean":"2024-04-26T21:17:44.355972+0000","last_became_active":"2024-04-26T21:17:42.345147+0000","last_became_peered":"2024-04-26T21:17:42.345147+0000","last_unstale":"2024-04-26T21:17:44.355972+0000","last_undegraded":"2024-04-26T21:17:44.355972+0000","last_fullsized":"2024-04-26T21:17:44.355972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:11.302817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340288+0000","last_change":"2024-04-26T21:17:43.335059+0000","last_active":"2024-04-26T21:17:44.340288+0000","last_peered":"2024-04-26T21:17:44.340288+0000","last_clean":"2024-04-26T21:17:44.340288+0000","last_became_active":"2024-04-26T21:17:43.334762+0000","last_became_peered":"2024-04-26T21:17:43.334762+0000","last_unstale":"2024-04-26T21:17:44.340288+0000","last_undegraded":"2024-04-26T21:17:44.340288+0000","last_fullsized":"2024-04-26T21:17:44.340288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:37.616169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.354116+0000","last_change":"2024-04-26T21:17:42.342526+0000","last_active":"2024-04-26T21:17:44.354116+0000","last_peered":"2024-04-26T21:17:44.354116+0000","last_clean":"2024-04-26T21:17:44.354116+0000","last_became_active":"2024-04-26T21:17:42.342262+0000","last_became_peered":"2024-04-26T21:17:42.342262+0000","last_unstale":"2024-04-26T21:17:44.354116+0000","last_undegraded":"2024-04-26T21:17:44.354116+0000","last_fullsized":"2024-04-26T21:17:44.354116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:02.905628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801861+0000","last_change":"2024-04-26T21:17:43.342322+0000","last_active":"2024-04-26T21:17:44.801861+0000","last_peered":"2024-04-26T21:17:44.801861+0000","last_clean":"2024-04-26T21:17:44.801861+0000","last_became_active":"2024-04-26T21:17:43.342026+0000","last_became_peered":"2024-04-26T21:17:43.342026+0000","last_unstale":"2024-04-26T21:17:44.801861+0000","last_undegraded":"2024-04-26T21:17:44.801861+0000","last_fullsized":"2024-04-26T21:17:44.801861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:50:16.960167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800950+0000","last_change":"2024-04-26T21:17:42.344849+0000","last_active":"2024-04-26T21:17:44.800950+0000","last_peered":"2024-04-26T21:17:44.800950+0000","last_clean":"2024-04-26T21:17:44.800950+0000","last_became_active":"2024-04-26T21:17:42.344569+0000","last_became_peered":"2024-04-26T21:17:42.344569+0000","last_unstale":"2024-04-26T21:17:44.800950+0000","last_undegraded":"2024-04-26T21:17:44.800950+0000","last_fullsized":"2024-04-26T21:17:44.800950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:01.319492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800978+0000","last_change":"2024-04-26T21:17:43.336097+0000","last_active":"2024-04-26T21:17:44.800978+0000","last_peered":"2024-04-26T21:17:44.800978+0000","last_clean":"2024-04-26T21:17:44.800978+0000","last_became_active":"2024-04-26T21:17:43.335811+0000","last_became_peered":"2024-04-26T21:17:43.335811+0000","last_unstale":"2024-04-26T21:17:44.800978+0000","last_undegraded":"2024-04-26T21:17:44.800978+0000","last_fullsized":"2024-04-26T21:17:44.800978+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:39.848625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801323+0000","last_change":"2024-04-26T21:17:42.343191+0000","last_active":"2024-04-26T21:17:44.801323+0000","last_peered":"2024-04-26T21:17:44.801323+0000","last_clean":"2024-04-26T21:17:44.801323+0000","last_became_active":"2024-04-26T21:17:42.342930+0000","last_became_peered":"2024-04-26T21:17:42.342930+0000","last_unstale":"2024-04-26T21:17:44.801323+0000","last_undegraded":"2024-04-26T21:17:44.801323+0000","last_fullsized":"2024-04-26T21:17:44.801323+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:24.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.336675+0000","last_change":"2024-04-26T21:17:43.337140+0000","last_active":"2024-04-26T21:17:44.336675+0000","last_peered":"2024-04-26T21:17:44.336675+0000","last_clean":"2024-04-26T21:17:44.336675+0000","last_became_active":"2024-04-26T21:17:43.336896+0000","last_became_peered":"2024-04-26T21:17:43.336896+0000","last_unstale":"2024-04-26T21:17:44.336675+0000","last_undegraded":"2024-04-26T21:17:44.336675+0000","last_fullsized":"2024-04-26T21:17:44.336675+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:10.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.339095+0000","last_change":"2024-04-26T21:17:42.343800+0000","last_active":"2024-04-26T21:17:44.339095+0000","last_peered":"2024-04-26T21:17:44.339095+0000","last_clean":"2024-04-26T21:17:44.339095+0000","last_became_active":"2024-04-26T21:17:42.343481+0000","last_became_peered":"2024-04-26T21:17:42.343481+0000","last_unstale":"2024-04-26T21:17:44.339095+0000","last_undegraded":"2024-04-26T21:17:44.339095+0000","last_fullsized":"2024-04-26T21:17:44.339095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:08.843853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801471+0000","last_change":"2024-04-26T21:17:43.343086+0000","last_active":"2024-04-26T21:17:44.801471+0000","last_peered":"2024-04-26T21:17:44.801471+0000","last_clean":"2024-04-26T21:17:44.801471+0000","last_became_active":"2024-04-26T21:17:43.342889+0000","last_became_peered":"2024-04-26T21:17:43.342889+0000","last_unstale":"2024-04-26T21:17:44.801471+0000","last_undegraded":"2024-04-26T21:17:44.801471+0000","last_fullsized":"2024-04-26T21:17:44.801471+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:12.285964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.801348+0000","last_change":"2024-04-26T21:17:42.331930+0000","last_active":"2024-04-26T21:17:44.801348+0000","last_peered":"2024-04-26T21:17:44.801348+0000","last_clean":"2024-04-26T21:17:44.801348+0000","last_became_active":"2024-04-26T21:17:42.331650+0000","last_became_peered":"2024-04-26T21:17:42.331650+0000","last_unstale":"2024-04-26T21:17:44.801348+0000","last_undegraded":"2024-04-26T21:17:44.801348+0000","last_fullsized":"2024-04-26T21:17:44.801348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:26.017749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340175+0000","last_change":"2024-04-26T21:17:43.335039+0000","last_active":"2024-04-26T21:17:44.340175+0000","last_peered":"2024-04-26T21:17:44.340175+0000","last_clean":"2024-04-26T21:17:44.340175+0000","last_became_active":"2024-04-26T21:17:43.334736+0000","last_became_peered":"2024-04-26T21:17:43.334736+0000","last_unstale":"2024-04-26T21:17:44.340175+0000","last_undegraded":"2024-04-26T21:17:44.340175+0000","last_fullsized":"2024-04-26T21:17:44.340175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:59.876847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.800998+0000","last_change":"2024-04-26T21:17:42.328692+0000","last_active":"2024-04-26T21:17:44.800998+0000","last_peered":"2024-04-26T21:17:44.800998+0000","last_clean":"2024-04-26T21:17:44.800998+0000","last_became_active":"2024-04-26T21:17:42.328387+0000","last_became_peered":"2024-04-26T21:17:42.328387+0000","last_unstale":"2024-04-26T21:17:44.800998+0000","last_undegraded":"2024-04-26T21:17:44.800998+0000","last_fullsized":"2024-04-26T21:17:44.800998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:11.302817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.355877+0000","last_change":"2024-04-26T21:17:43.352453+0000","last_active":"2024-04-26T21:17:44.355877+0000","last_peered":"2024-04-26T21:17:44.355877+0000","last_clean":"2024-04-26T21:17:44.355877+0000","last_became_active":"2024-04-26T21:17:43.352155+0000","last_became_peered":"2024-04-26T21:17:43.352155+0000","last_unstale":"2024-04-26T21:17:44.355877+0000","last_undegraded":"2024-04-26T21:17:44.355877+0000","last_fullsized":"2024-04-26T21:17:44.355877+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:42.309709+0000","last_clean_scrub_stamp":"2024-04-26T21:17:42.309709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:26.282204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340285+0000","last_change":"2024-04-26T21:17:42.342999+0000","last_active":"2024-04-26T21:17:44.340285+0000","last_peered":"2024-04-26T21:17:44.340285+0000","last_clean":"2024-04-26T21:17:44.340285+0000","last_became_active":"2024-04-26T21:17:42.342017+0000","last_became_peered":"2024-04-26T21:17:42.342017+0000","last_unstale":"2024-04-26T21:17:44.340285+0000","last_undegraded":"2024-04-26T21:17:44.340285+0000","last_fullsized":"2024-04-26T21:17:44.340285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:17:41.301881+0000","last_clean_scrub_stamp":"2024-04-26T21:17:41.301881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:46.523068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":206,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T21:17:44.340328+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:17:44.340328+0000","last_peered":"2024-04-26T21:17:44.340328+0000","last_clean":"2024-04-26T21:17:44.340328+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:17:44.340328+0000","last_undegraded":"2024-04-26T21:17:44.340328+0000","last_fullsized":"2024-04-26T21:17:44.340328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":792387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":200449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":200941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":201983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":790739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":200407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:17:52.284 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T21:17:52.284 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T21:17:52.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6566800640 1 Processor -- start 2024-04-26T21:17:52.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6566800640 1 -- start start 2024-04-26T21:17:52.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6566800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f656015f270 0x7f656006d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6566800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f65600d18e0 0x7f656006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6566800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65600cd1e0 con 0x7f656006e2c0 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6566800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f65600d1e10 con 0x7f65600d18e0 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6566800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f65600d20f0 con 0x7f656015f270 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6556a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f65600d18e0 0x7f656006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6556a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f65600d18e0 0x7f656006dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39134/0 (socket says 172.21.15.106:39134) 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6556a00640 1 -- 172.21.15.106:0/2859569856 learned_addr learned my addr 172.21.15.106:0/2859569856 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f655f400640 1 --2- 172.21.15.106:0/2859569856 >> v2:172.21.15.112:3300/0 conn(0x7f656015f270 0x7f656006d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6556a00640 1 -- 172.21.15.106:0/2859569856 >> v2:172.21.15.112:3300/0 conn(0x7f656015f270 msgr2=0x7f656006d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6556a00640 1 --2- 172.21.15.106:0/2859569856 >> v2:172.21.15.112:3300/0 conn(0x7f656015f270 0x7f656006d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6556a00640 1 -- 172.21.15.106:0/2859569856 >> v1:172.21.15.112:6789/0 conn(0x7f656006e2c0 legacy=0x7f65600cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.466+0000 7f6556a00640 1 -- 172.21.15.106:0/2859569856 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600d23d0 con 0x7f65600d18e0 2024-04-26T21:17:52.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f6556a00640 1 --2- 172.21.15.106:0/2859569856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65600d18e0 0x7f656006dd80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f656006f9c0 tx=0x7f654801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acc15946e09fa09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f655ea00640 1 -- 172.21.15.106:0/2859569856 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480ab600 con 0x7f65600d18e0 2024-04-26T21:17:52.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f655ea00640 1 -- 172.21.15.106:0/2859569856 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65480b0070 con 0x7f65600d18e0 2024-04-26T21:17:52.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f655ea00640 1 -- 172.21.15.106:0/2859569856 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480ab9c0 con 0x7f65600d18e0 2024-04-26T21:17:52.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f6566800640 1 -- 172.21.15.106:0/2859569856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65600d18e0 msgr2=0x7f656006dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f6566800640 1 --2- 172.21.15.106:0/2859569856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65600d18e0 0x7f656006dd80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f656006f9c0 tx=0x7f654801c4f0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f6566800640 1 -- 172.21.15.106:0/2859569856 shutdown_connections 2024-04-26T21:17:52.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f6566800640 1 --2- 172.21.15.106:0/2859569856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65600d18e0 0x7f656006dd80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f6566800640 1 --2- 172.21.15.106:0/2859569856 >> v2:172.21.15.112:3300/0 conn(0x7f656015f270 0x7f656006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f6566800640 1 -- 172.21.15.106:0/2859569856 >> 172.21.15.106:0/2859569856 conn(0x7f65600d2b90 msgr2=0x7f65600d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:52.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f6566800640 1 -- 172.21.15.106:0/2859569856 shutdown_connections 2024-04-26T21:17:52.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.470+0000 7f6566800640 1 -- 172.21.15.106:0/2859569856 wait complete. 2024-04-26T21:17:52.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 Processor -- start 2024-04-26T21:17:52.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 -- start start 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f656006e2c0 0x7f656014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65600d18e0 0x7f65600709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f656015f270 0x7f6560070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f656016bfc0 con 0x7f656015f270 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f656016be40 con 0x7f65600d18e0 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f656016c140 con 0x7f656006e2c0 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f656015f270 0x7f6560070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f656015f270 0x7f6560070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39148/0 (socket says 172.21.15.106:39148) 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6556a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65600d18e0 0x7f65600709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655fe00640 1 -- 172.21.15.106:0/247537871 learned_addr learned my addr 172.21.15.106:0/247537871 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:52.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655f400640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f656006e2c0 0x7f656014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655fe00640 1 -- 172.21.15.106:0/247537871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f656006e2c0 msgr2=0x7f656014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655fe00640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f656006e2c0 0x7f656014fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655fe00640 1 -- 172.21.15.106:0/247537871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65600d18e0 msgr2=0x7f65600709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655fe00640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65600d18e0 0x7f65600709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655fe00640 1 -- 172.21.15.106:0/247537871 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600b2b70 con 0x7f656015f270 2024-04-26T21:17:52.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f655fe00640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f656015f270 0x7f6560070f00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f655800c430 tx=0x7f655800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6557e00640 1 -- 172.21.15.106:0/247537871 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558005220 con 0x7f656015f270 2024-04-26T21:17:52.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6557e00640 1 -- 172.21.15.106:0/247537871 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65580053c0 con 0x7f656015f270 2024-04-26T21:17:52.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6557e00640 1 -- 172.21.15.106:0/247537871 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558007270 con 0x7f656015f270 2024-04-26T21:17:52.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65600b2e50 con 0x7f656015f270 2024-04-26T21:17:52.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.474+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65600b3410 con 0x7f656015f270 2024-04-26T21:17:52.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.478+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6560069400 con 0x7f656015f270 2024-04-26T21:17:52.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.478+0000 7f6557e00640 1 -- 172.21.15.106:0/247537871 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6558019020 con 0x7f656015f270 2024-04-26T21:17:52.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.478+0000 7f6557e00640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f653c068380 0x7f653c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.478+0000 7f6557e00640 1 -- 172.21.15.106:0/247537871 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f6558085dc0 con 0x7f656015f270 2024-04-26T21:17:52.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.478+0000 7f655f400640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f653c068380 0x7f653c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.478+0000 7f655f400640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f653c068380 0x7f653c06a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6550011340 tx=0x7f655000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.482+0000 7f6557e00640 1 -- 172.21.15.106:0/247537871 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6558055b90 con 0x7f656015f270 2024-04-26T21:17:52.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.694+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f65600b1a40 con 0x7f656015f270 2024-04-26T21:17:52.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6557e00640 1 -- 172.21.15.106:0/247537871 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f6558059e90 con 0x7f656015f270 2024-04-26T21:17:52.700 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-04-26T21:17:52.701 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBpGSxm3sFdExAA7AIaf9qeEkhvJ9xnUUughQ== 2024-04-26T21:17:52.701 INFO:teuthology.orchestra.run.smithi106.stdout: caps mds = "allow" 2024-04-26T21:17:52.701 INFO:teuthology.orchestra.run.smithi106.stdout: caps mon = "allow r" 2024-04-26T21:17:52.701 INFO:teuthology.orchestra.run.smithi106.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T21:17:52.701 INFO:teuthology.orchestra.run.smithi106.stderr:updated caps for client.0 2024-04-26T21:17:52.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f653c068380 msgr2=0x7f653c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f653c068380 0x7f653c06a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6550011340 tx=0x7f655000b040 comp rx=0 tx=0).stop 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f656015f270 msgr2=0x7f6560070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f656015f270 0x7f6560070f00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f655800c430 tx=0x7f655800c8f0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 shutdown_connections 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65600d18e0 0x7f65600709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f653c068380 0x7f653c06a840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f656015f270 0x7f6560070f00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 --2- 172.21.15.106:0/247537871 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f656006e2c0 0x7f656014fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 >> 172.21.15.106:0/247537871 conn(0x7f65600d2b90 msgr2=0x7f656015e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 shutdown_connections 2024-04-26T21:17:52.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.698+0000 7f6566800640 1 -- 172.21.15.106:0/247537871 wait complete. 2024-04-26T21:17:52.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:17:52.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa56d600640 1 Processor -- start 2024-04-26T21:17:52.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa56d600640 1 -- start start 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa56d600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa56815f3d0 0x7fa5680cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa56d600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5680cdc50 0x7fa5680ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa56d600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5680d1d70 con 0x7fa5680d37f0 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa56d600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fa5680d2050 con 0x7fa5680cdc50 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa56d600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa5680cd450 con 0x7fa56815f3d0 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa567400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5680cdc50 0x7fa5680ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa567400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5680cdc50 0x7fa5680ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39156/0 (socket says 172.21.15.106:39156) 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa567400640 1 -- 172.21.15.106:0/2125648103 learned_addr learned my addr 172.21.15.106:0/2125648103 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa566a00640 1 --2- 172.21.15.106:0/2125648103 >> v2:172.21.15.112:3300/0 conn(0x7fa56815f3d0 0x7fa5680cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa567400640 1 -- 172.21.15.106:0/2125648103 >> v2:172.21.15.112:3300/0 conn(0x7fa56815f3d0 msgr2=0x7fa5680cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa567400640 1 --2- 172.21.15.106:0/2125648103 >> v2:172.21.15.112:3300/0 conn(0x7fa56815f3d0 0x7fa5680cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa567400640 1 -- 172.21.15.106:0/2125648103 >> v1:172.21.15.112:6789/0 conn(0x7fa5680d37f0 legacy=0x7fa5680cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:52.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.854+0000 7fa567400640 1 -- 172.21.15.106:0/2125648103 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5680cd730 con 0x7fa5680cdc50 2024-04-26T21:17:52.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa567400640 1 --2- 172.21.15.106:0/2125648103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 0x7fa5680ce0a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa568073190 tx=0x7fa56001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97177fd633381e08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa565600640 1 -- 172.21.15.106:0/2125648103 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5600b0070 con 0x7fa5680cdc50 2024-04-26T21:17:52.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa565600640 1 -- 172.21.15.106:0/2125648103 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5600ab600 con 0x7fa5680cdc50 2024-04-26T21:17:52.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa565600640 1 -- 172.21.15.106:0/2125648103 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5600ab9d0 con 0x7fa5680cdc50 2024-04-26T21:17:52.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa56d600640 1 -- 172.21.15.106:0/2125648103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 msgr2=0x7fa5680ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa56d600640 1 --2- 172.21.15.106:0/2125648103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 0x7fa5680ce0a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa568073190 tx=0x7fa56001c4e0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa56d600640 1 -- 172.21.15.106:0/2125648103 shutdown_connections 2024-04-26T21:17:52.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa56d600640 1 --2- 172.21.15.106:0/2125648103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 0x7fa5680ce0a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa56d600640 1 --2- 172.21.15.106:0/2125648103 >> v2:172.21.15.112:3300/0 conn(0x7fa56815f3d0 0x7fa5680cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa56d600640 1 -- 172.21.15.106:0/2125648103 >> 172.21.15.106:0/2125648103 conn(0x7fa5680d2c60 msgr2=0x7fa5680d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:52.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa56d600640 1 -- 172.21.15.106:0/2125648103 shutdown_connections 2024-04-26T21:17:52.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.858+0000 7fa56d600640 1 -- 172.21.15.106:0/2125648103 wait complete. 2024-04-26T21:17:52.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 Processor -- start 2024-04-26T21:17:52.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 -- start start 2024-04-26T21:17:52.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 0x7fa56815d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5680d37f0 0x7fa5680c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa56815f3d0 0x7fa56815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa56816c010 con 0x7fa5680cdc50 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5680d0340 con 0x7fa5680d37f0 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa56816c190 con 0x7fa56815f3d0 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 0x7fa56815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 0x7fa56815d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39168/0 (socket says 172.21.15.106:39168) 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566a00640 1 -- 172.21.15.106:0/3020427897 learned_addr learned my addr 172.21.15.106:0/3020427897 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566000640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5680d37f0 0x7fa5680c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa567400640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa56815f3d0 0x7fa56815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566a00640 1 -- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa56815f3d0 msgr2=0x7fa56815fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566a00640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa56815f3d0 0x7fa56815fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566a00640 1 -- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5680d37f0 msgr2=0x7fa5680c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566a00640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5680d37f0 0x7fa5680c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566a00640 1 -- 172.21.15.106:0/3020427897 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56815bd80 con 0x7fa5680cdc50 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa567400640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa56815f3d0 0x7fa56815fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:52.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566000640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5680d37f0 0x7fa5680c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:52.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa566a00640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 0x7fa56815d320 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa558007e40 tx=0x7fa55800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa55ea00640 1 -- 172.21.15.106:0/3020427897 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558014620 con 0x7fa5680cdc50 2024-04-26T21:17:52.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa55ea00640 1 -- 172.21.15.106:0/3020427897 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa558019070 con 0x7fa5680cdc50 2024-04-26T21:17:52.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa55ea00640 1 -- 172.21.15.106:0/3020427897 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558014a00 con 0x7fa5680cdc50 2024-04-26T21:17:52.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56815c060 con 0x7fa5680cdc50 2024-04-26T21:17:52.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56815c620 con 0x7fa5680cdc50 2024-04-26T21:17:52.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.862+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa568069400 con 0x7fa5680cdc50 2024-04-26T21:17:52.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.866+0000 7fa55ea00640 1 -- 172.21.15.106:0/3020427897 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa558014ba0 con 0x7fa5680cdc50 2024-04-26T21:17:52.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.866+0000 7fa55ea00640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa5480683b0 0x7fa54806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.866+0000 7fa55ea00640 1 -- 172.21.15.106:0/3020427897 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fa5580873a0 con 0x7fa5680cdc50 2024-04-26T21:17:52.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.866+0000 7fa566000640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa5480683b0 0x7fa54806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.866+0000 7fa566000640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa5480683b0 0x7fa54806a870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa56815e4d0 tx=0x7fa554009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:52.870+0000 7fa55ea00640 1 -- 172.21.15.106:0/3020427897 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa5580577c0 con 0x7fa5680cdc50 2024-04-26T21:17:53.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.058+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa568162af0 con 0x7fa5680cdc50 2024-04-26T21:17:53.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.058+0000 7fa55ea00640 1 -- 172.21.15.106:0/3020427897 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7fa5580570c0 con 0x7fa5680cdc50 2024-04-26T21:17:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:53.063 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:17:45.722737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5469":{"gid":5469,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1043820033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1043820033},{"type":"v1","addr":"172.21.15.106:6836","nonce":1043820033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5469,"qdb_cluster":[5469]},"id":2}]} 2024-04-26T21:17:53.064 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 18 2024-04-26T21:17:53.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa5480683b0 msgr2=0x7fa54806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa5480683b0 0x7fa54806a870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa56815e4d0 tx=0x7fa554009040 comp rx=0 tx=0).stop 2024-04-26T21:17:53.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 msgr2=0x7fa56815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 0x7fa56815d320 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa558007e40 tx=0x7fa55800e4b0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 shutdown_connections 2024-04-26T21:17:53.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5680d37f0 0x7fa5680c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa5480683b0 0x7fa54806a870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa56815f3d0 0x7fa56815fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 --2- 172.21.15.106:0/3020427897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5680cdc50 0x7fa56815d320 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 >> 172.21.15.106:0/3020427897 conn(0x7fa5680d2c60 msgr2=0x7fa5680d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 shutdown_connections 2024-04-26T21:17:53.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.062+0000 7fa56d600640 1 -- 172.21.15.106:0/3020427897 wait complete. 2024-04-26T21:17:53.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:17:42.703325+0000', 'modified': '2024-04-26T21:17:45.722737+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5469}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5469': {'gid': 5469, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6836/1043820033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 1043820033}, {'type': 'v1', 'addr': '172.21.15.106:6836', 'nonce': 1043820033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5469, 'qdb_cluster': [5469]} 2024-04-26T21:17:53.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T21:17:53.487 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T21:17:53.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.622+0000 7fd883c00640 1 Processor -- start 2024-04-26T21:17:53.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.622+0000 7fd883c00640 1 -- start start 2024-04-26T21:17:53.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.622+0000 7fd883c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c13ed60 0x7fd87c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.622+0000 7fd883c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd87c13f140 0x7fd87c0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.622+0000 7fd883c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd87c06eb70 0x7fd87c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.622+0000 7fd883c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fd87c0b3ac0 con 0x7fd87c13f140 2024-04-26T21:17:53.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.622+0000 7fd883c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd87c0b4920 con 0x7fd87c06eb70 2024-04-26T21:17:53.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.622+0000 7fd883c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd87c0b3d10 con 0x7fd87c13ed60 2024-04-26T21:17:53.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd873e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd87c13f140 0x7fd87c0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd873e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd87c13f140 0x7fd87c0b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39170/0 (socket says 172.21.15.106:39170) 2024-04-26T21:17:53.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd873e00640 1 -- 172.21.15.106:0/2964090321 learned_addr learned my addr 172.21.15.106:0/2964090321 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:53.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd873e00640 1 -- 172.21.15.106:0/2964090321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c13ed60 msgr2=0x7fd87c15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd881200640 1 --2- 172.21.15.106:0/2964090321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c13ed60 0x7fd87c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd881c00640 1 --2- 172.21.15.106:0/2964090321 >> v2:172.21.15.112:3300/0 conn(0x7fd87c06eb70 0x7fd87c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd873e00640 1 --2- 172.21.15.106:0/2964090321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c13ed60 0x7fd87c15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd873e00640 1 -- 172.21.15.106:0/2964090321 >> v2:172.21.15.112:3300/0 conn(0x7fd87c06eb70 msgr2=0x7fd87c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd873e00640 1 --2- 172.21.15.106:0/2964090321 >> v2:172.21.15.112:3300/0 conn(0x7fd87c06eb70 0x7fd87c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd873e00640 1 -- 172.21.15.106:0/2964090321 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c0b3ff0 con 0x7fd87c13f140 2024-04-26T21:17:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd881200640 1 --2- 172.21.15.106:0/2964090321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c13ed60 0x7fd87c15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd881c00640 1 --2- 172.21.15.106:0/2964090321 >> v2:172.21.15.112:3300/0 conn(0x7fd87c06eb70 0x7fd87c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:53.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd873e00640 1 --2- 172.21.15.106:0/2964090321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13f140 0x7fd87c0b52e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd87c06e5c0 tx=0x7fd86401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b89b8f9af7826a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd87be00640 1 -- 172.21.15.106:0/2964090321 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8640b0070 con 0x7fd87c13f140 2024-04-26T21:17:53.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd87be00640 1 -- 172.21.15.106:0/2964090321 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8640ab600 con 0x7fd87c13f140 2024-04-26T21:17:53.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.626+0000 7fd87be00640 1 -- 172.21.15.106:0/2964090321 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8640ab9d0 con 0x7fd87c13f140 2024-04-26T21:17:53.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 -- 172.21.15.106:0/2964090321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13f140 msgr2=0x7fd87c0b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 --2- 172.21.15.106:0/2964090321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13f140 0x7fd87c0b52e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd87c06e5c0 tx=0x7fd86401c400 comp rx=0 tx=0).stop 2024-04-26T21:17:53.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 -- 172.21.15.106:0/2964090321 shutdown_connections 2024-04-26T21:17:53.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 --2- 172.21.15.106:0/2964090321 >> v2:172.21.15.112:3300/0 conn(0x7fd87c06eb70 0x7fd87c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 --2- 172.21.15.106:0/2964090321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13f140 0x7fd87c0b52e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 --2- 172.21.15.106:0/2964090321 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c13ed60 0x7fd87c15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 -- 172.21.15.106:0/2964090321 >> 172.21.15.106:0/2964090321 conn(0x7fd87c068340 msgr2=0x7fd87c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 -- 172.21.15.106:0/2964090321 shutdown_connections 2024-04-26T21:17:53.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 -- 172.21.15.106:0/2964090321 wait complete. 2024-04-26T21:17:53.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 Processor -- start 2024-04-26T21:17:53.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 -- start start 2024-04-26T21:17:53.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13ed60 0x7fd87c158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd87c15ec10 0x7fd87c15f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c12aa30 0x7fd87c12ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c160580 con 0x7fd87c13ed60 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c160400 con 0x7fd87c15ec10 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd883c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd87c160700 con 0x7fd87c12aa30 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd881200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13ed60 0x7fd87c158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd881200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13ed60 0x7fd87c158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39174/0 (socket says 172.21.15.106:39174) 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd881200640 1 -- 172.21.15.106:0/1557241776 learned_addr learned my addr 172.21.15.106:0/1557241776 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd873e00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd87c15ec10 0x7fd87c15f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd881c00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c12aa30 0x7fd87c12ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd881200640 1 -- 172.21.15.106:0/1557241776 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c12aa30 msgr2=0x7fd87c12ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd881200640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c12aa30 0x7fd87c12ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd881200640 1 -- 172.21.15.106:0/1557241776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd87c15ec10 msgr2=0x7fd87c15f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd881200640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd87c15ec10 0x7fd87c15f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.630+0000 7fd881200640 1 -- 172.21.15.106:0/1557241776 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c12b790 con 0x7fd87c13ed60 2024-04-26T21:17:53.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.634+0000 7fd881200640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13ed60 0x7fd87c158360 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00c7c0 tx=0x7fd86c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.634+0000 7fd879600640 1 -- 172.21.15.106:0/1557241776 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c007a30 con 0x7fd87c13ed60 2024-04-26T21:17:53.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.634+0000 7fd879600640 1 -- 172.21.15.106:0/1557241776 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86c007bd0 con 0x7fd87c13ed60 2024-04-26T21:17:53.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.634+0000 7fd879600640 1 -- 172.21.15.106:0/1557241776 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c0113f0 con 0x7fd87c13ed60 2024-04-26T21:17:53.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.634+0000 7fd883c00640 1 -- 172.21.15.106:0/1557241776 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87c12ba70 con 0x7fd87c13ed60 2024-04-26T21:17:53.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.634+0000 7fd883c00640 1 -- 172.21.15.106:0/1557241776 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87c12c030 con 0x7fd87c13ed60 2024-04-26T21:17:53.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.634+0000 7fd879600640 1 -- 172.21.15.106:0/1557241776 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd86c011590 con 0x7fd87c13ed60 2024-04-26T21:17:53.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd879600640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd858068380 0x7fd85806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd879600640 1 -- 172.21.15.106:0/1557241776 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd86c086c30 con 0x7fd87c13ed60 2024-04-26T21:17:53.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 Processor -- start 2024-04-26T21:17:53.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd858068380 0x7fd85806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 -- start start 2024-04-26T21:17:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd858068380 0x7fd85806a840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd8640ad000 tx=0x7fd8640a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 0x55803f136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f137410 0x55803f0ed610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f0edb50 0x55803f0edf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55803efa1140 con 0x55803f137410 2024-04-26T21:17:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55803ef36e00 con 0x55803f136af0 2024-04-26T21:17:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55803eeefa00 con 0x55803f0edb50 2024-04-26T21:17:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f137410 0x55803f0ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f137410 0x55803f0ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39180/0 (socket says 172.21.15.106:39180) 2024-04-26T21:17:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 -- 172.21.15.106:0/1569070688 learned_addr learned my addr 172.21.15.106:0/1569070688 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd881200640 1 --2- 172.21.15.106:0/1569070688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 0x55803f136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd881c00640 1 --2- 172.21.15.106:0/1569070688 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f0edb50 0x55803f0edf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 -- 172.21.15.106:0/1569070688 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f0edb50 msgr2=0x55803f0edf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 --2- 172.21.15.106:0/1569070688 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f0edb50 0x55803f0edf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 -- 172.21.15.106:0/1569070688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 msgr2=0x55803f136ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 --2- 172.21.15.106:0/1569070688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 0x55803f136ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 -- 172.21.15.106:0/1569070688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803eef40e0 con 0x55803f137410 2024-04-26T21:17:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd873e00640 1 --2- 172.21.15.106:0/1569070688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f137410 0x55803f0ed610 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd86401c440 tx=0x7fd864004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb42465aeb5363b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd871600640 1 -- 172.21.15.106:0/1569070688 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8640b0040 con 0x55803f137410 2024-04-26T21:17:53.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd871600640 1 -- 172.21.15.106:0/1569070688 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8640c5070 con 0x55803f137410 2024-04-26T21:17:53.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd871600640 1 -- 172.21.15.106:0/1569070688 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8640b6840 con 0x55803f137410 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 -- 172.21.15.106:0/1569070688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f137410 msgr2=0x55803f0ed610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1569070688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f137410 0x55803f0ed610 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd86401c440 tx=0x7fd864004740 comp rx=0 tx=0).stop 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 -- 172.21.15.106:0/1569070688 shutdown_connections 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1569070688 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f0edb50 0x55803f0edf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1569070688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f137410 0x55803f0ed610 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1569070688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 0x55803f136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 -- 172.21.15.106:0/1569070688 >> 172.21.15.106:0/1569070688 conn(0x55803f0e56f0 msgr2=0x55803f0e7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 -- 172.21.15.106:0/1569070688 shutdown_connections 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.638+0000 7fd8870e9000 1 -- 172.21.15.106:0/1569070688 wait complete. 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 -- start start 2024-04-26T21:17:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 Processor -- start 2024-04-26T21:17:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f0edb50 0x55803f13de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 0x55803f13e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f0f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55803ef44200 con 0x55803f0edb50 2024-04-26T21:17:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55803eedae80 con 0x55803f136af0 2024-04-26T21:17:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55803ef31ae0 con 0x55803f137410 2024-04-26T21:17:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 10 client.0 _ll_register_callbacks cb 0x55803ef43da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:17:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f0edb50 0x55803f13de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f0edb50 0x55803f13de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39182/0 (socket says 172.21.15.106:39182) 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881200640 1 -- 172.21.15.106:0/1044120487 learned_addr learned my addr 172.21.15.106:0/1044120487 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881c00640 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f0f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd873e00640 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 0x55803f13e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881200640 1 -- 172.21.15.106:0/1044120487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 msgr2=0x55803f0f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881200640 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f0f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881200640 1 -- 172.21.15.106:0/1044120487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 msgr2=0x55803f13e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881200640 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 0x55803f13e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881200640 1 -- 172.21.15.106:0/1044120487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803eed64e0 con 0x55803f0edb50 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd881200640 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f0edb50 0x55803f13de50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd86c056710 tx=0x7fd86c05ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bac5b15b285858 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd86a000640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-26T21:17:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd86a000640 1 -- 172.21.15.106:0/1044120487 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c01e070 con 0x55803f0edb50 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 -- 172.21.15.106:0/1044120487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8640c5070 con 0x55803f0edb50 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd86a000640 1 -- 172.21.15.106:0/1044120487 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd86c056060 con 0x55803f0edb50 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd86a000640 1 -- 172.21.15.106:0/1044120487 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd86c052760 con 0x55803f0edb50 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 10 client.5679 fetch_fsmap learned FSMap version 18 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 -- 172.21.15.106:0/1044120487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55803eebce80 con 0x55803f0edb50 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd86a000640 1 -- 172.21.15.106:0/1044120487 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8640c5070 con 0x55803f0edb50 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd86a000640 1 -- 172.21.15.106:0/1044120487 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fd86c052900 con 0x55803f0edb50 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 10 client.5679 fetch_fsmap finished waiting for FSMap version 18 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 10 client.5679 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 20 client.5679 populate_metadata read hostname 'smithi106' 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] conn(0x55803f0f89f0 0x55803f0f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 4 client.5679 mds_command: new command op to 5469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd8870e9000 1 -- 172.21.15.106:0/1044120487 --> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55803eecfbc0 con 0x55803f0f89f0 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.642+0000 7fd873e00640 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] conn(0x55803f0f89f0 0x55803f0f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd873e00640 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] conn(0x55803f0f89f0 0x55803f0f8dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e780c6d5d1159b6 server_cookie=544de4c1ba94c327 in_seq=0 out_seq=0 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd86a000640 10 client.5679 ms_handle_connect on v2:172.21.15.106:6834/1043820033 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd86a000640 1 -- 172.21.15.106:0/1044120487 <== mds.0 v2:172.21.15.106:6834/1043820033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55803eecfbc0 con 0x55803f0f89f0 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd86a000640 10 client.5679 handle_command_reply: tid=0 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 client.5679 shutdown 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 -- 172.21.15.106:0/1044120487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f0edb50 msgr2=0x55803f13de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f0edb50 0x55803f13de50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd86c056710 tx=0x7fd86c05ae50 comp rx=0 tx=0).stop 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 -- 172.21.15.106:0/1044120487 shutdown_connections 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] conn(0x55803f0f89f0 0x55803f0f8dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f136af0 0x55803f13e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f0f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd86a000640 0 client.5679 ms_handle_reset on v2:172.21.15.106:6834/1043820033 2024-04-26T21:17:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1044120487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f0edb50 0x55803f13de50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 -- 172.21.15.106:0/1044120487 >> 172.21.15.106:0/1044120487 conn(0x55803f0e56f0 msgr2=0x55803f0e7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 -- 172.21.15.106:0/1044120487 shutdown_connections 2024-04-26T21:17:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 1 -- 172.21.15.106:0/1044120487 wait complete. 2024-04-26T21:17:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.646+0000 7fd8870e9000 20 client.5679 trim_cache size 0 max 16384 2024-04-26T21:17:53.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd8870e9000 1 Processor -- start 2024-04-26T21:17:53.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd8870e9000 1 -- start start 2024-04-26T21:17:53.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 0x55803f0eef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f14cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd8870e9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c0cfa30 con 0x55803f136af0 2024-04-26T21:17:53.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd8870e9000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c12da80 con 0x55803f0edb50 2024-04-26T21:17:53.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd8870e9000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd87c0cf3e0 con 0x55803f137410 2024-04-26T21:17:53.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd873e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd873e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39184/0 (socket says 172.21.15.106:39184) 2024-04-26T21:17:53.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.662+0000 7fd873e00640 1 -- 172.21.15.106:0/3175826302 learned_addr learned my addr 172.21.15.106:0/3175826302 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:53.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd881200640 1 --2- 172.21.15.106:0/3175826302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 0x55803f0eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd881c00640 1 --2- 172.21.15.106:0/3175826302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f14cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd873e00640 1 -- 172.21.15.106:0/3175826302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 msgr2=0x55803f14cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd873e00640 1 --2- 172.21.15.106:0/3175826302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f14cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd873e00640 1 -- 172.21.15.106:0/3175826302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 msgr2=0x55803f0eef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd873e00640 1 --2- 172.21.15.106:0/3175826302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 0x55803f0eef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd873e00640 1 -- 172.21.15.106:0/3175826302 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803f137240 con 0x55803f136af0 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd873e00640 1 --2- 172.21.15.106:0/3175826302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef480 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd86401c8e0 tx=0x7fd864009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3144a932610374 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd870c00640 1 -- 172.21.15.106:0/3175826302 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8640d2bc0 con 0x55803f136af0 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd870c00640 1 -- 172.21.15.106:0/3175826302 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8640d7070 con 0x55803f136af0 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd870c00640 1 -- 172.21.15.106:0/3175826302 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8640d22d0 con 0x55803f136af0 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 -- 172.21.15.106:0/3175826302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 msgr2=0x55803f0ef480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 --2- 172.21.15.106:0/3175826302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef480 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd86401c8e0 tx=0x7fd864009240 comp rx=0 tx=0).stop 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 -- 172.21.15.106:0/3175826302 shutdown_connections 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 --2- 172.21.15.106:0/3175826302 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f14cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 --2- 172.21.15.106:0/3175826302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef480 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 --2- 172.21.15.106:0/3175826302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 0x55803f0eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 -- 172.21.15.106:0/3175826302 >> 172.21.15.106:0/3175826302 conn(0x55803f0e56f0 msgr2=0x55803f0e7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 -- 172.21.15.106:0/3175826302 shutdown_connections 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 -- 172.21.15.106:0/3175826302 wait complete. 2024-04-26T21:17:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 -- start start 2024-04-26T21:17:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 Processor -- start 2024-04-26T21:17:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 0x55803f0eef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f139800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55803ef36110 con 0x55803f136af0 2024-04-26T21:17:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55803eecc7b0 con 0x55803f0edb50 2024-04-26T21:17:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55803ef3b430 con 0x55803f137410 2024-04-26T21:17:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd8870e9000 10 client.0 _ll_register_callbacks cb 0x7fd86c056a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:17:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd873e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd873e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39188/0 (socket says 172.21.15.106:39188) 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd873e00640 1 -- 172.21.15.106:0/1769722085 learned_addr learned my addr 172.21.15.106:0/1769722085 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd881200640 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 0x55803f0eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.666+0000 7fd881c00640 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd873e00640 1 -- 172.21.15.106:0/1769722085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 msgr2=0x55803f139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd873e00640 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f139800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd873e00640 1 -- 172.21.15.106:0/1769722085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 msgr2=0x55803f0eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd873e00640 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 0x55803f0eef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd873e00640 1 -- 172.21.15.106:0/1769722085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803eeefc50 con 0x55803f136af0 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd873e00640 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef4c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd8640d4040 tx=0x7fd86401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30677ff67466d5b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 1 -- 172.21.15.106:0/1769722085 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8640b68d0 con 0x55803f136af0 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 1 -- 172.21.15.106:0/1769722085 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fd8640dcc40 con 0x55803f136af0 2024-04-26T21:17:53.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 -- 172.21.15.106:0/1769722085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8640d7070 con 0x55803f136af0 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 1 -- 172.21.15.106:0/1769722085 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd8640dce40 con 0x55803f136af0 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 10 client.5685 fetch_fsmap learned FSMap version 18 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 -- 172.21.15.106:0/1769722085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55803efb9160 con 0x55803f136af0 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 1 -- 172.21.15.106:0/1769722085 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8640d7070 con 0x55803f136af0 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 1 -- 172.21.15.106:0/1769722085 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7fd8640b6a70 con 0x55803f136af0 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 10 client.5685 fetch_fsmap finished waiting for FSMap version 18 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 10 client.5685 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 20 client.5685 populate_metadata read hostname 'smithi106' 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] conn(0x55803f13a1c0 0x55803f13a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 4 client.5685 mds_command: new command op to 5469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 -- 172.21.15.106:0/1769722085 --> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] -- command(tid 0: {"prefix": "status"}) -- 0x55803ef44a10 con 0x55803f13a1c0 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd881200640 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] conn(0x55803f13a1c0 0x55803f13a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd881200640 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] conn(0x55803f13a1c0 0x55803f13a5a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8615988c4f50118c server_cookie=1389feeb43568845 in_seq=0 out_seq=0 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 10 client.5685 ms_handle_connect on v2:172.21.15.106:6834/1043820033 2024-04-26T21:17:53.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 1 -- 172.21.15.106:0/1769722085 <== mds.0 v2:172.21.15.106:6834/1043820033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55803ef44a10 con 0x55803f13a1c0 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 10 client.5685 handle_command_reply: tid=0 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 client.5685 shutdown 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 -- 172.21.15.106:0/1769722085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 msgr2=0x55803f0ef4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef4c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd8640d4040 tx=0x7fd86401ac40 comp rx=0 tx=0).stop 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 -- 172.21.15.106:0/1769722085 shutdown_connections 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.106:6834/1043820033,v1:172.21.15.106:6836/1043820033] conn(0x55803f13a1c0 0x55803f13a5a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55803f137410 0x55803f139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55803f136af0 0x55803f0ef4c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 --2- 172.21.15.106:0/1769722085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55803f0edb50 0x55803f0eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd86a000640 0 client.5685 ms_handle_reset on v2:172.21.15.106:6834/1043820033 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 -- 172.21.15.106:0/1769722085 >> 172.21.15.106:0/1769722085 conn(0x55803f0e56f0 msgr2=0x55803f0f7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 -- 172.21.15.106:0/1769722085 shutdown_connections 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 1 -- 172.21.15.106:0/1769722085 wait complete. 2024-04-26T21:17:53.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd8870e9000 20 client.5685 trim_cache size 0 max 16384 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "f2bfe958-5421-4d89-8d8f-237a3ca1f771", 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 5469, 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 10.343639249000001, 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 18, 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 41, 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 41, 2024-04-26T21:17:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 18.220159552999998 2024-04-26T21:17:53.680 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:17:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 -- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd858068380 msgr2=0x7fd85806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd858068380 0x7fd85806a840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd8640ad000 tx=0x7fd8640a6000 comp rx=0 tx=0).stop 2024-04-26T21:17:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 -- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13ed60 msgr2=0x7fd87c158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13ed60 0x7fd87c158360 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00c7c0 tx=0x7fd86c00cc80 comp rx=0 tx=0).stop 2024-04-26T21:17:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 -- 172.21.15.106:0/1557241776 shutdown_connections 2024-04-26T21:17:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd87c15ec10 0x7fd87c15f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd858068380 0x7fd85806a840 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd87c12aa30 0x7fd87c12ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 --2- 172.21.15.106:0/1557241776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd87c13ed60 0x7fd87c158360 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 -- 172.21.15.106:0/1557241776 >> 172.21.15.106:0/1557241776 conn(0x7fd87c068340 msgr2=0x7fd87c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 -- 172.21.15.106:0/1557241776 shutdown_connections 2024-04-26T21:17:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.670+0000 7fd883c00640 1 -- 172.21.15.106:0/1557241776 wait complete. 2024-04-26T21:17:53.694 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:17:53.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fcea3c00640 1 Processor -- start 2024-04-26T21:17:53.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fcea3c00640 1 -- start start 2024-04-26T21:17:53.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fcea3c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce9c15d060 0x7fce9c0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fcea3c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9c0b2250 con 0x7fce9c0cfb70 2024-04-26T21:17:53.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fcea3c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9c0ce660 con 0x7fce9c0b3a40 2024-04-26T21:17:53.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fcea3c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fce9c0b25a0 con 0x7fce9c15d060 2024-04-26T21:17:53.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9be00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fce9c0cfb70 0x7fce9c0d0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50950/0 (socket says 172.21.15.106:50950) 2024-04-26T21:17:53.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9be00640 1 -- 172.21.15.106:0/4015892692 learned_addr learned my addr 172.21.15.106:0/4015892692 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:53.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fcea1200640 1 --2- 172.21.15.106:0/4015892692 >> v2:172.21.15.112:3300/0 conn(0x7fce9c15d060 0x7fce9c0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209231208 0 0) 0x7fce9c0b2250 con 0x7fce9c0cfb70 2024-04-26T21:17:53.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce80003530 con 0x7fce9c0cfb70 2024-04-26T21:17:53.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3878302110 0 0) 0x7fce80003530 con 0x7fce9c0cfb70 2024-04-26T21:17:53.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 >> v2:172.21.15.112:3300/0 conn(0x7fce9c15d060 msgr2=0x7fce9c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 --2- 172.21.15.106:0/4015892692 >> v2:172.21.15.112:3300/0 conn(0x7fce9c15d060 0x7fce9c0cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 >> v1:172.21.15.112:6789/0 conn(0x7fce9c0b3a40 legacy=0x7fce9c0d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c0ce940 con 0x7fce9c0cfb70 2024-04-26T21:17:53.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7fce8c001680 con 0x7fce9c0cfb70 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 >> v1:172.21.15.106:6789/0 conn(0x7fce9c0cfb70 legacy=0x7fce9c0d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce800039c0 0x7fce80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce80004810 0x7fce80004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce800051d0 0x7fce8000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c0b25a0 con 0x7fce800051d0 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce8000c070 con 0x7fce80004810 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.826+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fce8000c270 con 0x7fce800039c0 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea1c00640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce800051d0 0x7fce8000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fce9be00640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce80004810 0x7fce80004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea1200640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce800039c0 0x7fce80003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea1c00640 1 -- 172.21.15.106:0/4015892692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce800039c0 msgr2=0x7fce80003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea1c00640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce800039c0 0x7fce80003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea1c00640 1 -- 172.21.15.106:0/4015892692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce80004810 msgr2=0x7fce80004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:53.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea1c00640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce80004810 0x7fce80004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea1c00640 1 -- 172.21.15.106:0/4015892692 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce80003530 con 0x7fce800051d0 2024-04-26T21:17:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea1c00640 1 -- 172.21.15.106:0/4015892692 reap_dead start 2024-04-26T21:17:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea1c00640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce800051d0 0x7fce8000b9d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fce94001e70 tx=0x7fce9401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b97cb63e6f5b755 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94001a90 con 0x7fce800051d0 2024-04-26T21:17:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce94003bc0 con 0x7fce800051d0 2024-04-26T21:17:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fce9b400640 1 -- 172.21.15.106:0/4015892692 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94005020 con 0x7fce800051d0 2024-04-26T21:17:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea3c00640 1 -- 172.21.15.106:0/4015892692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce800051d0 msgr2=0x7fce8000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.830+0000 7fcea3c00640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce800051d0 0x7fce8000b9d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fce94001e70 tx=0x7fce9401c780 comp rx=0 tx=0).stop 2024-04-26T21:17:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 -- 172.21.15.106:0/4015892692 shutdown_connections 2024-04-26T21:17:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 --2- 172.21.15.106:0/4015892692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce800051d0 0x7fce8000b9d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 -- 172.21.15.106:0/4015892692 >> 172.21.15.106:0/4015892692 conn(0x7fce9c0d2c60 msgr2=0x7fce9c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 -- 172.21.15.106:0/4015892692 shutdown_connections 2024-04-26T21:17:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 -- 172.21.15.106:0/4015892692 wait complete. 2024-04-26T21:17:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 Processor -- start 2024-04-26T21:17:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 -- start start 2024-04-26T21:17:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce800051d0 0x7fce9c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce9c149880 0x7fce9c06da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce9c0af960 0x7fce9c0afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c0ce280 con 0x7fce9c149880 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c0d3980 con 0x7fce800051d0 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea3c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c0ce400 con 0x7fce9c0af960 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce9be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce9c149880 0x7fce9c06da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce800051d0 0x7fce9c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce9be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce9c149880 0x7fce9c06da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39200/0 (socket says 172.21.15.106:39200) 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea1200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce800051d0 0x7fce9c06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:38078/0 (socket says 172.21.15.106:38078) 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fcea1c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce9c0af960 0x7fce9c0afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce9be00640 1 -- 172.21.15.106:0/2469825412 learned_addr learned my addr 172.21.15.106:0/2469825412 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce9be00640 1 -- 172.21.15.106:0/2469825412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce9c0af960 msgr2=0x7fce9c0afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce9be00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce9c0af960 0x7fce9c0afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce9be00640 1 -- 172.21.15.106:0/2469825412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce800051d0 msgr2=0x7fce9c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce9be00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce800051d0 0x7fce9c06d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce9be00640 1 -- 172.21.15.106:0/2469825412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c15d830 con 0x7fce9c149880 2024-04-26T21:17:53.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce9be00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce9c149880 0x7fce9c06da50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fce8c007290 tx=0x7fce8c007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.834+0000 7fce98c00640 1 -- 172.21.15.106:0/2469825412 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00f9c0 con 0x7fce9c149880 2024-04-26T21:17:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.838+0000 7fce98c00640 1 -- 172.21.15.106:0/2469825412 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c018070 con 0x7fce9c149880 2024-04-26T21:17:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.838+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c15db10 con 0x7fce9c149880 2024-04-26T21:17:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.838+0000 7fce98c00640 1 -- 172.21.15.106:0/2469825412 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00fdc0 con 0x7fce9c149880 2024-04-26T21:17:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.838+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c15e0d0 con 0x7fce9c149880 2024-04-26T21:17:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.838+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c069400 con 0x7fce9c149880 2024-04-26T21:17:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.838+0000 7fce98c00640 1 -- 172.21.15.106:0/2469825412 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce8c01d460 con 0x7fce9c149880 2024-04-26T21:17:53.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.838+0000 7fce98c00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce78068380 0x7fce7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.838+0000 7fce98c00640 1 -- 172.21.15.106:0/2469825412 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fce8c086ab0 con 0x7fce9c149880 2024-04-26T21:17:53.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.838+0000 7fcea1200640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce78068380 0x7fce7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.842+0000 7fcea1200640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce78068380 0x7fce7806a840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fce84009b60 tx=0x7fce84009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:53.842+0000 7fce98c00640 1 -- 172.21.15.106:0/2469825412 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fce8c056ee0 con 0x7fce9c149880 2024-04-26T21:17:54.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fce9c15e2a0 con 0x7fce9c149880 2024-04-26T21:17:54.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fce98c00640 1 -- 172.21.15.106:0/2469825412 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7fce8c0567e0 con 0x7fce9c149880 2024-04-26T21:17:54.044 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce78068380 msgr2=0x7fce7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce78068380 0x7fce7806a840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fce84009b60 tx=0x7fce84009190 comp rx=0 tx=0).stop 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce9c149880 msgr2=0x7fce9c06da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce9c149880 0x7fce9c06da50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fce8c007290 tx=0x7fce8c007690 comp rx=0 tx=0).stop 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 shutdown_connections 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fce78068380 0x7fce7806a840 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fce9c0af960 0x7fce9c0afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce9c149880 0x7fce9c06da50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 --2- 172.21.15.106:0/2469825412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce800051d0 0x7fce9c06d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 >> 172.21.15.106:0/2469825412 conn(0x7fce9c0d2c60 msgr2=0x7fce9c071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 shutdown_connections 2024-04-26T21:17:54.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54.042+0000 7fcea3c00640 1 -- 172.21.15.106:0/2469825412 wait complete. 2024-04-26T21:17:54.066 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:17:54.066 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:17:54.066 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-04-26T21:17:54.066 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T21:17:54.066 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:17:54.067 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:17:54.067 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:17:54.067 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:17:54.067 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:17:54.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:54.067 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-04-26T21:17:54.076 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:17:54.076 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:17:54.076 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:17:54.076 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:17:54.077 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42342sec preferred_lft 42342sec 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 02:42:e8:de:01:3d brd ff:ff:ff:ff:ff:ff 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:17:54.078 INFO:teuthology.orchestra.run.smithi106.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T21:17:54.079 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:17:54.079 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T21:17:54.079 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:17:54.079 INFO:teuthology.orchestra.run.smithi106.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T21:17:54.079 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:17:54.079 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T21:17:54.079 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:17:54.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:54.079 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:17:54.137 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-04-26T21:17:54.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:54.139 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T21:17:54.194 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:17:54.195 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:17:54.195 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-26T21:17:54.195 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:17:54.195 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:17:54.195 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:17:54.195 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-26T21:17:54.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:17:54.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:17:54.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:54.329 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-26T21:17:54.337 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T21:17:54.338 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T21:17:54.338 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:17:54.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:54.338 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2024-04-26T21:17:54.400 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T21:17:54.400 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:17:54.400 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T21:17:54.451 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:17:54.452 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:17:54.452 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:17:54.503 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-26T21:17:54.565 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:17:54.617 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-26T21:17:54.617 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-26T21:17:54.617 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-26T21:17:54.617 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-26T21:17:54.617 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/run/lock 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/fs/nfsd 2024-04-26T21:17:54.618 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/run/rpc_pipefs 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:17:54.619 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:17:54.620 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:17:54.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:54.620 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-26T21:17:54.671 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T21:17:54.671 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T21:17:54.714 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-26T21:17:54.734 DEBUG:teuthology.orchestra.run.smithi106:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/sys 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/proc 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/dev 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/pts 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/run 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/ 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/security 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/shm 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/run/lock 2024-04-26T21:17:54.785 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/cgroup 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/pstore 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/bpf 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/hugepages 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/dev/mqueue 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/debug 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/tracing 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/proc/fs/nfsd 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/fs/fuse/connections 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/sys/kernel/config 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/run/rpc_pipefs 2024-04-26T21:17:54.786 INFO:teuthology.orchestra.run.smithi106.stdout:/run/user/1000 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:17:54.787 INFO:teuthology.orchestra.run.smithi106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:17:54.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:54.788 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-26T21:17:54.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:2024-04-26T21:17:54.802+0000 7fb6413a0580 -1 init, newargv = 0x562d6a00b260 newargc=15 2024-04-26T21:17:54.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:ceph-fuse[38903]: starting ceph client 2024-04-26T21:17:54.814 INFO:teuthology.orchestra.run.smithi106.stdout:44 2024-04-26T21:17:54.815 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:ceph-fuse[38903]: starting fuse 2024-04-26T21:17:54.815 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> import glob 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> import re 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> import os 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> import subprocess 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> def _find_admin_socket(client_name): 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> files = glob.glob(asok_path) 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> # Given a non-glob path, it better be there 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> if "*" not in asok_path: 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> assert(len(files) == 1) 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> return files[0] 2024-04-26T21:17:54.816 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> for f in files: 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> contents = proc_f.read() 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> if mountpoint in contents: 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> return f 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> print(_find_admin_socket("client.0")) 2024-04-26T21:17:54.817 DEBUG:teuthology.orchestra.run.smithi106:> ' 2024-04-26T21:17:54.939 INFO:teuthology.orchestra.run.smithi106.stdout:/var/run/ceph/ceph-client.0.38903.asok 2024-04-26T21:17:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:17:54.950 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38903.asok 2024-04-26T21:17:54.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:54.951 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38903.asok status 2024-04-26T21:17:55.122 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:17:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: "metadata": { 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "entity_id": "0", 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": "smithi106", 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "pid": "38903", 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "root": "/" 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_count": 0, 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_pinned_count": 0, 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 5697, 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "inst": { 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "name": { 2024-04-26T21:17:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "client", 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 5697 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2875665300 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2875665300 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "inst_str": "client.5697 192.168.0.1:0/2875665300", 2024-04-26T21:17:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addr_str": "192.168.0.1:0/2875665300", 2024-04-26T21:17:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "inode_count": 1, 2024-04-26T21:17:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_epoch": 18, 2024-04-26T21:17:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch": 41, 2024-04-26T21:17:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch_barrier": 0, 2024-04-26T21:17:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklisted": false, 2024-04-26T21:17:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs" 2024-04-26T21:17:55.125 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:17:55.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:55.137 DEBUG:teuthology.orchestra.run.smithi106:> stat --file-system '--printf=%T 2024-04-26T21:17:55.137 DEBUG:teuthology.orchestra.run.smithi106:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T21:17:55.146 INFO:teuthology.orchestra.run.smithi106.stdout:fuseblk 2024-04-26T21:17:55.147 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T21:17:55.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:55.147 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:17:55.211 DEBUG:teuthology.orchestra.run.smithi106:> stdin-killer -- python3 -c ' 2024-04-26T21:17:55.211 DEBUG:teuthology.orchestra.run.smithi106:> import os 2024-04-26T21:17:55.211 DEBUG:teuthology.orchestra.run.smithi106:> os.mkdir("/home/ubuntu/cephtest/mnt.0/testdir") 2024-04-26T21:17:55.211 DEBUG:teuthology.orchestra.run.smithi106:> fd = os.open("/home/ubuntu/cephtest/mnt.0/testdir", os.O_RDONLY) 2024-04-26T21:17:55.211 DEBUG:teuthology.orchestra.run.smithi106:> os.fchmod(fd, 0o777) 2024-04-26T21:17:55.211 DEBUG:teuthology.orchestra.run.smithi106:> os.fsync(fd) 2024-04-26T21:17:55.211 DEBUG:teuthology.orchestra.run.smithi106:> ' 2024-04-26T21:17:55.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:17:55.338 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:17:55.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb01e000640 1 Processor -- start 2024-04-26T21:17:55.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb01e000640 1 -- start start 2024-04-26T21:17:55.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb01e000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb0180d37f0 0x7fb0180cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb01e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0180cdc50 0x7fb0180ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb01e000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0180d1d70 con 0x7fb01815f3d0 2024-04-26T21:17:55.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb01e000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb0180d2050 con 0x7fb0180d37f0 2024-04-26T21:17:55.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb01e000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb0180cd450 con 0x7fb0180cdc50 2024-04-26T21:17:55.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb016a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb0180d37f0 0x7fb0180cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb017e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0180cdc50 0x7fb0180ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb017e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0180cdc50 0x7fb0180ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:44020/0 (socket says 172.21.15.106:44020) 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb017400640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb01815f3d0 0x7fb0180cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:51238/0 (socket says 172.21.15.106:51238) 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb017400640 1 -- 172.21.15.106:0/2962979851 learned_addr learned my addr 172.21.15.106:0/2962979851 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb016a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb0180d37f0 0x7fb0180cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:38086/0 (socket says 172.21.15.106:38086) 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb016a00640 1 -- 172.21.15.106:0/2962979851 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0180cdc50 msgr2=0x7fb0180ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb016a00640 1 --2- 172.21.15.106:0/2962979851 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0180cdc50 0x7fb0180ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb016a00640 1 -- 172.21.15.106:0/2962979851 >> v1:172.21.15.112:6789/0 conn(0x7fb01815f3d0 legacy=0x7fb0180cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb016a00640 1 -- 172.21.15.106:0/2962979851 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0180cd730 con 0x7fb0180d37f0 2024-04-26T21:17:55.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.514+0000 7fb016000640 1 -- 172.21.15.106:0/2962979851 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528958845 0 0) 0x7fb0180d1d70 con 0x7fb01815f3d0 2024-04-26T21:17:55.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb016a00640 1 --2- 172.21.15.106:0/2962979851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 0x7fb0180cfbf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb0040097c0 tx=0x7fb00401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50e4c1647118732 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:55.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb016000640 1 -- 172.21.15.106:0/2962979851 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0040b0070 con 0x7fb0180d37f0 2024-04-26T21:17:55.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb016000640 1 -- 172.21.15.106:0/2962979851 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0040ab600 con 0x7fb0180d37f0 2024-04-26T21:17:55.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb016000640 1 -- 172.21.15.106:0/2962979851 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0040ab9d0 con 0x7fb0180d37f0 2024-04-26T21:17:55.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb01e000640 1 -- 172.21.15.106:0/2962979851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 msgr2=0x7fb0180cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb01e000640 1 --2- 172.21.15.106:0/2962979851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 0x7fb0180cfbf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb0040097c0 tx=0x7fb00401c4a0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb01e000640 1 -- 172.21.15.106:0/2962979851 shutdown_connections 2024-04-26T21:17:55.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb01e000640 1 --2- 172.21.15.106:0/2962979851 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb0180cdc50 0x7fb0180ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb01e000640 1 --2- 172.21.15.106:0/2962979851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 0x7fb0180cfbf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb01e000640 1 -- 172.21.15.106:0/2962979851 >> 172.21.15.106:0/2962979851 conn(0x7fb0180d2c60 msgr2=0x7fb0180d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:55.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb01e000640 1 -- 172.21.15.106:0/2962979851 shutdown_connections 2024-04-26T21:17:55.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.518+0000 7fb01e000640 1 -- 172.21.15.106:0/2962979851 wait complete. 2024-04-26T21:17:55.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 Processor -- start 2024-04-26T21:17:55.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 -- start start 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0180cdc50 0x7fb0180cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 0x7fb018156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb01815f3d0 0x7fb0180c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb01816c010 con 0x7fb0180cdc50 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb0180d0340 con 0x7fb0180d37f0 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb01816c190 con 0x7fb01815f3d0 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0180cdc50 0x7fb0180cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0180cdc50 0x7fb0180cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39206/0 (socket says 172.21.15.106:39206) 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017400640 1 -- 172.21.15.106:0/4004522650 learned_addr learned my addr 172.21.15.106:0/4004522650 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb016a00640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 0x7fb018156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017e00640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb01815f3d0 0x7fb0180c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017400640 1 -- 172.21.15.106:0/4004522650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb01815f3d0 msgr2=0x7fb0180c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017400640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb01815f3d0 0x7fb0180c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017400640 1 -- 172.21.15.106:0/4004522650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 msgr2=0x7fb018156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017400640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 0x7fb018156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017400640 1 -- 172.21.15.106:0/4004522650 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0180cbbf0 con 0x7fb0180cdc50 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb016a00640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 0x7fb018156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb017400640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0180cdc50 0x7fb0180cb6b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c410 tx=0x7fb00800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb00f400640 1 -- 172.21.15.106:0/4004522650 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0080074e0 con 0x7fb0180cdc50 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb00f400640 1 -- 172.21.15.106:0/4004522650 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0080047f0 con 0x7fb0180cdc50 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0180ca610 con 0x7fb0180cdc50 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb00f400640 1 -- 172.21.15.106:0/4004522650 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008007680 con 0x7fb0180cdc50 2024-04-26T21:17:55.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0180cabd0 con 0x7fb0180cdc50 2024-04-26T21:17:55.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.522+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb018069400 con 0x7fb0180cdc50 2024-04-26T21:17:55.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.526+0000 7fb00f400640 1 -- 172.21.15.106:0/4004522650 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb008011070 con 0x7fb0180cdc50 2024-04-26T21:17:55.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.526+0000 7fb00f400640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faff8068380 0x7faff806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.526+0000 7fb00f400640 1 -- 172.21.15.106:0/4004522650 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fb008086670 con 0x7fb0180cdc50 2024-04-26T21:17:55.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.526+0000 7fb016a00640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faff8068380 0x7faff806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.526+0000 7fb016a00640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faff8068380 0x7faff806a840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0040ad000 tx=0x7fb004008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:55.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.530+0000 7fb00f400640 1 -- 172.21.15.106:0/4004522650 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb0080563b0 con 0x7fb0180cdc50 2024-04-26T21:17:55.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb01806f400 con 0x7fb0180cdc50 2024-04-26T21:17:55.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb00f400640 1 -- 172.21.15.106:0/4004522650 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7fb00805a6b0 con 0x7fb0180cdc50 2024-04-26T21:17:55.725 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:17:45.722737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5469":{"gid":5469,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1043820033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1043820033},{"type":"v1","addr":"172.21.15.106:6836","nonce":1043820033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5469,"qdb_cluster":[5469]},"id":2}]} 2024-04-26T21:17:55.725 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 18 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faff8068380 msgr2=0x7faff806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faff8068380 0x7faff806a840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0040ad000 tx=0x7fb004008040 comp rx=0 tx=0).stop 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0180cdc50 msgr2=0x7fb0180cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0180cdc50 0x7fb0180cb6b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c410 tx=0x7fb00800c8d0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 shutdown_connections 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0180d37f0 0x7fb018156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7faff8068380 0x7faff806a840 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb01815f3d0 0x7fb0180c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 --2- 172.21.15.106:0/4004522650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0180cdc50 0x7fb0180cb6b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 >> 172.21.15.106:0/4004522650 conn(0x7fb0180d2c60 msgr2=0x7fb018074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:55.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 shutdown_connections 2024-04-26T21:17:55.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:55.722+0000 7fb01e000640 1 -- 172.21.15.106:0/4004522650 wait complete. 2024-04-26T21:17:55.745 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-26T21:17:55.913 INFO:teuthology.orchestra.run.smithi106.stdout:{"message":"","return_code":0} 2024-04-26T21:17:55.913 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T21:17:55.913 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:17:56.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3323a00640 1 Processor -- start 2024-04-26T21:17:56.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3323a00640 1 -- start start 2024-04-26T21:17:56.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3323a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c146490 0x7f331c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:56.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3323a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f331c146870 0x7f331c0d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:56.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3323a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c0b3da0 con 0x7f331c160ac0 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3323a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f331c160fa0 con 0x7f331c146870 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3323a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f331c161280 con 0x7f331c146490 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3321000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c146490 0x7f331c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:56.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3321a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f331c146870 0x7f331c0d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:56.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3321000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c146490 0x7f331c15df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:44038/0 (socket says 172.21.15.106:44038) 2024-04-26T21:17:56.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3321000640 1 -- 172.21.15.106:0/4267500624 learned_addr learned my addr 172.21.15.106:0/4267500624 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:56.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3321000640 1 -- 172.21.15.106:0/4267500624 >> v2:172.21.15.112:3300/0 conn(0x7f331c146870 msgr2=0x7f331c0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:17:56.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3321000640 1 --2- 172.21.15.106:0/4267500624 >> v2:172.21.15.112:3300/0 conn(0x7f331c146870 0x7f331c0d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3321000640 1 -- 172.21.15.106:0/4267500624 >> v1:172.21.15.112:6789/0 conn(0x7f331c160ac0 legacy=0x7f331c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:56.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.046+0000 7f3321000640 1 -- 172.21.15.106:0/4267500624 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c161560 con 0x7f331c146490 2024-04-26T21:17:56.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f3321000640 1 --2- 172.21.15.106:0/4267500624 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c146490 0x7f331c15df50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f330c009870 tx=0x7f330c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e64a49b49559577 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:56.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f331be00640 1 -- 172.21.15.106:0/4267500624 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0b2070 con 0x7f331c146490 2024-04-26T21:17:56.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f331be00640 1 -- 172.21.15.106:0/4267500624 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c0a9070 con 0x7f331c146490 2024-04-26T21:17:56.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f331be00640 1 -- 172.21.15.106:0/4267500624 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0ad880 con 0x7f331c146490 2024-04-26T21:17:56.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f3323a00640 1 -- 172.21.15.106:0/4267500624 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c146490 msgr2=0x7f331c15df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:56.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f3323a00640 1 --2- 172.21.15.106:0/4267500624 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c146490 0x7f331c15df50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f330c009870 tx=0x7f330c01c560 comp rx=0 tx=0).stop 2024-04-26T21:17:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f3323a00640 1 -- 172.21.15.106:0/4267500624 shutdown_connections 2024-04-26T21:17:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f3323a00640 1 --2- 172.21.15.106:0/4267500624 >> v2:172.21.15.112:3300/0 conn(0x7f331c146870 0x7f331c0d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f3323a00640 1 --2- 172.21.15.106:0/4267500624 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c146490 0x7f331c15df50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f3323a00640 1 -- 172.21.15.106:0/4267500624 >> 172.21.15.106:0/4267500624 conn(0x7f331c068340 msgr2=0x7f331c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f3323a00640 1 -- 172.21.15.106:0/4267500624 shutdown_connections 2024-04-26T21:17:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.050+0000 7f3323a00640 1 -- 172.21.15.106:0/4267500624 wait complete. 2024-04-26T21:17:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 Processor -- start 2024-04-26T21:17:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 -- start start 2024-04-26T21:17:56.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f331c146490 0x7f331c15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:56.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331c146870 0x7f331c13d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:56.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c160ac0 0x7f331c0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:56.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f331c0b5190 con 0x7f331c146490 2024-04-26T21:17:56.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f331c0b5010 con 0x7f331c146870 2024-04-26T21:17:56.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f331c169e60 con 0x7f331c160ac0 2024-04-26T21:17:56.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f331c146490 0x7f331c15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:56.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f331c146490 0x7f331c15c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39218/0 (socket says 172.21.15.106:39218) 2024-04-26T21:17:56.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321000640 1 -- 172.21.15.106:0/4235094049 learned_addr learned my addr 172.21.15.106:0/4235094049 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:17:56.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321a00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c160ac0 0x7f331c0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:56.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3313e00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331c146870 0x7f331c13d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321000640 1 -- 172.21.15.106:0/4235094049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c160ac0 msgr2=0x7f331c0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321000640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c160ac0 0x7f331c0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321000640 1 -- 172.21.15.106:0/4235094049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331c146870 msgr2=0x7f331c13d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321000640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331c146870 0x7f331c13d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321000640 1 -- 172.21.15.106:0/4235094049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c1fbe20 con 0x7f331c146490 2024-04-26T21:17:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3321000640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f331c146490 0x7f331c15c410 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f330c0b0040 tx=0x7f330c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3319600640 1 -- 172.21.15.106:0/4235094049 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0bc020 con 0x7f331c146490 2024-04-26T21:17:56.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3319600640 1 -- 172.21.15.106:0/4235094049 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c0addc0 con 0x7f331c146490 2024-04-26T21:17:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3319600640 1 -- 172.21.15.106:0/4235094049 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0b2040 con 0x7f331c146490 2024-04-26T21:17:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331c1fc0c0 con 0x7f331c146490 2024-04-26T21:17:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.054+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331c1fc680 con 0x7f331c146490 2024-04-26T21:17:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.058+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331c069400 con 0x7f331c146490 2024-04-26T21:17:56.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.058+0000 7f3319600640 1 -- 172.21.15.106:0/4235094049 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f330c0bf020 con 0x7f331c146490 2024-04-26T21:17:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.058+0000 7f3319600640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f32f80683b0 0x7f32f806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.058+0000 7f3319600640 1 -- 172.21.15.106:0/4235094049 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f330c120b10 con 0x7f331c146490 2024-04-26T21:17:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.058+0000 7f3313e00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f32f80683b0 0x7f32f806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:56.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.058+0000 7f3313e00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f32f80683b0 0x7f32f806a870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f331c1416c0 tx=0x7f3304009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.062+0000 7f3319600640 1 -- 172.21.15.106:0/4235094049 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f330c0c6030 con 0x7f331c146490 2024-04-26T21:17:56.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f331c145c50 con 0x7f331c146490 2024-04-26T21:17:56.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3319600640 1 -- 172.21.15.106:0/4235094049 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7f330c016150 con 0x7f331c146490 2024-04-26T21:17:56.253 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:17:56.253 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:17:45.722737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5469":{"gid":5469,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1043820033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1043820033},{"type":"v1","addr":"172.21.15.106:6836","nonce":1043820033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5469,"qdb_cluster":[5469]},"id":2}]} 2024-04-26T21:17:56.254 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 18 2024-04-26T21:17:56.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f32f80683b0 msgr2=0x7f32f806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:56.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f32f80683b0 0x7f32f806a870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f331c1416c0 tx=0x7f3304009040 comp rx=0 tx=0).stop 2024-04-26T21:17:56.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f331c146490 msgr2=0x7f331c15c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f331c146490 0x7f331c15c410 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f330c0b0040 tx=0x7f330c01ada0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 shutdown_connections 2024-04-26T21:17:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f331c146870 0x7f331c13d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f32f80683b0 0x7f32f806a870 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f331c160ac0 0x7f331c0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 --2- 172.21.15.106:0/4235094049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f331c146490 0x7f331c15c410 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 >> 172.21.15.106:0/4235094049 conn(0x7f331c068340 msgr2=0x7f331c068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 shutdown_connections 2024-04-26T21:17:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56.250+0000 7f3323a00640 1 -- 172.21.15.106:0/4235094049 wait complete. 2024-04-26T21:17:56.276 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_log_pause 1 2024-04-26T21:17:56.432 INFO:teuthology.orchestra.run.smithi106.stdout:{"success":"mds_log_pause = '' "} 2024-04-26T21:17:56.433 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_log_pause = '' " } 2024-04-26T21:17:56.433 DEBUG:teuthology.orchestra.run.smithi106:> sudo stdin-killer -- python3 -c ' 2024-04-26T21:17:56.433 DEBUG:teuthology.orchestra.run.smithi106:> import os 2024-04-26T21:17:56.433 DEBUG:teuthology.orchestra.run.smithi106:> os.chdir("/home/ubuntu/cephtest/mnt.0/testdir") 2024-04-26T21:17:56.433 DEBUG:teuthology.orchestra.run.smithi106:> os.setgid(65534) 2024-04-26T21:17:56.433 DEBUG:teuthology.orchestra.run.smithi106:> os.setuid(65534) 2024-04-26T21:17:56.433 DEBUG:teuthology.orchestra.run.smithi106:> fd = os.open("testfile", os.O_CREAT | os.O_RDWR, 0o644) 2024-04-26T21:17:56.434 DEBUG:teuthology.orchestra.run.smithi106:> os.fchmod(fd, 0o640) 2024-04-26T21:17:56.434 DEBUG:teuthology.orchestra.run.smithi106:> ' 2024-04-26T21:17:56.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:17:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:17:56.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:17:56.519 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod 600 /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2024-04-26T21:18:06.567 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 2:0 2024-04-26T21:18:06.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdd1600640 1 Processor -- start 2024-04-26T21:18:06.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdd1600640 1 -- start start 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdd1600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcdcc160680 0x7fcdcc0d3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdd1600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcdcc0b3dc0 0x7fcdcc0cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdd1600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc0cfc10 0x7fcdcc0d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdd1600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fcdcc0d1c50 con 0x7fcdcc160680 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdd1600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcdcc0d00a0 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdd1600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc0d0330 con 0x7fcdcc0cfc10 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdcaa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcdcc160680 0x7fcdcc0d3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdcaa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcdcc160680 0x7fcdcc0d3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41492/0 (socket says 172.21.15.106:41492) 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdcaa00640 1 -- 172.21.15.106:0/1749056368 learned_addr learned my addr 172.21.15.106:0/1749056368 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdcaa00640 1 -- 172.21.15.106:0/1749056368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc0cfc10 msgr2=0x7fcdcc0d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdcaa00640 1 --2- 172.21.15.106:0/1749056368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc0cfc10 0x7fcdcc0d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdcaa00640 1 -- 172.21.15.106:0/1749056368 >> v2:172.21.15.112:3300/0 conn(0x7fcdcc0b3dc0 msgr2=0x7fcdcc0cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdcaa00640 1 --2- 172.21.15.106:0/1749056368 >> v2:172.21.15.112:3300/0 conn(0x7fcdcc0b3dc0 0x7fcdcc0cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.710+0000 7fcdcaa00640 1 -- 172.21.15.106:0/1749056368 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc0d05d0 con 0x7fcdcc160680 2024-04-26T21:18:06.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdcaa00640 1 --2- 172.21.15.106:0/1749056368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc160680 0x7fcdcc0d3890 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009870 tx=0x7fcdbc01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744f248e1e96fa98 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:06.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdc9600640 1 -- 172.21.15.106:0/1749056368 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0b0070 con 0x7fcdcc160680 2024-04-26T21:18:06.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdc9600640 1 -- 172.21.15.106:0/1749056368 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc0ab600 con 0x7fcdcc160680 2024-04-26T21:18:06.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdc9600640 1 -- 172.21.15.106:0/1749056368 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0ab9d0 con 0x7fcdcc160680 2024-04-26T21:18:06.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdd1600640 1 -- 172.21.15.106:0/1749056368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc160680 msgr2=0x7fcdcc0d3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:06.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1749056368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc160680 0x7fcdcc0d3890 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009870 tx=0x7fcdbc01c230 comp rx=0 tx=0).stop 2024-04-26T21:18:06.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdd1600640 1 -- 172.21.15.106:0/1749056368 shutdown_connections 2024-04-26T21:18:06.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1749056368 >> v2:172.21.15.112:3300/0 conn(0x7fcdcc0b3dc0 0x7fcdcc0cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1749056368 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc0cfc10 0x7fcdcc0d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1749056368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc160680 0x7fcdcc0d3890 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdd1600640 1 -- 172.21.15.106:0/1749056368 >> 172.21.15.106:0/1749056368 conn(0x7fcdcc0d2d70 msgr2=0x7fcdcc0d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdd1600640 1 -- 172.21.15.106:0/1749056368 shutdown_connections 2024-04-26T21:18:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.714+0000 7fcdd1600640 1 -- 172.21.15.106:0/1749056368 wait complete. 2024-04-26T21:18:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 Processor -- start 2024-04-26T21:18:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 -- start start 2024-04-26T21:18:06.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc0b3dc0 0x7fcdcc14b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc0cfc10 0x7fcdcc165200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc160680 0x7fcdcc154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc160be0 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc160a60 con 0x7fcdcc0cfc10 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc0c68c0 con 0x7fcdcc160680 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcaa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc0b3dc0 0x7fcdcc14b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcaa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc0b3dc0 0x7fcdcc14b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41494/0 (socket says 172.21.15.106:41494) 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcaa00640 1 -- 172.21.15.106:0/1410994295 learned_addr learned my addr 172.21.15.106:0/1410994295 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdca000640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc0cfc10 0x7fcdcc165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcb400640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc160680 0x7fcdcc154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcaa00640 1 -- 172.21.15.106:0/1410994295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc160680 msgr2=0x7fcdcc154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcaa00640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc160680 0x7fcdcc154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcaa00640 1 -- 172.21.15.106:0/1410994295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc0cfc10 msgr2=0x7fcdcc165200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcaa00640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc0cfc10 0x7fcdcc165200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcaa00640 1 -- 172.21.15.106:0/1410994295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc0cca40 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdcaa00640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc0b3dc0 0x7fcdcc14b4a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0ae040 tx=0x7fcdbc01aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdc2a00640 1 -- 172.21.15.106:0/1410994295 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0ba020 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdc2a00640 1 -- 172.21.15.106:0/1410994295 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc0b6620 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdc2a00640 1 -- 172.21.15.106:0/1410994295 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0b0040 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc0ccd20 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.718+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc0cd000 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.722+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdcc069400 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.722+0000 7fcdc2a00640 1 -- 172.21.15.106:0/1410994295 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcdbc0bd020 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.722+0000 7fcdc2a00640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcdac0683b0 0x7fcdac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:06.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.722+0000 7fcdc2a00640 1 -- 172.21.15.106:0/1410994295 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fcdbc120e40 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.722+0000 7fcdca000640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcdac0683b0 0x7fcdac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:06.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.722+0000 7fcdca000640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcdac0683b0 0x7fcdac06a870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8006fd0 tx=0x7fcdb8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:06.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.726+0000 7fcdc2a00640 1 -- 172.21.15.106:0/1410994295 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcdbc0c4030 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.938+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "2:0"} v 0) -- 0x7fcdcc0c7c80 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.944 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T21:18:06.942+0000 7fc9b4000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:18:06.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.942+0000 7fcdc2a00640 1 -- 172.21.15.106:0/1410994295 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "2:0"}]=0 failed mds gid 5469 v19) ==== 97+0+0 (secure 0 0 0) 0x7fcdbc016110 con 0x7fcdcc0b3dc0 2024-04-26T21:18:06.946 INFO:teuthology.orchestra.run.smithi106.stderr:failed mds gid 5469 2024-04-26T21:18:06.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcdac0683b0 msgr2=0x7fcdac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:06.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcdac0683b0 0x7fcdac06a870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8006fd0 tx=0x7fcdb8008040 comp rx=0 tx=0).stop 2024-04-26T21:18:06.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc0b3dc0 msgr2=0x7fcdcc14b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:06.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc0b3dc0 0x7fcdcc14b4a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0ae040 tx=0x7fcdbc01aa70 comp rx=0 tx=0).stop 2024-04-26T21:18:06.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 shutdown_connections 2024-04-26T21:18:06.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc0cfc10 0x7fcdcc165200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcdac0683b0 0x7fcdac06a870 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcdcc160680 0x7fcdcc154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 --2- 172.21.15.106:0/1410994295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdcc0b3dc0 0x7fcdcc14b4a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:06.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 >> 172.21.15.106:0/1410994295 conn(0x7fcdcc0d2d70 msgr2=0x7fcdcc15a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:06.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 shutdown_connections 2024-04-26T21:18:06.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:06.946+0000 7fcdd1600640 1 -- 172.21.15.106:0/1410994295 wait complete. 2024-04-26T21:18:06.959 INFO:tasks.ceph.mds.c.smithi106.stderr: -2123> 2024-04-26T21:17:46.286+0000 7fa76b600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:18:06.982 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:18:07.014 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2024-04-26T21:18:07.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.114+0000 7f401c000640 1 Processor -- start 2024-04-26T21:18:07.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.114+0000 7f401c000640 1 -- start start 2024-04-26T21:18:07.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f401c000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40140d01c0 0x7f40140b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:07.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f401c000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40140d1840 con 0x7f40140cfd40 2024-04-26T21:18:07.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f401c000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40140b2250 con 0x7f401415d060 2024-04-26T21:18:07.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f401c000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f40140b25a0 con 0x7f40140d01c0 2024-04-26T21:18:07.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4018c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f40140cfd40 0x7f40140b2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53692/0 (socket says 172.21.15.106:53692) 2024-04-26T21:18:07.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4018c00640 1 -- 172.21.15.106:0/1778526793 learned_addr learned my addr 172.21.15.106:0/1778526793 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:07.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80893338 0 0) 0x7f4000001120 con 0x7f40140cfd40 2024-04-26T21:18:07.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ffc003530 con 0x7f40140cfd40 2024-04-26T21:18:07.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f401a000640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40140d01c0 0x7f40140b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:07.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4084406909 0 0) 0x7f3ffc003530 con 0x7f40140cfd40 2024-04-26T21:18:07.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40140d01c0 msgr2=0x7f40140b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:07.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40140d01c0 0x7f40140b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 >> v1:172.21.15.112:6789/0 conn(0x7f401415d060 legacy=0x7f40140cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:07.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40140ce660 con 0x7f40140cfd40 2024-04-26T21:18:07.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f4000001850 con 0x7f40140cfd40 2024-04-26T21:18:07.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 >> v1:172.21.15.106:6789/0 conn(0x7f40140cfd40 legacy=0x7f40140b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:07.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ffc0039f0 0x7f3ffc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ffc004810 0x7f3ffc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40140d01c0 0x7f3ffc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f40140b25a0 con 0x7f3ffc004810 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc00ba80 con 0x7f3ffc0039f0 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3ffc00bc80 con 0x7f40140d01c0 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4018c00640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ffc004810 0x7f3ffc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4019600640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ffc0039f0 0x7f3ffc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f401a000640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40140d01c0 0x7f3ffc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4018c00640 1 -- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40140d01c0 msgr2=0x7f3ffc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4018c00640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40140d01c0 0x7f3ffc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4018c00640 1 -- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ffc0039f0 msgr2=0x7f3ffc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4018c00640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ffc0039f0 0x7f3ffc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.118+0000 7f4018c00640 1 -- 172.21.15.106:0/1778526793 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc003530 con 0x7f3ffc004810 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f4018c00640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ffc004810 0x7f3ffc004c90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f400000c490 tx=0x7f400001f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ca0228eb805553 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400000c0e0 con 0x7f3ffc004810 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4000005b00 con 0x7f3ffc004810 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f4013e00640 1 -- 172.21.15.106:0/1778526793 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000007070 con 0x7f3ffc004810 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f401c000640 1 -- 172.21.15.106:0/1778526793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ffc004810 msgr2=0x7f3ffc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f401c000640 1 --2- 172.21.15.106:0/1778526793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ffc004810 0x7f3ffc004c90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f400000c490 tx=0x7f400001f3c0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f401a000640 1 -- 172.21.15.106:0/1778526793 reap_dead start 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f401c000640 1 -- 172.21.15.106:0/1778526793 shutdown_connections 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f401c000640 1 -- 172.21.15.106:0/1778526793 >> 172.21.15.106:0/1778526793 conn(0x7f40140d2c60 msgr2=0x7f40140d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f401c000640 1 -- 172.21.15.106:0/1778526793 shutdown_connections 2024-04-26T21:18:07.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f401c000640 1 -- 172.21.15.106:0/1778526793 wait complete. 2024-04-26T21:18:07.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f401c000640 1 Processor -- start 2024-04-26T21:18:07.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.122+0000 7f401c000640 1 -- start start 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401c000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ffc004810 0x7f4014152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401c000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4014152cf0 0x7f4014154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401c000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4014153170 0x7f40141553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401c000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f40140d3980 con 0x7f4014152cf0 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401c000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f401415d440 con 0x7f4014153170 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401c000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f40140ce280 con 0x7f3ffc004810 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4018c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4014152cf0 0x7f4014154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4018c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4014152cf0 0x7f4014154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55962/0 (socket says 172.21.15.106:55962) 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4018c00640 1 -- 172.21.15.106:0/2460169349 learned_addr learned my addr 172.21.15.106:0/2460169349 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401a000640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4014153170 0x7f40141553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4019600640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ffc004810 0x7f4014152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4018c00640 1 -- 172.21.15.106:0/2460169349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ffc004810 msgr2=0x7f4014152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4018c00640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ffc004810 0x7f4014152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4018c00640 1 -- 172.21.15.106:0/2460169349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4014153170 msgr2=0x7f40141553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4018c00640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4014153170 0x7f40141553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4018c00640 1 -- 172.21.15.106:0/2460169349 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40141547e0 con 0x7f4014152cf0 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4018c00640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4014152cf0 0x7f4014154e90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f400000c490 tx=0x7f3ffc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4011600640 1 -- 172.21.15.106:0/2460169349 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000005cb0 con 0x7f4014152cf0 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4011600640 1 -- 172.21.15.106:0/2460169349 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4000005e50 con 0x7f4014152cf0 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4014152690 con 0x7f4014152cf0 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4011600640 1 -- 172.21.15.106:0/2460169349 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40000049f0 con 0x7f4014152cf0 2024-04-26T21:18:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4014153a20 con 0x7f4014152cf0 2024-04-26T21:18:07.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4014069400 con 0x7f4014152cf0 2024-04-26T21:18:07.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.126+0000 7f4011600640 1 -- 172.21.15.106:0/2460169349 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4000004b90 con 0x7f4014152cf0 2024-04-26T21:18:07.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.130+0000 7f4011600640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ff4068380 0x7f3ff406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:07.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.130+0000 7f4011600640 1 -- 172.21.15.106:0/2460169349 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f4000123e50 con 0x7f4014152cf0 2024-04-26T21:18:07.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.130+0000 7f4019600640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ff4068380 0x7f3ff406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:07.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.130+0000 7f4019600640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ff4068380 0x7f3ff406a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4008000c10 tx=0x7f4008009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:07.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.134+0000 7f4011600640 1 -- 172.21.15.106:0/2460169349 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f40000c1060 con 0x7f4014152cf0 2024-04-26T21:18:07.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f401406cce0 con 0x7f4014152cf0 2024-04-26T21:18:07.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f4011600640 1 -- 172.21.15.106:0/2460169349 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+4350 (secure 0 0 0) 0x7f40141547e0 con 0x7f4014152cf0 2024-04-26T21:18:07.326 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:07.326 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:18:06.951393+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-26T21:18:07.326 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 20 2024-04-26T21:18:07.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ff4068380 msgr2=0x7f3ff406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ff4068380 0x7f3ff406a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4008000c10 tx=0x7f4008009040 comp rx=0 tx=0).stop 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4014152cf0 msgr2=0x7f4014154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4014152cf0 0x7f4014154e90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f400000c490 tx=0x7f3ffc005840 comp rx=0 tx=0).stop 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 shutdown_connections 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4014153170 0x7f40141553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3ff4068380 0x7f3ff406a840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4014152cf0 0x7f4014154e90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 --2- 172.21.15.106:0/2460169349 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ffc004810 0x7f4014152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 >> 172.21.15.106:0/2460169349 conn(0x7f40140d2c60 msgr2=0x7f40140b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.322+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 shutdown_connections 2024-04-26T21:18:07.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:07.326+0000 7f401c000640 1 -- 172.21.15.106:0/2460169349 wait complete. 2024-04-26T21:18:07.751 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:17:42.703325+0000', 'modified': '2024-04-26T21:18:06.951393+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 44, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5413}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5413': {'gid': 5413, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.106:6837/967590660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6835', 'nonce': 967590660}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 967590660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T21:18:07.751 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5413:up:replay 2024-04-26T21:18:08.752 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:18:08.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5daa200640 1 Processor -- start 2024-04-26T21:18:08.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5daa200640 1 -- start start 2024-04-26T21:18:08.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5daa200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 0x7f5da415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:08.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5daa200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5da406eb70 0x7f5da40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:08.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5daa200640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da40b3d10 con 0x7f5da413f140 2024-04-26T21:18:08.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5daa200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5da40b3ac0 con 0x7f5da406eb70 2024-04-26T21:18:08.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5daa200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5da40b4920 con 0x7f5da413ed60 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5da3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5da406eb70 0x7f5da40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5da3400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 0x7f5da415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5da3e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5da406eb70 0x7f5da40d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.106:35892/0 (socket says 172.21.15.106:35892) 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.894+0000 7f5da3e00640 1 -- 172.21.15.106:0/1515031202 learned_addr learned my addr 172.21.15.106:0/1515031202 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da3e00640 1 -- 172.21.15.106:0/1515031202 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 msgr2=0x7f5da415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da3e00640 1 --2- 172.21.15.106:0/1515031202 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 0x7f5da415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da3e00640 1 -- 172.21.15.106:0/1515031202 >> v1:172.21.15.112:6789/0 conn(0x7f5da413f140 legacy=0x7f5da40b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da3e00640 1 -- 172.21.15.106:0/1515031202 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da40b3ff0 con 0x7f5da406eb70 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da2000640 1 -- 172.21.15.106:0/1515031202 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400583399 0 0) 0x7f5da40b3d10 con 0x7f5da413f140 2024-04-26T21:18:08.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da3400640 1 --2- 172.21.15.106:0/1515031202 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 0x7f5da415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:08.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da3e00640 1 --2- 172.21.15.106:0/1515031202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da406eb70 0x7f5da40d0df0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009870 tx=0x7f5d9c01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d043167e87ecf11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:08.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da2000640 1 -- 172.21.15.106:0/1515031202 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0b0070 con 0x7f5da406eb70 2024-04-26T21:18:08.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da2000640 1 -- 172.21.15.106:0/1515031202 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c004230 con 0x7f5da406eb70 2024-04-26T21:18:08.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5da2000640 1 -- 172.21.15.106:0/1515031202 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c003620 con 0x7f5da406eb70 2024-04-26T21:18:08.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5daa200640 1 -- 172.21.15.106:0/1515031202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da406eb70 msgr2=0x7f5da40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:08.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5daa200640 1 --2- 172.21.15.106:0/1515031202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da406eb70 0x7f5da40d0df0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009870 tx=0x7f5d9c01c440 comp rx=0 tx=0).stop 2024-04-26T21:18:08.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5daa200640 1 -- 172.21.15.106:0/1515031202 shutdown_connections 2024-04-26T21:18:08.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5daa200640 1 --2- 172.21.15.106:0/1515031202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da406eb70 0x7f5da40d0df0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:08.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5daa200640 1 --2- 172.21.15.106:0/1515031202 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 0x7f5da415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:08.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.898+0000 7f5daa200640 1 -- 172.21.15.106:0/1515031202 >> 172.21.15.106:0/1515031202 conn(0x7f5da4068340 msgr2=0x7f5da4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:08.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 -- 172.21.15.106:0/1515031202 shutdown_connections 2024-04-26T21:18:08.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 -- 172.21.15.106:0/1515031202 wait complete. 2024-04-26T21:18:08.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 Processor -- start 2024-04-26T21:18:08.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 -- start start 2024-04-26T21:18:08.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 0x7f5da4144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da40ce870 0x7f5da4156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5da40cecf0 0x7f5da4156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5da41607d0 con 0x7f5da40cecf0 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5da4160650 con 0x7f5da40ce870 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5daa200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5da4168b60 con 0x7f5da413ed60 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5da40cecf0 0x7f5da4156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5da40cecf0 0x7f5da4156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55976/0 (socket says 172.21.15.106:55976) 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3e00640 1 -- 172.21.15.106:0/549589398 learned_addr learned my addr 172.21.15.106:0/549589398 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3400640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 0x7f5da4144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:08.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da2a00640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da40ce870 0x7f5da4156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:08.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3e00640 1 -- 172.21.15.106:0/549589398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 msgr2=0x7f5da4144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:08.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3e00640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 0x7f5da4144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:08.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3e00640 1 -- 172.21.15.106:0/549589398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da40ce870 msgr2=0x7f5da4156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3e00640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da40ce870 0x7f5da4156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3e00640 1 -- 172.21.15.106:0/549589398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da40cd4b0 con 0x7f5da40cecf0 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.902+0000 7f5da3e00640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5da40cecf0 0x7f5da4156640 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009870 tx=0x7f5d9c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5d9b400640 1 -- 172.21.15.106:0/549589398 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0bb070 con 0x7f5da40cecf0 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5d9b400640 1 -- 172.21.15.106:0/549589398 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c003cf0 con 0x7f5da40cecf0 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da4131370 con 0x7f5da40cecf0 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5d9b400640 1 -- 172.21.15.106:0/549589398 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0b0040 con 0x7f5da40cecf0 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da4131930 con 0x7f5da40cecf0 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da4069400 con 0x7f5da40cecf0 2024-04-26T21:18:08.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5d9b400640 1 -- 172.21.15.106:0/549589398 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d9c0be070 con 0x7f5da40cecf0 2024-04-26T21:18:08.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5d9b400640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5d84068380 0x7f5d8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:08.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5d9b400640 1 -- 172.21.15.106:0/549589398 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f5d9c120260 con 0x7f5da40cecf0 2024-04-26T21:18:08.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5da3400640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5d84068380 0x7f5d8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:08.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.906+0000 7f5da3400640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5d84068380 0x7f5d8406a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009bd0 tx=0x7f5d9400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:08.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:08.910+0000 7f5d9b400640 1 -- 172.21.15.106:0/549589398 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5d9c016150 con 0x7f5da40cecf0 2024-04-26T21:18:09.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5da415b890 con 0x7f5da40cecf0 2024-04-26T21:18:09.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5d9b400640 1 -- 172.21.15.106:0/549589398 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5176 (secure 0 0 0) 0x7f5d9c0effc0 con 0x7f5da40cecf0 2024-04-26T21:18:09.110 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:09.110 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/791761080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":791761080},{"type":"v1","addr":"172.21.15.106:6836","nonce":791761080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:18:07.963201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-26T21:18:09.110 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 22 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5d84068380 msgr2=0x7f5d8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5d84068380 0x7f5d8406a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009bd0 tx=0x7f5d9400b040 comp rx=0 tx=0).stop 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5da40cecf0 msgr2=0x7f5da4156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5da40cecf0 0x7f5da4156640 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009870 tx=0x7f5d9c0191e0 comp rx=0 tx=0).stop 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 shutdown_connections 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da40ce870 0x7f5da4156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5d84068380 0x7f5d8406a840 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5da40cecf0 0x7f5da4156640 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 --2- 172.21.15.106:0/549589398 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5da413ed60 0x7f5da4144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:09.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.106+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 >> 172.21.15.106:0/549589398 conn(0x7f5da4068340 msgr2=0x7f5da4071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:09.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.110+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 shutdown_connections 2024-04-26T21:18:09.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:09.110+0000 7f5daa200640 1 -- 172.21.15.106:0/549589398 wait complete. 2024-04-26T21:18:09.533 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:17:42.703325+0000', 'modified': '2024-04-26T21:18:07.963201+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 44, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5413}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5413': {'gid': 5413, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:rejoin', 'state_seq': 10, 'addr': '172.21.15.106:6837/967590660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6835', 'nonce': 967590660}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 967590660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T21:18:09.533 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5413:up:rejoin 2024-04-26T21:18:10.534 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:18:10.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1b9400640 1 Processor -- start 2024-04-26T21:18:10.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1b9400640 1 -- start start 2024-04-26T21:18:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1b9400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd1b4146490 0x7fd1b40b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1b9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd1b40cd3a0 0x7fd1b4160810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1b9400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1b4161670 con 0x7fd1b4160d50 2024-04-26T21:18:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1b9400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fd1b41611c0 con 0x7fd1b40cd3a0 2024-04-26T21:18:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1b9400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd1b40d02c0 con 0x7fd1b4146490 2024-04-26T21:18:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1ab400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd1b40cd3a0 0x7fd1b4160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1b8a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd1b4160d50 0x7fd1b415d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53698/0 (socket says 172.21.15.106:53698) 2024-04-26T21:18:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.678+0000 7fd1b8a00640 1 -- 172.21.15.106:0/37730325 learned_addr learned my addr 172.21.15.106:0/37730325 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1b3e00640 1 --2- 172.21.15.106:0/37730325 >> v2:172.21.15.112:3300/0 conn(0x7fd1b4146490 0x7fd1b40b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1ab400640 1 -- 172.21.15.106:0/37730325 >> v2:172.21.15.112:3300/0 conn(0x7fd1b4146490 msgr2=0x7fd1b40b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1ab400640 1 --2- 172.21.15.106:0/37730325 >> v2:172.21.15.112:3300/0 conn(0x7fd1b4146490 0x7fd1b40b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1ab400640 1 -- 172.21.15.106:0/37730325 >> v1:172.21.15.106:6789/0 conn(0x7fd1b4160d50 legacy=0x7fd1b415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1ab400640 1 -- 172.21.15.106:0/37730325 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b40cd8a0 con 0x7fd1b40cd3a0 2024-04-26T21:18:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1b3400640 1 -- 172.21.15.106:0/37730325 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799038851 0 0) 0x7fd1b4161670 con 0x7fd1b4160d50 2024-04-26T21:18:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1ab400640 1 --2- 172.21.15.106:0/37730325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b40cd3a0 0x7fd1b4160810 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd1b406f980 tx=0x7fd19c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9db79f1e8dbd7f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1b3400640 1 -- 172.21.15.106:0/37730325 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0b0070 con 0x7fd1b40cd3a0 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1b3400640 1 -- 172.21.15.106:0/37730325 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c0ab600 con 0x7fd1b40cd3a0 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1b3400640 1 -- 172.21.15.106:0/37730325 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0ab9d0 con 0x7fd1b40cd3a0 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1b9400640 1 -- 172.21.15.106:0/37730325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b40cd3a0 msgr2=0x7fd1b4160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.682+0000 7fd1b9400640 1 --2- 172.21.15.106:0/37730325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b40cd3a0 0x7fd1b4160810 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd1b406f980 tx=0x7fd19c01c3f0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 -- 172.21.15.106:0/37730325 shutdown_connections 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 --2- 172.21.15.106:0/37730325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b40cd3a0 0x7fd1b4160810 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 --2- 172.21.15.106:0/37730325 >> v2:172.21.15.112:3300/0 conn(0x7fd1b4146490 0x7fd1b40b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 -- 172.21.15.106:0/37730325 >> 172.21.15.106:0/37730325 conn(0x7fd1b40b26c0 msgr2=0x7fd1b40b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 -- 172.21.15.106:0/37730325 shutdown_connections 2024-04-26T21:18:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 -- 172.21.15.106:0/37730325 wait complete. 2024-04-26T21:18:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 Processor -- start 2024-04-26T21:18:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 -- start start 2024-04-26T21:18:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1b40cd3a0 0x7fd1b4073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b4146490 0x7fd1b413daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1b4160d50 0x7fd1b415ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4169d30 con 0x7fd1b4146490 2024-04-26T21:18:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4169bb0 con 0x7fd1b40cd3a0 2024-04-26T21:18:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b9400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b4169eb0 con 0x7fd1b4160d50 2024-04-26T21:18:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1ab400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b4146490 0x7fd1b413daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1ab400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b4146490 0x7fd1b413daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:55992/0 (socket says 172.21.15.106:55992) 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1ab400640 1 -- 172.21.15.106:0/3484384551 learned_addr learned my addr 172.21.15.106:0/3484384551 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b3e00640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1b40cd3a0 0x7fd1b4073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1b8a00640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1b4160d50 0x7fd1b415ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1ab400640 1 -- 172.21.15.106:0/3484384551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1b4160d50 msgr2=0x7fd1b415ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1ab400640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1b4160d50 0x7fd1b415ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1ab400640 1 -- 172.21.15.106:0/3484384551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1b40cd3a0 msgr2=0x7fd1b4073890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1ab400640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1b40cd3a0 0x7fd1b4073890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1ab400640 1 -- 172.21.15.106:0/3484384551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b40b1680 con 0x7fd1b4146490 2024-04-26T21:18:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.686+0000 7fd1ab400640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b4146490 0x7fd1b413daa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0ae040 tx=0x7fd19c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b0c00640 1 -- 172.21.15.106:0/3484384551 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0b0050 con 0x7fd1b4146490 2024-04-26T21:18:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b0c00640 1 -- 172.21.15.106:0/3484384551 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c0bc070 con 0x7fd1b4146490 2024-04-26T21:18:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b0c00640 1 -- 172.21.15.106:0/3484384551 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0b5850 con 0x7fd1b4146490 2024-04-26T21:18:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b4071e60 con 0x7fd1b4146490 2024-04-26T21:18:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b40b13a0 con 0x7fd1b4146490 2024-04-26T21:18:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b4069400 con 0x7fd1b4146490 2024-04-26T21:18:10.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b0c00640 1 -- 172.21.15.106:0/3484384551 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd19c0b59f0 con 0x7fd1b4146490 2024-04-26T21:18:10.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b0c00640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd190068380 0x7fd19006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:10.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b0c00640 1 -- 172.21.15.106:0/3484384551 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7fd19c1212d0 con 0x7fd1b4146490 2024-04-26T21:18:10.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b3e00640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd190068380 0x7fd19006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:10.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.690+0000 7fd1b3e00640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd190068380 0x7fd19006a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009b60 tx=0x7fd1a4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:10.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.694+0000 7fd1b0c00640 1 -- 172.21.15.106:0/3484384551 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd19c016070 con 0x7fd1b4146490 2024-04-26T21:18:10.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.882+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1b40b3560 con 0x7fd1b4146490 2024-04-26T21:18:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b0c00640 1 -- 172.21.15.106:0/3484384551 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5182 (secure 0 0 0) 0x7fd19c0f1030 con 0x7fd1b4146490 2024-04-26T21:18:10.888 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:10.888 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/791761080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":791761080},{"type":"v1","addr":"172.21.15.106:6836","nonce":791761080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:18:08.972959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":20,"state":"up:clientreplay","state_seq":11,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-26T21:18:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 23 2024-04-26T21:18:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd190068380 msgr2=0x7fd19006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd190068380 0x7fd19006a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009b60 tx=0x7fd1a4009190 comp rx=0 tx=0).stop 2024-04-26T21:18:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b4146490 msgr2=0x7fd1b413daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b4146490 0x7fd1b413daa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0ae040 tx=0x7fd19c01ac30 comp rx=0 tx=0).stop 2024-04-26T21:18:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 shutdown_connections 2024-04-26T21:18:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd190068380 0x7fd19006a840 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd1b4160d50 0x7fd1b415ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1b4146490 0x7fd1b413daa0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 --2- 172.21.15.106:0/3484384551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1b40cd3a0 0x7fd1b4073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 >> 172.21.15.106:0/3484384551 conn(0x7fd1b40b26c0 msgr2=0x7fd1b40b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 shutdown_connections 2024-04-26T21:18:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:10.886+0000 7fd1b9400640 1 -- 172.21.15.106:0/3484384551 wait complete. 2024-04-26T21:18:11.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:17:42.703325+0000', 'modified': '2024-04-26T21:18:08.972959+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 44, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5413}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5413': {'gid': 5413, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:clientreplay', 'state_seq': 11, 'addr': '172.21.15.106:6837/967590660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6835', 'nonce': 967590660}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 967590660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T21:18:11.312 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5413:up:clientreplay 2024-04-26T21:18:12.297 INFO:tasks.ceph.mds.a.smithi106.stderr:2024-04-26T21:18:12.294+0000 7f485cc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:18:12.337 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:18:12.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bec00640 1 Processor -- start 2024-04-26T21:18:12.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bec00640 1 -- start start 2024-04-26T21:18:12.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bec00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f09b8159850 0x7f09b80b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bec00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b815ce30 0x7f09b815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bec00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b815d3a0 con 0x7f09b815c290 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bec00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f09b8159c30 con 0x7f09b8159850 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bec00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f09b80b4e80 con 0x7f09b815ce30 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bd800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f09b8159850 0x7f09b80b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bd800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f09b8159850 0x7f09b80b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56000/0 (socket says 172.21.15.106:56000) 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.478+0000 7f09bd800640 1 -- 172.21.15.106:0/2764907960 learned_addr learned my addr 172.21.15.106:0/2764907960 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.482+0000 7f09be200640 1 --2- 172.21.15.106:0/2764907960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b815ce30 0x7f09b815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.482+0000 7f09bd800640 1 -- 172.21.15.106:0/2764907960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b815ce30 msgr2=0x7f09b815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.482+0000 7f09bd800640 1 --2- 172.21.15.106:0/2764907960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b815ce30 0x7f09b815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.482+0000 7f09bd800640 1 -- 172.21.15.106:0/2764907960 >> v1:172.21.15.112:6789/0 conn(0x7f09b815c290 legacy=0x7f09b815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:12.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.482+0000 7f09bd800640 1 -- 172.21.15.106:0/2764907960 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b80b5160 con 0x7f09b8159850 2024-04-26T21:18:12.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.482+0000 7f09bd800640 1 --2- 172.21.15.106:0/2764907960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b8159850 0x7f09b80b4750 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009870 tx=0x7f09ac01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee625d04be0bf775 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:12.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.482+0000 7f09b7e00640 1 -- 172.21.15.106:0/2764907960 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0b0070 con 0x7f09b8159850 2024-04-26T21:18:12.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.482+0000 7f09b7e00640 1 -- 172.21.15.106:0/2764907960 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ac0a4e50 con 0x7f09b8159850 2024-04-26T21:18:12.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.482+0000 7f09b7e00640 1 -- 172.21.15.106:0/2764907960 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0ab820 con 0x7f09b8159850 2024-04-26T21:18:12.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 -- 172.21.15.106:0/2764907960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b8159850 msgr2=0x7f09b80b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:12.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 --2- 172.21.15.106:0/2764907960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b8159850 0x7f09b80b4750 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009870 tx=0x7f09ac01c400 comp rx=0 tx=0).stop 2024-04-26T21:18:12.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 -- 172.21.15.106:0/2764907960 shutdown_connections 2024-04-26T21:18:12.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 --2- 172.21.15.106:0/2764907960 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b815ce30 0x7f09b815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 --2- 172.21.15.106:0/2764907960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b8159850 0x7f09b80b4750 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 -- 172.21.15.106:0/2764907960 >> 172.21.15.106:0/2764907960 conn(0x7f09b80b26c0 msgr2=0x7f09b80b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:12.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 -- 172.21.15.106:0/2764907960 shutdown_connections 2024-04-26T21:18:12.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 -- 172.21.15.106:0/2764907960 wait complete. 2024-04-26T21:18:12.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 Processor -- start 2024-04-26T21:18:12.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 -- start start 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b8159850 0x7f09b80ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b815c290 0x7f09b8165640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b815ce30 0x7f09b8165b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f09b815ec50 con 0x7f09b815ce30 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f09b815ead0 con 0x7f09b815c290 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bec00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f09b815edd0 con 0x7f09b8159850 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09be200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b815ce30 0x7f09b8165b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09be200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b815ce30 0x7f09b8165b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56010/0 (socket says 172.21.15.106:56010) 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09be200640 1 -- 172.21.15.106:0/905765902 learned_addr learned my addr 172.21.15.106:0/905765902 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bce00640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b815c290 0x7f09b8165640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09bd800640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b8159850 0x7f09b80ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:12.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09be200640 1 -- 172.21.15.106:0/905765902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b8159850 msgr2=0x7f09b80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09be200640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b8159850 0x7f09b80ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09be200640 1 -- 172.21.15.106:0/905765902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b815c290 msgr2=0x7f09b8165640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09be200640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b815c290 0x7f09b8165640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.486+0000 7f09be200640 1 -- 172.21.15.106:0/905765902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b8069ee0 con 0x7f09b815ce30 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09be200640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b815ce30 0x7f09b8165b80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f09b0007e90 tx=0x7f09b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09b5600640 1 -- 172.21.15.106:0/905765902 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0014420 con 0x7f09b815ce30 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09b5600640 1 -- 172.21.15.106:0/905765902 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b0019070 con 0x7f09b815ce30 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09b5600640 1 -- 172.21.15.106:0/905765902 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0014800 con 0x7f09b815ce30 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b80cf250 con 0x7f09b815ce30 2024-04-26T21:18:12.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b80cf810 con 0x7f09b815ce30 2024-04-26T21:18:12.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b8069400 con 0x7f09b815ce30 2024-04-26T21:18:12.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09b5600640 1 -- 172.21.15.106:0/905765902 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09b00149a0 con 0x7f09b815ce30 2024-04-26T21:18:12.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09b5600640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0998068380 0x7f099806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:12.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09b5600640 1 -- 172.21.15.106:0/905765902 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f09b0087260 con 0x7f09b815ce30 2024-04-26T21:18:12.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.490+0000 7f09bd800640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0998068380 0x7f099806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:12.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.494+0000 7f09bd800640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0998068380 0x7f099806a840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0ad000 tx=0x7f09ac0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:12.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.494+0000 7f09b5600640 1 -- 172.21.15.106:0/905765902 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f09b0056fc0 con 0x7f09b815ce30 2024-04-26T21:18:12.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.682+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09b80ccce0 con 0x7f09b815ce30 2024-04-26T21:18:12.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.682+0000 7f09b5600640 1 -- 172.21.15.106:0/905765902 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5183 (secure 0 0 0) 0x7f09b005b2c0 con 0x7f09b815ce30 2024-04-26T21:18:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:12.687 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/791761080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":791761080},{"type":"v1","addr":"172.21.15.106:6836","nonce":791761080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:18:10.975225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5413,"qdb_cluster":[5413]},"id":2}]} 2024-04-26T21:18:12.687 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 24 2024-04-26T21:18:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0998068380 msgr2=0x7f099806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0998068380 0x7f099806a840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0ad000 tx=0x7f09ac0a6000 comp rx=0 tx=0).stop 2024-04-26T21:18:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b815ce30 msgr2=0x7f09b8165b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:12.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b815ce30 0x7f09b8165b80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f09b0007e90 tx=0x7f09b000e4b0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 shutdown_connections 2024-04-26T21:18:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09b815c290 0x7f09b8165640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f0998068380 0x7f099806a840 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b815ce30 0x7f09b8165b80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 --2- 172.21.15.106:0/905765902 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09b8159850 0x7f09b80ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 >> 172.21.15.106:0/905765902 conn(0x7f09b80b26c0 msgr2=0x7f09b8164d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 shutdown_connections 2024-04-26T21:18:12.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:12.686+0000 7f09bec00640 1 -- 172.21.15.106:0/905765902 wait complete. 2024-04-26T21:18:13.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:17:42.703325+0000', 'modified': '2024-04-26T21:18:10.975225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 44, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5413}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5413': {'gid': 5413, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.106:6837/967590660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6835', 'nonce': 967590660}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 967590660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5413, 'qdb_cluster': [5413]} 2024-04-26T21:18:13.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T21:18:13.111 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T21:18:13.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1907e00640 1 Processor -- start 2024-04-26T21:18:13.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1907e00640 1 -- start start 2024-04-26T21:18:13.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1907e00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f19080719f0 0x7f19080d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1907e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190806d610 0x7f19080d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1907e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19080cff60 con 0x7f19080cf390 2024-04-26T21:18:13.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1907e00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f19080d0240 con 0x7f19080719f0 2024-04-26T21:18:13.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1907e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f19080701e0 con 0x7f190806d610 2024-04-26T21:18:13.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1906a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f19080cf390 0x7f19080cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53710/0 (socket says 172.21.15.106:53710) 2024-04-26T21:18:13.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1906a00640 1 -- 172.21.15.106:0/1149385716 learned_addr learned my addr 172.21.15.106:0/1149385716 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:13.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084755836 0 0) 0x7f19080cff60 con 0x7f19080cf390 2024-04-26T21:18:13.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18ec003530 con 0x7f19080cf390 2024-04-26T21:18:13.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1907400640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190806d610 0x7f19080d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1906000640 1 --2- 172.21.15.106:0/1149385716 >> v2:172.21.15.112:3300/0 conn(0x7f19080719f0 0x7f19080d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3625269358 0 0) 0x7f18ec003530 con 0x7f19080cf390 2024-04-26T21:18:13.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190806d610 msgr2=0x7f19080d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190806d610 0x7f19080d1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 >> v2:172.21.15.112:3300/0 conn(0x7f19080719f0 msgr2=0x7f19080d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 --2- 172.21.15.106:0/1149385716 >> v2:172.21.15.112:3300/0 conn(0x7f19080719f0 0x7f19080d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19080704c0 con 0x7f19080cf390 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f18f8001a00 con 0x7f19080cf390 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1906000640 1 --2- 172.21.15.106:0/1149385716 >> v2:172.21.15.112:3300/0 conn(0x7f19080719f0 0x7f19080d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 >> v1:172.21.15.106:6789/0 conn(0x7f19080cf390 legacy=0x7f19080cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f18ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec004810 0x7f18ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190806d610 0x7f18ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f19080d0240 con 0x7f18ec0039c0 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19080701e0 con 0x7f18ec004810 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec00ba00 con 0x7f190806d610 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1906a00640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f18ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1906000640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec004810 0x7f18ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.246+0000 7f1907400640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190806d610 0x7f18ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1906a00640 1 -- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190806d610 msgr2=0x7f18ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1906a00640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190806d610 0x7f18ec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1906a00640 1 -- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec004810 msgr2=0x7f18ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1906a00640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec004810 0x7f18ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1906a00640 1 -- 172.21.15.106:0/1149385716 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec003530 con 0x7f18ec0039c0 2024-04-26T21:18:13.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1906000640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18ec004810 0x7f18ec004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:13.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1907400640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190806d610 0x7f18ec0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:13.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1906a00640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f18ec003de0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f18f800a8a0 tx=0x7f18f801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71730ef8abed39f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f800a4c0 con 0x7f18ec0039c0 2024-04-26T21:18:13.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f80ad650 con 0x7f18ec0039c0 2024-04-26T21:18:13.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1905600640 1 -- 172.21.15.106:0/1149385716 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a5e60 con 0x7f18ec0039c0 2024-04-26T21:18:13.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1907e00640 1 -- 172.21.15.106:0/1149385716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 msgr2=0x7f18ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1907e00640 1 --2- 172.21.15.106:0/1149385716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f18ec003de0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f18f800a8a0 tx=0x7f18f801d360 comp rx=0 tx=0).stop 2024-04-26T21:18:13.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1907400640 1 -- 172.21.15.106:0/1149385716 reap_dead start 2024-04-26T21:18:13.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1907e00640 1 -- 172.21.15.106:0/1149385716 shutdown_connections 2024-04-26T21:18:13.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1907e00640 1 -- 172.21.15.106:0/1149385716 >> 172.21.15.106:0/1149385716 conn(0x7f19080b4620 msgr2=0x7f19080b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:13.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.250+0000 7f1907e00640 1 -- 172.21.15.106:0/1149385716 shutdown_connections 2024-04-26T21:18:13.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 -- 172.21.15.106:0/1149385716 wait complete. 2024-04-26T21:18:13.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 Processor -- start 2024-04-26T21:18:13.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 -- start start 2024-04-26T21:18:13.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f1908156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19081fb370 0x7f19081fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190809d5c0 0x7f190809da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f19080d1e30 con 0x7f18ec0039c0 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19080d1cb0 con 0x7f19081fb370 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f19080d1fb0 con 0x7f190809d5c0 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f1908156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f1908156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56030/0 (socket says 172.21.15.106:56030) 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906a00640 1 -- 172.21.15.106:0/3765265369 learned_addr learned my addr 172.21.15.106:0/3765265369 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907400640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190809d5c0 0x7f190809da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906000640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19081fb370 0x7f19081fb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906a00640 1 -- 172.21.15.106:0/3765265369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190809d5c0 msgr2=0x7f190809da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906a00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190809d5c0 0x7f190809da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906a00640 1 -- 172.21.15.106:0/3765265369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19081fb370 msgr2=0x7f19081fb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906a00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19081fb370 0x7f19081fb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906a00640 1 -- 172.21.15.106:0/3765265369 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19080c77c0 con 0x7f18ec0039c0 2024-04-26T21:18:13.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1906a00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f1908156d70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f18f801d190 tx=0x7f18ec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f18fea00640 1 -- 172.21.15.106:0/3765265369 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80bc070 con 0x7f18ec0039c0 2024-04-26T21:18:13.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f18fea00640 1 -- 172.21.15.106:0/3765265369 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f80a5e60 con 0x7f18ec0039c0 2024-04-26T21:18:13.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f18fea00640 1 -- 172.21.15.106:0/3765265369 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80b2040 con 0x7f18ec0039c0 2024-04-26T21:18:13.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.254+0000 7f1907e00640 1 -- 172.21.15.106:0/3765265369 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19080c7aa0 con 0x7f18ec0039c0 2024-04-26T21:18:13.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.258+0000 7f1907e00640 1 -- 172.21.15.106:0/3765265369 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19080c8060 con 0x7f18ec0039c0 2024-04-26T21:18:13.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.258+0000 7f18fea00640 1 -- 172.21.15.106:0/3765265369 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18f80bf070 con 0x7f18ec0039c0 2024-04-26T21:18:13.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.258+0000 7f18fea00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e80683b0 0x7f18e806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.258+0000 7f18fea00640 1 -- 172.21.15.106:0/3765265369 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f18f8120cc0 con 0x7f18ec0039c0 2024-04-26T21:18:13.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.258+0000 7f1910a0d000 1 Processor -- start 2024-04-26T21:18:13.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.258+0000 7f1906000640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e80683b0 0x7f18e806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.258+0000 7f1910a0d000 1 -- start start 2024-04-26T21:18:13.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.258+0000 7f1906000640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e80683b0 0x7f18e806a870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19081fb2d0 tx=0x7f18f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909054aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 0x559090501200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 0x559090501b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5590903b9140 con 0x55909054a700 2024-04-26T21:18:13.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55909034ee00 con 0x559090501740 2024-04-26T21:18:13.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x559090307a00 con 0x55909054b020 2024-04-26T21:18:13.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909054aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909054aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56036/0 (socket says 172.21.15.106:56036) 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906a00640 1 -- 172.21.15.106:0/2193093579 learned_addr learned my addr 172.21.15.106:0/2193093579 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1907400640 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 0x559090501b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906000640 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 0x559090501200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906a00640 1 -- 172.21.15.106:0/2193093579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 msgr2=0x559090501200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906a00640 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 0x559090501200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906a00640 1 -- 172.21.15.106:0/2193093579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 msgr2=0x559090501b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906a00640 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 0x559090501b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906a00640 1 -- 172.21.15.106:0/2193093579 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55909030c0e0 con 0x55909054a700 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1907400640 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 0x559090501b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1906a00640 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909054aae0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f18f80f0720 tx=0x7f18f80f0380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82ed90f16a0250a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f18f3400640 1 -- 172.21.15.106:0/2193093579 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80f4d20 con 0x55909054a700 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f18f3400640 1 -- 172.21.15.106:0/2193093579 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f80f9550 con 0x55909054a700 2024-04-26T21:18:13.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f18f3400640 1 -- 172.21.15.106:0/2193093579 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80eed20 con 0x55909054a700 2024-04-26T21:18:13.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 -- 172.21.15.106:0/2193093579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 msgr2=0x55909054aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909054aae0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f18f80f0720 tx=0x7f18f80f0380 comp rx=0 tx=0).stop 2024-04-26T21:18:13.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 -- 172.21.15.106:0/2193093579 shutdown_connections 2024-04-26T21:18:13.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 0x559090501b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 0x559090501200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 --2- 172.21.15.106:0/2193093579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909054aae0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 -- 172.21.15.106:0/2193093579 >> 172.21.15.106:0/2193093579 conn(0x5590904fd6f0 msgr2=0x5590904ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:13.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 -- 172.21.15.106:0/2193093579 shutdown_connections 2024-04-26T21:18:13.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 -- 172.21.15.106:0/2193093579 wait complete. 2024-04-26T21:18:13.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 -- start start 2024-04-26T21:18:13.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.262+0000 7f1910a0d000 1 Processor -- start 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 0x55909050c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909050c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 0x55909050cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55909035c200 con 0x55909054a700 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5590902f2e80 con 0x559090501740 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x559090349ae0 con 0x55909054b020 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 10 client.0 _ll_register_callbacks cb 0x55909035bda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909050c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909050c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56042/0 (socket says 172.21.15.106:56042) 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906000640 1 -- 172.21.15.106:0/996950206 learned_addr learned my addr 172.21.15.106:0/996950206 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:13.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906a00640 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 0x55909050c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1907400640 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 0x55909050cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906000640 1 -- 172.21.15.106:0/996950206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 msgr2=0x55909050cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906000640 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 0x55909050cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906000640 1 -- 172.21.15.106:0/996950206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 msgr2=0x55909050c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906000640 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 0x55909050c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906000640 1 -- 172.21.15.106:0/996950206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590902ee4e0 con 0x55909054a700 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906000640 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909050c5e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f18f4006aa0 tx=0x7f18f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff952ae7362ed0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f18e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f18e7e00640 1 -- 172.21.15.106:0/996950206 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f4028070 con 0x55909054a700 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 -- 172.21.15.106:0/996950206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18f80f9550 con 0x55909054a700 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f18e7e00640 1 -- 172.21.15.106:0/996950206 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f18f4024420 con 0x55909054a700 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f18e7e00640 1 -- 172.21.15.106:0/996950206 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f18f4033050 con 0x55909054a700 2024-04-26T21:18:13.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 10 client.5751 fetch_fsmap learned FSMap version 24 2024-04-26T21:18:13.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 -- 172.21.15.106:0/996950206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5590902d4e80 con 0x55909054a700 2024-04-26T21:18:13.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f18e7e00640 1 -- 172.21.15.106:0/996950206 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f80f9550 con 0x55909054a700 2024-04-26T21:18:13.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f18e7e00640 1 -- 172.21.15.106:0/996950206 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7f18f4036020 con 0x55909054a700 2024-04-26T21:18:13.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 10 client.5751 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T21:18:13.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 10 client.5751 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T21:18:13.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 20 client.5751 populate_metadata read hostname 'smithi106' 2024-04-26T21:18:13.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] conn(0x55909050d530 0x55909055c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 4 client.5751 mds_command: new command op to 5413 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T21:18:13.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 -- 172.21.15.106:0/996950206 --> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590902e7bc0 con 0x55909050d530 2024-04-26T21:18:13.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906a00640 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] conn(0x55909050d530 0x55909055c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1906a00640 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] conn(0x55909050d530 0x55909055c7b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5383df9e9fc4377 server_cookie=5834f9ca9b24351c in_seq=0 out_seq=0 2024-04-26T21:18:13.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f18e7e00640 10 client.5751 ms_handle_connect on v2:172.21.15.106:6835/967590660 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f18e7e00640 1 -- 172.21.15.106:0/996950206 <== mds.0 v2:172.21.15.106:6835/967590660 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5590902e7bc0 con 0x55909050d530 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f18e7e00640 10 client.5751 handle_command_reply: tid=0 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.266+0000 7f1910a0d000 1 client.5751 shutdown 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 -- 172.21.15.106:0/996950206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 msgr2=0x55909050c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909050c5e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f18f4006aa0 tx=0x7f18f4004740 comp rx=0 tx=0).stop 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 -- 172.21.15.106:0/996950206 shutdown_connections 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55909054b020 0x55909050cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054a700 0x55909050c5e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] conn(0x55909050d530 0x55909055c7b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 --2- 172.21.15.106:0/996950206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559090501740 0x55909050c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 -- 172.21.15.106:0/996950206 >> 172.21.15.106:0/996950206 conn(0x5590904fd6f0 msgr2=0x559090500370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f18e7e00640 0 client.5751 ms_handle_reset on v2:172.21.15.106:6835/967590660 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 -- 172.21.15.106:0/996950206 shutdown_connections 2024-04-26T21:18:13.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 1 -- 172.21.15.106:0/996950206 wait complete. 2024-04-26T21:18:13.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.270+0000 7f1910a0d000 20 client.5751 trim_cache size 0 max 16384 2024-04-26T21:18:13.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1910a0d000 1 Processor -- start 2024-04-26T21:18:13.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1910a0d000 1 -- start start 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590904fd6f0 0x559090500af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559090501740 0x559090501030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55909054a700 0x55909055c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1910a0d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f19082040f0 con 0x5590904fd6f0 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1910a0d000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f190809ee50 con 0x55909054a700 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1910a0d000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f190809f4a0 con 0x559090501740 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1906a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590904fd6f0 0x559090500af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1906a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590904fd6f0 0x559090500af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56052/0 (socket says 172.21.15.106:56052) 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1906a00640 1 -- 172.21.15.106:0/2777142766 learned_addr learned my addr 172.21.15.106:0/2777142766 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1906a00640 1 -- 172.21.15.106:0/2777142766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559090501740 msgr2=0x559090501030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1906a00640 1 --2- 172.21.15.106:0/2777142766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559090501740 0x559090501030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1906a00640 1 -- 172.21.15.106:0/2777142766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55909054a700 msgr2=0x55909055c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1906a00640 1 --2- 172.21.15.106:0/2777142766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55909054a700 0x55909055c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1906a00640 1 -- 172.21.15.106:0/2777142766 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559090307c50 con 0x5590904fd6f0 2024-04-26T21:18:13.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f1906a00640 1 --2- 172.21.15.106:0/2777142766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590904fd6f0 0x559090500af0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f18f80b6040 tx=0x7f18f80f2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f654dda2a2014fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f18f2a00640 1 -- 172.21.15.106:0/2777142766 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f811f060 con 0x5590904fd6f0 2024-04-26T21:18:13.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f18f2a00640 1 -- 172.21.15.106:0/2777142766 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f80eed20 con 0x5590904fd6f0 2024-04-26T21:18:13.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.286+0000 7f18f2a00640 1 -- 172.21.15.106:0/2777142766 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80f7070 con 0x5590904fd6f0 2024-04-26T21:18:13.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- 172.21.15.106:0/2777142766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590904fd6f0 msgr2=0x559090500af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 --2- 172.21.15.106:0/2777142766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590904fd6f0 0x559090500af0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f18f80b6040 tx=0x7f18f80f2000 comp rx=0 tx=0).stop 2024-04-26T21:18:13.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- 172.21.15.106:0/2777142766 shutdown_connections 2024-04-26T21:18:13.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 --2- 172.21.15.106:0/2777142766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55909054a700 0x55909055c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 --2- 172.21.15.106:0/2777142766 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559090501740 0x559090501030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 --2- 172.21.15.106:0/2777142766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590904fd6f0 0x559090500af0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- 172.21.15.106:0/2777142766 >> 172.21.15.106:0/2777142766 conn(0x559090506e70 msgr2=0x559090557460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:13.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- 172.21.15.106:0/2777142766 shutdown_connections 2024-04-26T21:18:13.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- 172.21.15.106:0/2777142766 wait complete. 2024-04-26T21:18:13.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- start start 2024-04-26T21:18:13.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 Processor -- start 2024-04-26T21:18:13.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559090501740 0x55909055f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55909054a700 0x559090576340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054b020 0x559090576880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55909034e110 con 0x55909054b020 2024-04-26T21:18:13.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5590902e47b0 con 0x55909054a700 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55909035b0a0 con 0x559090501740 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 10 client.0 _ll_register_callbacks cb 0x7f18f4006ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1907400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054b020 0x559090576880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1907400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054b020 0x559090576880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56056/0 (socket says 172.21.15.106:56056) 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1907400640 1 -- 172.21.15.106:0/3742438232 learned_addr learned my addr 172.21.15.106:0/3742438232 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1906000640 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55909054a700 0x559090576340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1906a00640 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559090501740 0x55909055f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1907400640 1 -- 172.21.15.106:0/3742438232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559090501740 msgr2=0x55909055f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1907400640 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559090501740 0x55909055f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1907400640 1 -- 172.21.15.106:0/3742438232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55909054a700 msgr2=0x559090576340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1907400640 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55909054a700 0x559090576340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1907400640 1 -- 172.21.15.106:0/3742438232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590903d1160 con 0x55909054b020 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1907400640 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054b020 0x559090576880 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1900018680 tx=0x7f1900018b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cae66ee8917321b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f18e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f18e7e00640 1 -- 172.21.15.106:0/3742438232 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900025060 con 0x55909054b020 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f18e7e00640 1 -- 172.21.15.106:0/3742438232 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f1900016d00 con 0x55909054b020 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- 172.21.15.106:0/3742438232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18f80eed20 con 0x55909054b020 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f18e7e00640 1 -- 172.21.15.106:0/3742438232 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f19000203f0 con 0x55909054b020 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 10 client.5757 fetch_fsmap learned FSMap version 24 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.290+0000 7f1910a0d000 1 -- 172.21.15.106:0/3742438232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5590900080c0 con 0x55909054b020 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f18e7e00640 1 -- 172.21.15.106:0/3742438232 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f80eed20 con 0x55909054b020 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f18e7e00640 1 -- 172.21.15.106:0/3742438232 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 24) ==== 3494+0+0 (secure 0 0 0) 0x7f190002e020 con 0x55909054b020 2024-04-26T21:18:13.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 10 client.5757 fetch_fsmap finished waiting for FSMap version 24 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 10 client.5757 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 20 client.5757 populate_metadata read hostname 'smithi106' 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] conn(0x5590905b9b90 0x5590905b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 4 client.5757 mds_command: new command op to 5413 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 -- 172.21.15.106:0/3742438232 --> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] -- command(tid 0: {"prefix": "status"}) -- 0x55909035ca10 con 0x5590905b9b90 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1906a00640 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] conn(0x5590905b9b90 0x5590905b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1906a00640 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] conn(0x5590905b9b90 0x5590905b9f70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83a2f7c471e77edf server_cookie=e092f2851c97e1f0 in_seq=0 out_seq=0 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f18e7e00640 10 client.5757 ms_handle_connect on v2:172.21.15.106:6835/967590660 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f18e7e00640 1 -- 172.21.15.106:0/3742438232 <== mds.0 v2:172.21.15.106:6835/967590660 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55909035ca10 con 0x5590905b9b90 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f18e7e00640 10 client.5757 handle_command_reply: tid=0 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 client.5757 shutdown 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 -- 172.21.15.106:0/3742438232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054b020 msgr2=0x559090576880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054b020 0x559090576880 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1900018680 tx=0x7f1900018b40 comp rx=0 tx=0).stop 2024-04-26T21:18:13.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 -- 172.21.15.106:0/3742438232 shutdown_connections 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.106:6835/967590660,v1:172.21.15.106:6837/967590660] conn(0x5590905b9b90 0x5590905b9f70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55909054a700 0x559090576340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55909054b020 0x559090576880 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f18e7e00640 0 client.5757 ms_handle_reset on v2:172.21.15.106:6835/967590660 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 --2- 172.21.15.106:0/3742438232 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x559090501740 0x55909055f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 -- 172.21.15.106:0/3742438232 >> 172.21.15.106:0/3742438232 conn(0x559090506e70 msgr2=0x559090557cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 -- 172.21.15.106:0/3742438232 shutdown_connections 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 1 -- 172.21.15.106:0/3742438232 wait complete. 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1910a0d000 20 client.5757 trim_cache size 0 max 16384 2024-04-26T21:18:13.301 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "f2bfe958-5421-4d89-8d8f-237a3ca1f771", 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 5413, 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 6.3394474169999997, 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 24, 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 44, 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 44, 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 37.842380194999997 2024-04-26T21:18:13.302 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:18:13.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 -- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e80683b0 msgr2=0x7f18e806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e80683b0 0x7f18e806a870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19081fb2d0 tx=0x7f18f4008040 comp rx=0 tx=0).stop 2024-04-26T21:18:13.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 -- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 msgr2=0x7f1908156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f1908156d70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f18f801d190 tx=0x7f18ec005840 comp rx=0 tx=0).stop 2024-04-26T21:18:13.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 -- 172.21.15.106:0/3765265369 shutdown_connections 2024-04-26T21:18:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19081fb370 0x7f19081fb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f18e80683b0 0x7f18e806a870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f190809d5c0 0x7f190809da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 --2- 172.21.15.106:0/3765265369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18ec0039c0 0x7f1908156d70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 -- 172.21.15.106:0/3765265369 >> 172.21.15.106:0/3765265369 conn(0x7f19080b4620 msgr2=0x7f19080b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 -- 172.21.15.106:0/3765265369 shutdown_connections 2024-04-26T21:18:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.294+0000 7f1907e00640 1 -- 172.21.15.106:0/3765265369 wait complete. 2024-04-26T21:18:13.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:13.317 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%a /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2024-04-26T21:18:13.327 INFO:teuthology.orchestra.run.smithi106.stdout:600 2024-04-26T21:18:13.328 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T21:18:13.328 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T21:18:13.470 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T21:18:13.561 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T21:18:13.561 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T21:18:13.561 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:18:13.562 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:18:13.570 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:18:13.570 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:18:13.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:18:13.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa65f600640 1 Processor -- start 2024-04-26T21:18:13.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa65f600640 1 -- start start 2024-04-26T21:18:13.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa65f600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa65813ed60 0x7fa65815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa65f600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa65806eb70 0x7fa6580d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa65f600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6580b3d10 con 0x7fa65813f140 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa65f600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fa6580b3ac0 con 0x7fa65813ed60 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa65f600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa6580b4920 con 0x7fa65806eb70 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa65cc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa65813ed60 0x7fa65815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa64fe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa65813f140 0x7fa6580b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53718/0 (socket says 172.21.15.106:53718) 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.790+0000 7fa64fe00640 1 -- 172.21.15.106:0/1684092509 learned_addr learned my addr 172.21.15.106:0/1684092509 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65d600640 1 --2- 172.21.15.106:0/1684092509 >> v2:172.21.15.112:3300/0 conn(0x7fa65806eb70 0x7fa6580d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65cc00640 1 -- 172.21.15.106:0/1684092509 >> v2:172.21.15.112:3300/0 conn(0x7fa65806eb70 msgr2=0x7fa6580d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65cc00640 1 --2- 172.21.15.106:0/1684092509 >> v2:172.21.15.112:3300/0 conn(0x7fa65806eb70 0x7fa6580d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65cc00640 1 -- 172.21.15.106:0/1684092509 >> v1:172.21.15.106:6789/0 conn(0x7fa65813f140 legacy=0x7fa6580b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65cc00640 1 -- 172.21.15.106:0/1684092509 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6580b3ff0 con 0x7fa65813ed60 2024-04-26T21:18:13.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65cc00640 1 --2- 172.21.15.106:0/1684092509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65813ed60 0x7fa65815c3e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa6580cdcb0 tx=0x7fa64801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c618f47408516138 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa657e00640 1 -- 172.21.15.106:0/1684092509 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480b0070 con 0x7fa65813ed60 2024-04-26T21:18:13.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa657e00640 1 -- 172.21.15.106:0/1684092509 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6480ab600 con 0x7fa65813ed60 2024-04-26T21:18:13.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa657e00640 1 -- 172.21.15.106:0/1684092509 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480ab9d0 con 0x7fa65813ed60 2024-04-26T21:18:13.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65f600640 1 -- 172.21.15.106:0/1684092509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65813ed60 msgr2=0x7fa65815c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65f600640 1 --2- 172.21.15.106:0/1684092509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65813ed60 0x7fa65815c3e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa6580cdcb0 tx=0x7fa64801c360 comp rx=0 tx=0).stop 2024-04-26T21:18:13.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65f600640 1 -- 172.21.15.106:0/1684092509 shutdown_connections 2024-04-26T21:18:13.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65f600640 1 --2- 172.21.15.106:0/1684092509 >> v2:172.21.15.112:3300/0 conn(0x7fa65806eb70 0x7fa6580d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65f600640 1 --2- 172.21.15.106:0/1684092509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65813ed60 0x7fa65815c3e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65f600640 1 -- 172.21.15.106:0/1684092509 >> 172.21.15.106:0/1684092509 conn(0x7fa658068340 msgr2=0x7fa658068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:13.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.794+0000 7fa65f600640 1 -- 172.21.15.106:0/1684092509 shutdown_connections 2024-04-26T21:18:13.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65f600640 1 -- 172.21.15.106:0/1684092509 wait complete. 2024-04-26T21:18:13.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65f600640 1 Processor -- start 2024-04-26T21:18:13.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65f600640 1 -- start start 2024-04-26T21:18:13.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65f600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa65813ed60 0x7fa65813d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65f600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580ad050 0x7fa6580ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65f600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6580b1a50 0x7fa6580b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65f600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa6581607b0 con 0x7fa6580b1a50 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65f600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa658160630 con 0x7fa6580ad050 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65f600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa658168b60 con 0x7fa65813ed60 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65d600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6580b1a50 0x7fa6580b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65d600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6580b1a50 0x7fa6580b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56062/0 (socket says 172.21.15.106:56062) 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65d600640 1 -- 172.21.15.106:0/672449449 learned_addr learned my addr 172.21.15.106:0/672449449 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65cc00640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa65813ed60 0x7fa65813d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa64fe00640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580ad050 0x7fa6580ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65d600640 1 -- 172.21.15.106:0/672449449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa65813ed60 msgr2=0x7fa65813d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65d600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa65813ed60 0x7fa65813d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65d600640 1 -- 172.21.15.106:0/672449449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580ad050 msgr2=0x7fa6580ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65d600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580ad050 0x7fa6580ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65d600640 1 -- 172.21.15.106:0/672449449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6580b27c0 con 0x7fa6580b1a50 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.798+0000 7fa65d600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6580b1a50 0x7fa6580b1ed0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa650007ea0 tx=0x7fa650007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa655600640 1 -- 172.21.15.106:0/672449449 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650014420 con 0x7fa6580b1a50 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa655600640 1 -- 172.21.15.106:0/672449449 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650019070 con 0x7fa6580b1a50 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6580aa8a0 con 0x7fa6580b1a50 2024-04-26T21:18:13.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa655600640 1 -- 172.21.15.106:0/672449449 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650014800 con 0x7fa6580b1a50 2024-04-26T21:18:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6580aae60 con 0x7fa6580b1a50 2024-04-26T21:18:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa658069400 con 0x7fa6580b1a50 2024-04-26T21:18:13.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa655600640 1 -- 172.21.15.106:0/672449449 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6500149a0 con 0x7fa6580b1a50 2024-04-26T21:18:13.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa655600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa634068380 0x7fa63406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:13.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa655600640 1 -- 172.21.15.106:0/672449449 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7fa6500872e0 con 0x7fa6580b1a50 2024-04-26T21:18:13.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa65cc00640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa634068380 0x7fa63406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:13.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.802+0000 7fa65cc00640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa634068380 0x7fa63406a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa6480ad000 tx=0x7fa6480a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:13.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.806+0000 7fa655600640 1 -- 172.21.15.106:0/672449449 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa650057040 con 0x7fa6580b1a50 2024-04-26T21:18:13.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.966+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa658068bf0 con 0x7fa6580b1a50 2024-04-26T21:18:13.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.966+0000 7fa655600640 1 -- 172.21.15.106:0/672449449 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+17114 (secure 0 0 0) 0x7fa65005b340 con 0x7fa6580b1a50 2024-04-26T21:18:13.974 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:13.974 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:18:06.945586+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:17:40.370502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T21:17:41.669690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6836/1043820033":"2024-04-27T21:18:06.945562+0000","172.21.15.106:6834/1043820033":"2024-04-27T21:18:06.945562+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:18:13.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa634068380 msgr2=0x7fa63406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa634068380 0x7fa63406a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa6480ad000 tx=0x7fa6480a6000 comp rx=0 tx=0).stop 2024-04-26T21:18:13.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6580b1a50 msgr2=0x7fa6580b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:13.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6580b1a50 0x7fa6580b1ed0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa650007ea0 tx=0x7fa650007f90 comp rx=0 tx=0).stop 2024-04-26T21:18:13.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 shutdown_connections 2024-04-26T21:18:13.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580ad050 0x7fa6580ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa634068380 0x7fa63406a840 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6580b1a50 0x7fa6580b1ed0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 --2- 172.21.15.106:0/672449449 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa65813ed60 0x7fa65813d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:13.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 >> 172.21.15.106:0/672449449 conn(0x7fa658068340 msgr2=0x7fa65806f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:13.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 shutdown_connections 2024-04-26T21:18:13.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:13.970+0000 7fa65f600640 1 -- 172.21.15.106:0/672449449 wait complete. 2024-04-26T21:18:13.992 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:17:40.370502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:17:41.669690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:18:13.993 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:18:14.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.126+0000 7f9dd9a00640 1 Processor -- start 2024-04-26T21:18:14.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.126+0000 7f9dd9a00640 1 -- start start 2024-04-26T21:18:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.126+0000 7f9dd9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd40b5260 0x7f9dd415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.126+0000 7f9dd9a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9dd415de50 0x7f9dd4166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.126+0000 7f9dd9a00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd40b44a0 con 0x7f9dd415d530 2024-04-26T21:18:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.126+0000 7f9dd9a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd40b4780 con 0x7f9dd415de50 2024-04-26T21:18:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.126+0000 7f9dd9a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd40b4a60 con 0x7f9dd40b5260 2024-04-26T21:18:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd3400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9dd415de50 0x7f9dd4166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd3400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9dd415de50 0x7f9dd4166ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56068/0 (socket says 172.21.15.106:56068) 2024-04-26T21:18:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd3400640 1 -- 172.21.15.106:0/2262462780 learned_addr learned my addr 172.21.15.106:0/2262462780 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:14.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd3400640 1 -- 172.21.15.106:0/2262462780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd40b5260 msgr2=0x7f9dd415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:14.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dca000640 1 --2- 172.21.15.106:0/2262462780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd40b5260 0x7f9dd415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd3400640 1 --2- 172.21.15.106:0/2262462780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd40b5260 0x7f9dd415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd3400640 1 -- 172.21.15.106:0/2262462780 >> v1:172.21.15.112:6789/0 conn(0x7f9dd415d530 legacy=0x7f9dd40cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:14.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd3400640 1 -- 172.21.15.106:0/2262462780 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd40b4d40 con 0x7f9dd415de50 2024-04-26T21:18:14.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dca000640 1 --2- 172.21.15.106:0/2262462780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd40b5260 0x7f9dd415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:14.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd3400640 1 --2- 172.21.15.106:0/2262462780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd415de50 0x7f9dd4166ae0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009870 tx=0x7f9dcc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb83bf979f22f779 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:14.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd2000640 1 -- 172.21.15.106:0/2262462780 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0ab660 con 0x7f9dd415de50 2024-04-26T21:18:14.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd2000640 1 -- 172.21.15.106:0/2262462780 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dcc0b0070 con 0x7f9dd415de50 2024-04-26T21:18:14.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.130+0000 7f9dd2000640 1 -- 172.21.15.106:0/2262462780 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0aba20 con 0x7f9dd415de50 2024-04-26T21:18:14.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 -- 172.21.15.106:0/2262462780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd415de50 msgr2=0x7f9dd4166ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 --2- 172.21.15.106:0/2262462780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd415de50 0x7f9dd4166ae0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009870 tx=0x7f9dcc01c520 comp rx=0 tx=0).stop 2024-04-26T21:18:14.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 -- 172.21.15.106:0/2262462780 shutdown_connections 2024-04-26T21:18:14.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 --2- 172.21.15.106:0/2262462780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd415de50 0x7f9dd4166ae0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 --2- 172.21.15.106:0/2262462780 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd40b5260 0x7f9dd415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 -- 172.21.15.106:0/2262462780 >> 172.21.15.106:0/2262462780 conn(0x7f9dd40b2910 msgr2=0x7f9dd40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 -- 172.21.15.106:0/2262462780 shutdown_connections 2024-04-26T21:18:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 -- 172.21.15.106:0/2262462780 wait complete. 2024-04-26T21:18:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 Processor -- start 2024-04-26T21:18:14.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 -- start start 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd40b5260 0x7f9dd4139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd415d530 0x7f9dd4157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd415de50 0x7f9dd4157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd40d06b0 con 0x7f9dd40b5260 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd40d0530 con 0x7f9dd415d530 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd9a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd4169840 con 0x7f9dd415de50 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd40b5260 0x7f9dd4139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd40b5260 0x7f9dd4139be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56070/0 (socket says 172.21.15.106:56070) 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd2a00640 1 -- 172.21.15.106:0/3225715317 learned_addr learned my addr 172.21.15.106:0/3225715317 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd3400640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd415de50 0x7f9dd4157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dca000640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd415d530 0x7f9dd4157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd2a00640 1 -- 172.21.15.106:0/3225715317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd415de50 msgr2=0x7f9dd4157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd2a00640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd415de50 0x7f9dd4157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd2a00640 1 -- 172.21.15.106:0/3225715317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd415d530 msgr2=0x7f9dd4157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd2a00640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd415d530 0x7f9dd4157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dd2a00640 1 -- 172.21.15.106:0/3225715317 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd413a390 con 0x7f9dd40b5260 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.134+0000 7f9dca000640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd415d530 0x7f9dd4157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dd2a00640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd40b5260 0x7f9dd4139be0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c7c0 tx=0x7f9dc400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dcb400640 1 -- 172.21.15.106:0/3225715317 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4016020 con 0x7f9dd40b5260 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dcb400640 1 -- 172.21.15.106:0/3225715317 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc400aa50 con 0x7f9dd40b5260 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd413a670 con 0x7f9dd40b5260 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dcb400640 1 -- 172.21.15.106:0/3225715317 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4012420 con 0x7f9dd40b5260 2024-04-26T21:18:14.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd413ac30 con 0x7f9dd40b5260 2024-04-26T21:18:14.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd4069400 con 0x7f9dd40b5260 2024-04-26T21:18:14.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dcb400640 1 -- 172.21.15.106:0/3225715317 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9dc4019020 con 0x7f9dd40b5260 2024-04-26T21:18:14.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dcb400640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9db0068380 0x7f9db006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dcb400640 1 -- 172.21.15.106:0/3225715317 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f9dc4086c10 con 0x7f9dd40b5260 2024-04-26T21:18:14.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.138+0000 7f9dca000640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9db0068380 0x7f9db006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.142+0000 7f9dca000640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9db0068380 0x7f9db006a840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc006fd0 tx=0x7f9dbc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:14.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.142+0000 7f9dcb400640 1 -- 172.21.15.106:0/3225715317 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9dc4020030 con 0x7f9dd40b5260 2024-04-26T21:18:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.298+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9dd413fb30 con 0x7f9dd40b5260 2024-04-26T21:18:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.298+0000 7f9dcb400640 1 -- 172.21.15.106:0/3225715317 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) ==== 93+0+10 (secure 0 0 0) 0x7f9dc4056f30 con 0x7f9dd40b5260 2024-04-26T21:18:14.304 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9db0068380 msgr2=0x7f9db006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9db0068380 0x7f9db006a840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc006fd0 tx=0x7f9dbc008040 comp rx=0 tx=0).stop 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd40b5260 msgr2=0x7f9dd4139be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd40b5260 0x7f9dd4139be0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c7c0 tx=0x7f9dc400cc80 comp rx=0 tx=0).stop 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 shutdown_connections 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd415d530 0x7f9dd4157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9db0068380 0x7f9db006a840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9dd415de50 0x7f9dd4157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 --2- 172.21.15.106:0/3225715317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dd40b5260 0x7f9dd4139be0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 >> 172.21.15.106:0/3225715317 conn(0x7f9dd40b2910 msgr2=0x7f9dd40b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 shutdown_connections 2024-04-26T21:18:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.302+0000 7f9dd9a00640 1 -- 172.21.15.106:0/3225715317 wait complete. 2024-04-26T21:18:14.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:18:14.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.462+0000 7f79b1400640 1 Processor -- start 2024-04-26T21:18:14.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.462+0000 7f79b1400640 1 -- start start 2024-04-26T21:18:14.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.462+0000 7f79b1400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac15ea90 0x7f79ac166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.462+0000 7f79b1400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ac0b4f00 con 0x7f79ac15d080 2024-04-26T21:18:14.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.462+0000 7f79b1400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ac0b51e0 con 0x7f79ac15c4e0 2024-04-26T21:18:14.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.462+0000 7f79b1400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac15d5f0 con 0x7f79ac15ea90 2024-04-26T21:18:14.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a1e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f79ac15d080 0x7f79ac0b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53722/0 (socket says 172.21.15.106:53722) 2024-04-26T21:18:14.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a1e00640 1 -- 172.21.15.106:0/660655341 learned_addr learned my addr 172.21.15.106:0/660655341 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79ab200640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac15ea90 0x7f79ac166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89368320 0 0) 0x7f79ac0b4f00 con 0x7f79ac15d080 2024-04-26T21:18:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7990003530 con 0x7f79ac15d080 2024-04-26T21:18:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3454050103 0 0) 0x7f7990003530 con 0x7f79ac15d080 2024-04-26T21:18:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac15ea90 msgr2=0x7f79ac166db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac15ea90 0x7f79ac166db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 >> v1:172.21.15.112:6789/0 conn(0x7f79ac15c4e0 legacy=0x7f79ac15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac0b54c0 con 0x7f79ac15d080 2024-04-26T21:18:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f7994001680 con 0x7f79ac15d080 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 >> v1:172.21.15.106:6789/0 conn(0x7f79ac15d080 legacy=0x7f79ac0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79900039f0 0x7f7990003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7990004810 0x7f7990004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac15ea90 0x7f79900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac15d5f0 con 0x7f7990004810 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f799000bab0 con 0x7f79900039f0 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f799000bcb0 con 0x7f79ac15ea90 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a1e00640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7990004810 0x7f7990004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79aa800640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79900039f0 0x7f7990003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79ab200640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac15ea90 0x7f79900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a1e00640 1 -- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac15ea90 msgr2=0x7f79900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a1e00640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac15ea90 0x7f79900051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a1e00640 1 -- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79900039f0 msgr2=0x7f7990003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a1e00640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79900039f0 0x7f7990003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.466+0000 7f79a1e00640 1 -- 172.21.15.106:0/660655341 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7990003530 con 0x7f7990004810 2024-04-26T21:18:14.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79a1e00640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7990004810 0x7f7990004c90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7994001ec0 tx=0x7f799401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feae213eb98055c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:14.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994007d40 con 0x7f7990004810 2024-04-26T21:18:14.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7994005b00 con 0x7f7990004810 2024-04-26T21:18:14.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79a9e00640 1 -- 172.21.15.106:0/660655341 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994007070 con 0x7f7990004810 2024-04-26T21:18:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 -- 172.21.15.106:0/660655341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7990004810 msgr2=0x7f7990004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 --2- 172.21.15.106:0/660655341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7990004810 0x7f7990004c90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7994001ec0 tx=0x7f799401f370 comp rx=0 tx=0).stop 2024-04-26T21:18:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79ab200640 1 -- 172.21.15.106:0/660655341 reap_dead start 2024-04-26T21:18:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 -- 172.21.15.106:0/660655341 shutdown_connections 2024-04-26T21:18:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 -- 172.21.15.106:0/660655341 >> 172.21.15.106:0/660655341 conn(0x7f79ac0b2910 msgr2=0x7f79ac0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 -- 172.21.15.106:0/660655341 shutdown_connections 2024-04-26T21:18:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 -- 172.21.15.106:0/660655341 wait complete. 2024-04-26T21:18:14.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 Processor -- start 2024-04-26T21:18:14.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 -- start start 2024-04-26T21:18:14.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7990004810 0x7f79ac13c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac163dc0 0x7f79ac164240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac0d0430 0x7f79ac0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac164da0 con 0x7f79ac0d0430 2024-04-26T21:18:14.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac145ba0 con 0x7f7990004810 2024-04-26T21:18:14.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.470+0000 7f79b1400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac164f20 con 0x7f79ac163dc0 2024-04-26T21:18:14.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79ab200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac0d0430 0x7f79ac0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79ab200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac0d0430 0x7f79ac0d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56080/0 (socket says 172.21.15.106:56080) 2024-04-26T21:18:14.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79ab200640 1 -- 172.21.15.106:0/2759438971 learned_addr learned my addr 172.21.15.106:0/2759438971 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79ab200640 1 -- 172.21.15.106:0/2759438971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac163dc0 msgr2=0x7f79ac164240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79ab200640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac163dc0 0x7f79ac164240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79ab200640 1 -- 172.21.15.106:0/2759438971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7990004810 msgr2=0x7f79ac13c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79ab200640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7990004810 0x7f79ac13c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79ab200640 1 -- 172.21.15.106:0/2759438971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac1f8e10 con 0x7f79ac0d0430 2024-04-26T21:18:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79ab200640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac0d0430 0x7f79ac0d08e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f79a4011860 tx=0x7f79a4011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79a3400640 1 -- 172.21.15.106:0/2759438971 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4004240 con 0x7f79ac0d0430 2024-04-26T21:18:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79a3400640 1 -- 172.21.15.106:0/2759438971 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a401b070 con 0x7f79ac0d0430 2024-04-26T21:18:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79a3400640 1 -- 172.21.15.106:0/2759438971 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a400f7a0 con 0x7f79ac0d0430 2024-04-26T21:18:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac1f9080 con 0x7f79ac0d0430 2024-04-26T21:18:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac1f9640 con 0x7f79ac0d0430 2024-04-26T21:18:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ac069400 con 0x7f79ac0d0430 2024-04-26T21:18:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79a3400640 1 -- 172.21.15.106:0/2759438971 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79a4012040 con 0x7f79ac0d0430 2024-04-26T21:18:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.474+0000 7f79a3400640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79880683b0 0x7f798806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.478+0000 7f79a3400640 1 -- 172.21.15.106:0/2759438971 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f79a4086ab0 con 0x7f79ac0d0430 2024-04-26T21:18:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.478+0000 7f79aa800640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79880683b0 0x7f798806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.478+0000 7f79aa800640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79880683b0 0x7f798806a870 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79ac141a20 tx=0x7f799c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:14.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.478+0000 7f79a3400640 1 -- 172.21.15.106:0/2759438971 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f79a4056dd0 con 0x7f79ac0d0430 2024-04-26T21:18:14.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79ac06fb90 con 0x7f79ac0d0430 2024-04-26T21:18:14.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79a3400640 1 -- 172.21.15.106:0/2759438971 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) ==== 104+0+11 (secure 0 0 0) 0x7f79a401ee40 con 0x7f79ac0d0430 2024-04-26T21:18:14.640 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:18:14.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79880683b0 msgr2=0x7f798806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79880683b0 0x7f798806a870 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79ac141a20 tx=0x7f799c009040 comp rx=0 tx=0).stop 2024-04-26T21:18:14.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac0d0430 msgr2=0x7f79ac0d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac0d0430 0x7f79ac0d08e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f79a4011860 tx=0x7f79a4011d20 comp rx=0 tx=0).stop 2024-04-26T21:18:14.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 shutdown_connections 2024-04-26T21:18:14.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f79880683b0 0x7f798806a870 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac0d0430 0x7f79ac0d08e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f79ac163dc0 0x7f79ac164240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 --2- 172.21.15.106:0/2759438971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7990004810 0x7f79ac13c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 >> 172.21.15.106:0/2759438971 conn(0x7f79ac0b2910 msgr2=0x7f79ac06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:14.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 shutdown_connections 2024-04-26T21:18:14.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.638+0000 7f79b1400640 1 -- 172.21.15.106:0/2759438971 wait complete. 2024-04-26T21:18:14.661 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:18:14.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.794+0000 7f5148400640 1 Processor -- start 2024-04-26T21:18:14.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.794+0000 7f5148400640 1 -- start start 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5148400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5140159890 0x7f5140071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5148400640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51400ae8d0 0x7f51400b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5148400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5140072af0 con 0x7f51400aed30 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5148400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f51400b3e20 con 0x7f5140159890 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5148400640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f51400b43c0 con 0x7f51400ae8d0 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5145a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5140159890 0x7f5140071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5146400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f51400aed30 0x7f51400b4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53734/0 (socket says 172.21.15.106:53734) 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5145a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5140159890 0x7f5140071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56086/0 (socket says 172.21.15.106:56086) 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5146400640 1 -- 172.21.15.106:0/4240737238 learned_addr learned my addr 172.21.15.106:0/4240737238 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5145a00640 1 -- 172.21.15.106:0/4240737238 >> v2:172.21.15.112:3300/0 conn(0x7f51400ae8d0 msgr2=0x7f51400b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5145000640 1 --2- 172.21.15.106:0/4240737238 >> v2:172.21.15.112:3300/0 conn(0x7f51400ae8d0 0x7f51400b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5145a00640 1 --2- 172.21.15.106:0/4240737238 >> v2:172.21.15.112:3300/0 conn(0x7f51400ae8d0 0x7f51400b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5145a00640 1 -- 172.21.15.106:0/4240737238 >> v1:172.21.15.106:6789/0 conn(0x7f51400aed30 legacy=0x7f51400b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f5145a00640 1 -- 172.21.15.106:0/4240737238 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5140072dd0 con 0x7f5140159890 2024-04-26T21:18:14.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.798+0000 7f513fe00640 1 -- 172.21.15.106:0/4240737238 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940731999 0 0) 0x7f5140072af0 con 0x7f51400aed30 2024-04-26T21:18:14.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5145a00640 1 --2- 172.21.15.106:0/4240737238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 0x7f5140071f90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5140070020 tx=0x7f513401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5bc9e234db18fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:14.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f513fe00640 1 -- 172.21.15.106:0/4240737238 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51340b4070 con 0x7f5140159890 2024-04-26T21:18:14.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f513fe00640 1 -- 172.21.15.106:0/4240737238 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51340af600 con 0x7f5140159890 2024-04-26T21:18:14.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f513fe00640 1 -- 172.21.15.106:0/4240737238 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51340af9d0 con 0x7f5140159890 2024-04-26T21:18:14.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 -- 172.21.15.106:0/4240737238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 msgr2=0x7f5140071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 --2- 172.21.15.106:0/4240737238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 0x7f5140071f90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5140070020 tx=0x7f513401f110 comp rx=0 tx=0).stop 2024-04-26T21:18:14.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 -- 172.21.15.106:0/4240737238 shutdown_connections 2024-04-26T21:18:14.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 --2- 172.21.15.106:0/4240737238 >> v2:172.21.15.112:3300/0 conn(0x7f51400ae8d0 0x7f51400b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 --2- 172.21.15.106:0/4240737238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 0x7f5140071f90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 -- 172.21.15.106:0/4240737238 >> 172.21.15.106:0/4240737238 conn(0x7f51400b2910 msgr2=0x7f51400b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:14.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 -- 172.21.15.106:0/4240737238 shutdown_connections 2024-04-26T21:18:14.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 -- 172.21.15.106:0/4240737238 wait complete. 2024-04-26T21:18:14.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 Processor -- start 2024-04-26T21:18:14.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 -- start start 2024-04-26T21:18:14.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51400ae8d0 0x7f51401574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51400aed30 0x7f5140153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 0x7f5140151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f51400730b0 con 0x7f5140159890 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5140160580 con 0x7f51400aed30 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5148400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f51400724d0 con 0x7f51400ae8d0 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5146400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 0x7f5140151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5146400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 0x7f5140151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56100/0 (socket says 172.21.15.106:56100) 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.802+0000 7f5146400640 1 -- 172.21.15.106:0/2235625007 learned_addr learned my addr 172.21.15.106:0/2235625007 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5145a00640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51400ae8d0 0x7f51401574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5145000640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51400aed30 0x7f5140153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5146400640 1 -- 172.21.15.106:0/2235625007 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51400ae8d0 msgr2=0x7f51401574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5146400640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51400ae8d0 0x7f51401574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5146400640 1 -- 172.21.15.106:0/2235625007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51400aed30 msgr2=0x7f5140153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5146400640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51400aed30 0x7f5140153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5146400640 1 -- 172.21.15.106:0/2235625007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5140154620 con 0x7f5140159890 2024-04-26T21:18:14.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5146400640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 0x7f5140151d30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f513800c480 tx=0x7f513800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:14.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f513d600640 1 -- 172.21.15.106:0/2235625007 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138018070 con 0x7f5140159890 2024-04-26T21:18:14.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f513d600640 1 -- 172.21.15.106:0/2235625007 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51380074e0 con 0x7f5140159890 2024-04-26T21:18:14.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5140150f70 con 0x7f5140159890 2024-04-26T21:18:14.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f513d600640 1 -- 172.21.15.106:0/2235625007 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138004a30 con 0x7f5140159890 2024-04-26T21:18:14.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5140151530 con 0x7f5140159890 2024-04-26T21:18:14.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5140069400 con 0x7f5140159890 2024-04-26T21:18:14.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f513d600640 1 -- 172.21.15.106:0/2235625007 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f513801b070 con 0x7f5140159890 2024-04-26T21:18:14.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f513d600640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5120068380 0x7f512006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:14.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f513d600640 1 -- 172.21.15.106:0/2235625007 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f5138085ef0 con 0x7f5140159890 2024-04-26T21:18:14.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.806+0000 7f5145a00640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5120068380 0x7f512006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:14.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.810+0000 7f5145a00640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5120068380 0x7f512006a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51340b1000 tx=0x7f51340aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:14.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.810+0000 7f513d600640 1 -- 172.21.15.106:0/2235625007 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f51380562a0 con 0x7f5140159890 2024-04-26T21:18:14.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.966+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f51400b4cd0 con 0x7f5140159890 2024-04-26T21:18:14.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.966+0000 7f513d600640 1 -- 172.21.15.106:0/2235625007 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) ==== 100+0+11 (secure 0 0 0) 0x7f5138055ba0 con 0x7f5140159890 2024-04-26T21:18:14.971 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:18:14.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5120068380 msgr2=0x7f512006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5120068380 0x7f512006a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51340b1000 tx=0x7f51340aa000 comp rx=0 tx=0).stop 2024-04-26T21:18:14.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 msgr2=0x7f5140151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 0x7f5140151d30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f513800c480 tx=0x7f513800c940 comp rx=0 tx=0).stop 2024-04-26T21:18:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 shutdown_connections 2024-04-26T21:18:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51400aed30 0x7f5140153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f5120068380 0x7f512006a840 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5140159890 0x7f5140151d30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 --2- 172.21.15.106:0/2235625007 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51400ae8d0 0x7f51401574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 >> 172.21.15.106:0/2235625007 conn(0x7f51400b2910 msgr2=0x7f51400b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 shutdown_connections 2024-04-26T21:18:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:14.970+0000 7f5148400640 1 -- 172.21.15.106:0/2235625007 wait complete. 2024-04-26T21:18:14.993 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:18:15.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.126+0000 7f49ff800640 1 Processor -- start 2024-04-26T21:18:15.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.126+0000 7f49ff800640 1 -- start start 2024-04-26T21:18:15.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49ff800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8148a90 0x7f49f80724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49ff800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f49f8070120 0x7f49f80b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49ff800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f8072b00 con 0x7f49f80b4420 2024-04-26T21:18:15.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49ff800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f49f80af1b0 con 0x7f49f8070120 2024-04-26T21:18:15.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49ff800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f49f8148e70 con 0x7f49f8148a90 2024-04-26T21:18:15.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49efe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f49f8070120 0x7f49f80b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49efe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f49f8070120 0x7f49f80b3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56114/0 (socket says 172.21.15.106:56114) 2024-04-26T21:18:15.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49efe00640 1 -- 172.21.15.106:0/4245633813 learned_addr learned my addr 172.21.15.106:0/4245633813 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:15.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49fd800640 1 --1- 172.21.15.106:0/4245633813 >> v1:172.21.15.106:6789/0 conn(0x7f49f80b4420 0x7f49f80af640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53740/0 (socket says 172.21.15.106:53740) 2024-04-26T21:18:15.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49fce00640 1 --2- 172.21.15.106:0/4245633813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8148a90 0x7f49f80724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49efe00640 1 -- 172.21.15.106:0/4245633813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8148a90 msgr2=0x7f49f80724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:15.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49efe00640 1 --2- 172.21.15.106:0/4245633813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8148a90 0x7f49f80724d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49efe00640 1 -- 172.21.15.106:0/4245633813 >> v1:172.21.15.106:6789/0 conn(0x7f49f80b4420 legacy=0x7f49f80af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49efe00640 1 -- 172.21.15.106:0/4245633813 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f8072de0 con 0x7f49f8070120 2024-04-26T21:18:15.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.130+0000 7f49f7e00640 1 -- 172.21.15.106:0/4245633813 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842385521 0 0) 0x7f49f8072b00 con 0x7f49f80b4420 2024-04-26T21:18:15.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49efe00640 1 --2- 172.21.15.106:0/4245633813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f8070120 0x7f49f80b3ee0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009870 tx=0x7f49e001cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e8ad2263de7484 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:15.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49f7e00640 1 -- 172.21.15.106:0/4245633813 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e00aa620 con 0x7f49f8070120 2024-04-26T21:18:15.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49f7e00640 1 -- 172.21.15.106:0/4245633813 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e00af070 con 0x7f49f8070120 2024-04-26T21:18:15.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49f7e00640 1 -- 172.21.15.106:0/4245633813 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e00aa9e0 con 0x7f49f8070120 2024-04-26T21:18:15.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 -- 172.21.15.106:0/4245633813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f8070120 msgr2=0x7f49f80b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 --2- 172.21.15.106:0/4245633813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f8070120 0x7f49f80b3ee0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009870 tx=0x7f49e001cf00 comp rx=0 tx=0).stop 2024-04-26T21:18:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 -- 172.21.15.106:0/4245633813 shutdown_connections 2024-04-26T21:18:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 --2- 172.21.15.106:0/4245633813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f8070120 0x7f49f80b3ee0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 --2- 172.21.15.106:0/4245633813 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8148a90 0x7f49f80724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 -- 172.21.15.106:0/4245633813 >> 172.21.15.106:0/4245633813 conn(0x7f49f806e440 msgr2=0x7f49f806e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 -- 172.21.15.106:0/4245633813 shutdown_connections 2024-04-26T21:18:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 -- 172.21.15.106:0/4245633813 wait complete. 2024-04-26T21:18:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 Processor -- start 2024-04-26T21:18:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.134+0000 7f49ff800640 1 -- start start 2024-04-26T21:18:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49ff800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8070120 0x7f49f815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49ff800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f80b4420 0x7f49f812a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49ff800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8148a90 0x7f49f8163d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49ff800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80afed0 con 0x7f49f80b4420 2024-04-26T21:18:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49ff800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80afd50 con 0x7f49f8070120 2024-04-26T21:18:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49ff800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f49f816bfa0 con 0x7f49f8148a90 2024-04-26T21:18:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49efe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f80b4420 0x7f49f812a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49efe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f80b4420 0x7f49f812a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56118/0 (socket says 172.21.15.106:56118) 2024-04-26T21:18:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49efe00640 1 -- 172.21.15.106:0/1942946987 learned_addr learned my addr 172.21.15.106:0/1942946987 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49efe00640 1 -- 172.21.15.106:0/1942946987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8148a90 msgr2=0x7f49f8163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49efe00640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8148a90 0x7f49f8163d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49fce00640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8070120 0x7f49f815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49efe00640 1 -- 172.21.15.106:0/1942946987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8070120 msgr2=0x7f49f815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49efe00640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8070120 0x7f49f815ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49efe00640 1 -- 172.21.15.106:0/1942946987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f815f0f0 con 0x7f49f80b4420 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49fce00640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8070120 0x7f49f815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49efe00640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f80b4420 0x7f49f812a850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f49e00ac040 tx=0x7f49e001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49f5600640 1 -- 172.21.15.106:0/1942946987 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e00aace0 con 0x7f49f80b4420 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49f5600640 1 -- 172.21.15.106:0/1942946987 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e00bd3f0 con 0x7f49f80b4420 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49f5600640 1 -- 172.21.15.106:0/1942946987 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e00bd7e0 con 0x7f49f80b4420 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f813f4e0 con 0x7f49f80b4420 2024-04-26T21:18:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f813faa0 con 0x7f49f80b4420 2024-04-26T21:18:15.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f8069400 con 0x7f49f80b4420 2024-04-26T21:18:15.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.138+0000 7f49f5600640 1 -- 172.21.15.106:0/1942946987 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49e00b33f0 con 0x7f49f80b4420 2024-04-26T21:18:15.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.142+0000 7f49f5600640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f49d4068380 0x7f49d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.142+0000 7f49f5600640 1 -- 172.21.15.106:0/1942946987 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f49e0120460 con 0x7f49f80b4420 2024-04-26T21:18:15.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.142+0000 7f49fce00640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f49d4068380 0x7f49d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.142+0000 7f49fce00640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f49d4068380 0x7f49d406a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009a40 tx=0x7f49e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.146+0000 7f49f5600640 1 -- 172.21.15.106:0/1942946987 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f49e00c6020 con 0x7f49f80b4420 2024-04-26T21:18:15.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.314+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f49f8070aa0 con 0x7f49f80b4420 2024-04-26T21:18:15.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.314+0000 7f49f5600640 1 -- 172.21.15.106:0/1942946987 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v44) ==== 80+0+124 (secure 0 0 0) 0x7f49e0016150 con 0x7f49f80b4420 2024-04-26T21:18:15.318 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106:6836/1043820033 2024-04-27T21:18:06.945562+0000 2024-04-26T21:18:15.319 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106:6834/1043820033 2024-04-27T21:18:06.945562+0000 2024-04-26T21:18:15.319 INFO:teuthology.orchestra.run.smithi106.stderr:listed 2 entries 2024-04-26T21:18:15.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f49d4068380 msgr2=0x7f49d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f49d4068380 0x7f49d406a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009a40 tx=0x7f49e8008040 comp rx=0 tx=0).stop 2024-04-26T21:18:15.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f80b4420 msgr2=0x7f49f812a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f80b4420 0x7f49f812a850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f49e00ac040 tx=0x7f49e001ace0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 shutdown_connections 2024-04-26T21:18:15.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f49d4068380 0x7f49d406a840 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f49f8148a90 0x7f49f8163d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49f80b4420 0x7f49f812a850 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 --2- 172.21.15.106:0/1942946987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49f8070120 0x7f49f815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 >> 172.21.15.106:0/1942946987 conn(0x7f49f806e440 msgr2=0x7f49f8160d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:15.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 shutdown_connections 2024-04-26T21:18:15.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.318+0000 7f49ff800640 1 -- 172.21.15.106:0/1942946987 wait complete. 2024-04-26T21:18:15.341 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi106.front.sepia.ceph.com... 2024-04-26T21:18:15.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:15.342 DEBUG:teuthology.orchestra.run.smithi106:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T21:18:15.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi106.stderr:ceph-fuse[38903]: fuse finished with error 0 and tester_r 0 2024-04-26T21:18:15.363 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:18:15.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:15.363 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T21:18:15.416 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T21:18:15.416 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:18:15.416 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:18:15.425 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350236k,nr_inodes=4087559,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5493 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T21:18:15.425 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T21:18:15.425 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:18:15.425 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:18:15.467 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350300k,nr_inodes=4087575,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2516 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T21:18:15.467 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T21:18:15.467 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:18:15.467 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:18:15.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350236k,nr_inodes=4087559,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5493 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T21:18:15.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:18:15.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.642+0000 7f6331800640 1 Processor -- start 2024-04-26T21:18:15.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.642+0000 7f6331800640 1 -- start start 2024-04-26T21:18:15.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.642+0000 7f6331800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f632c06cb10 0x7f632c06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.642+0000 7f6331800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c06fd10 0x7f632c073040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.642+0000 7f6331800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632c070180 con 0x7f632c15cce0 2024-04-26T21:18:15.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6331800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f632c160630 con 0x7f632c06cb10 2024-04-26T21:18:15.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6331800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f632c070420 con 0x7f632c06fd10 2024-04-26T21:18:15.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6322000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f632c06cb10 0x7f632c06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6322000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f632c06cb10 0x7f632c06f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56128/0 (socket says 172.21.15.106:56128) 2024-04-26T21:18:15.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6322000640 1 -- 172.21.15.106:0/1173075993 learned_addr learned my addr 172.21.15.106:0/1173075993 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:15.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f632b400640 1 --2- 172.21.15.106:0/1173075993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c06fd10 0x7f632c073040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6322000640 1 -- 172.21.15.106:0/1173075993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c06fd10 msgr2=0x7f632c073040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:15.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6322000640 1 --2- 172.21.15.106:0/1173075993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c06fd10 0x7f632c073040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6322000640 1 -- 172.21.15.106:0/1173075993 >> v1:172.21.15.112:6789/0 conn(0x7f632c15cce0 legacy=0x7f632c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6322000640 1 -- 172.21.15.106:0/1173075993 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c162e50 con 0x7f632c06cb10 2024-04-26T21:18:15.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f6322000640 1 --2- 172.21.15.106:0/1173075993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06cb10 0x7f632c06f7d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6314009870 tx=0x7f631401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5430676d1aec8cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:15.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f632a000640 1 -- 172.21.15.106:0/1173075993 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63140b2070 con 0x7f632c06cb10 2024-04-26T21:18:15.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f632a000640 1 -- 172.21.15.106:0/1173075993 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63140a9070 con 0x7f632c06cb10 2024-04-26T21:18:15.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.646+0000 7f632a000640 1 -- 172.21.15.106:0/1173075993 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63140ad880 con 0x7f632c06cb10 2024-04-26T21:18:15.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 -- 172.21.15.106:0/1173075993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06cb10 msgr2=0x7f632c06f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 --2- 172.21.15.106:0/1173075993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06cb10 0x7f632c06f7d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6314009870 tx=0x7f631401c560 comp rx=0 tx=0).stop 2024-04-26T21:18:15.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 -- 172.21.15.106:0/1173075993 shutdown_connections 2024-04-26T21:18:15.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 --2- 172.21.15.106:0/1173075993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c06fd10 0x7f632c073040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 --2- 172.21.15.106:0/1173075993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06cb10 0x7f632c06f7d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 -- 172.21.15.106:0/1173075993 >> 172.21.15.106:0/1173075993 conn(0x7f632c068140 msgr2=0x7f632c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:15.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 -- 172.21.15.106:0/1173075993 shutdown_connections 2024-04-26T21:18:15.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 -- 172.21.15.106:0/1173075993 wait complete. 2024-04-26T21:18:15.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 Processor -- start 2024-04-26T21:18:15.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 -- start start 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f632c06cb10 0x7f632c0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06fd10 0x7f632c151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c15cce0 0x7f632c0b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f632c073d90 con 0x7f632c06fd10 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f632c162c00 con 0x7f632c06cb10 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6331800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f632c073f10 con 0x7f632c15cce0 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6322000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06fd10 0x7f632c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6322000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06fd10 0x7f632c151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56134/0 (socket says 172.21.15.106:56134) 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6322000640 1 -- 172.21.15.106:0/2874116950 learned_addr learned my addr 172.21.15.106:0/2874116950 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:15.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f632aa00640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f632c06cb10 0x7f632c0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f632b400640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c15cce0 0x7f632c0b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6322000640 1 -- 172.21.15.106:0/2874116950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c15cce0 msgr2=0x7f632c0b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6322000640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c15cce0 0x7f632c0b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6322000640 1 -- 172.21.15.106:0/2874116950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f632c06cb10 msgr2=0x7f632c0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6322000640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f632c06cb10 0x7f632c0b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6322000640 1 -- 172.21.15.106:0/2874116950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c15e550 con 0x7f632c06fd10 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.650+0000 7f6322000640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06fd10 0x7f632c151770 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f63140b0040 tx=0x7f6314019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f6323400640 1 -- 172.21.15.106:0/2874116950 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63140b2040 con 0x7f632c06fd10 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f6323400640 1 -- 172.21.15.106:0/2874116950 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63140bb070 con 0x7f632c06fd10 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f6323400640 1 -- 172.21.15.106:0/2874116950 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63140b6440 con 0x7f632c06fd10 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c1528c0 con 0x7f632c06fd10 2024-04-26T21:18:15.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c152e80 con 0x7f632c06fd10 2024-04-26T21:18:15.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c069400 con 0x7f632c06fd10 2024-04-26T21:18:15.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f6323400640 1 -- 172.21.15.106:0/2874116950 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63140ab070 con 0x7f632c06fd10 2024-04-26T21:18:15.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f6323400640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6308068380 0x7f630806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:15.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f6323400640 1 -- 172.21.15.106:0/2874116950 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f63141204c0 con 0x7f632c06fd10 2024-04-26T21:18:15.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f632aa00640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6308068380 0x7f630806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:15.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.654+0000 7f632aa00640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6308068380 0x7f630806a840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f632c162bd0 tx=0x7f631c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:15.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.658+0000 7f6323400640 1 -- 172.21.15.106:0/2874116950 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f632c15e550 con 0x7f632c06fd10 2024-04-26T21:18:15.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.846+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f632c1530c0 con 0x7f632c06fd10 2024-04-26T21:18:15.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6323400640 1 -- 172.21.15.106:0/2874116950 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5183 (secure 0 0 0) 0x7f6314016150 con 0x7f632c06fd10 2024-04-26T21:18:15.852 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:15.852 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/791761080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":791761080},{"type":"v1","addr":"172.21.15.106:6836","nonce":791761080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:18:10.975225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5413,"qdb_cluster":[5413]},"id":2}]} 2024-04-26T21:18:15.853 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 24 2024-04-26T21:18:15.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6308068380 msgr2=0x7f630806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6308068380 0x7f630806a840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f632c162bd0 tx=0x7f631c009040 comp rx=0 tx=0).stop 2024-04-26T21:18:15.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06fd10 msgr2=0x7f632c151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:15.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06fd10 0x7f632c151770 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f63140b0040 tx=0x7f6314019300 comp rx=0 tx=0).stop 2024-04-26T21:18:15.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 shutdown_connections 2024-04-26T21:18:15.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6308068380 0x7f630806a840 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f632c15cce0 0x7f632c0b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f632c06fd10 0x7f632c151770 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 --2- 172.21.15.106:0/2874116950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f632c06cb10 0x7f632c0b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 >> 172.21.15.106:0/2874116950 conn(0x7f632c068140 msgr2=0x7f632c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 shutdown_connections 2024-04-26T21:18:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:15.850+0000 7f6331800640 1 -- 172.21.15.106:0/2874116950 wait complete. 2024-04-26T21:18:15.873 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:18:16.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7add600640 1 Processor -- start 2024-04-26T21:18:16.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7add600640 1 -- start start 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7add600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 0x7f7ad80cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7add600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7ad80d37f0 0x7f7ad80cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7add600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad80d1d70 con 0x7f7ad80cff60 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7add600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad80d2050 con 0x7f7ad80d37f0 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7add600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad80cd450 con 0x7f7ad815f3d0 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7ace000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7ad80d37f0 0x7f7ad80cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7ad7400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7ad80cff60 0x7f7ad806d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53752/0 (socket says 172.21.15.106:53752) 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7ad7400640 1 -- 172.21.15.106:0/1529469658 learned_addr learned my addr 172.21.15.106:0/1529469658 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7ad6a00640 1 --2- 172.21.15.106:0/1529469658 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 0x7f7ad80cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7ace000640 1 -- 172.21.15.106:0/1529469658 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 msgr2=0x7f7ad80cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:16.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7ace000640 1 --2- 172.21.15.106:0/1529469658 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 0x7f7ad80cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7ace000640 1 -- 172.21.15.106:0/1529469658 >> v1:172.21.15.106:6789/0 conn(0x7f7ad80cff60 legacy=0x7f7ad806d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.006+0000 7f7ace000640 1 -- 172.21.15.106:0/1529469658 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad80cd730 con 0x7f7ad80d37f0 2024-04-26T21:18:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7ace000640 1 --2- 172.21.15.106:0/1529469658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80d37f0 0x7f7ad80cfa20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097c0 tx=0x7f7ac001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a1031a87243994 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7ad6000640 1 -- 172.21.15.106:0/1529469658 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00b0070 con 0x7f7ad80d37f0 2024-04-26T21:18:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7ad6000640 1 -- 172.21.15.106:0/1529469658 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac00ab600 con 0x7f7ad80d37f0 2024-04-26T21:18:16.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7ad6000640 1 -- 172.21.15.106:0/1529469658 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00ab9d0 con 0x7f7ad80d37f0 2024-04-26T21:18:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7add600640 1 -- 172.21.15.106:0/1529469658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80d37f0 msgr2=0x7f7ad80cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7add600640 1 --2- 172.21.15.106:0/1529469658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80d37f0 0x7f7ad80cfa20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097c0 tx=0x7f7ac001c4a0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7add600640 1 -- 172.21.15.106:0/1529469658 shutdown_connections 2024-04-26T21:18:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7add600640 1 --2- 172.21.15.106:0/1529469658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80d37f0 0x7f7ad80cfa20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7add600640 1 --2- 172.21.15.106:0/1529469658 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 0x7f7ad80cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7add600640 1 -- 172.21.15.106:0/1529469658 >> 172.21.15.106:0/1529469658 conn(0x7f7ad80d2c60 msgr2=0x7f7ad80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7add600640 1 -- 172.21.15.106:0/1529469658 shutdown_connections 2024-04-26T21:18:16.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.010+0000 7f7add600640 1 -- 172.21.15.106:0/1529469658 wait complete. 2024-04-26T21:18:16.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 Processor -- start 2024-04-26T21:18:16.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 -- start start 2024-04-26T21:18:16.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80cff60 0x7f7ad80c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ad80d37f0 0x7f7ad80ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 0x7f7ad80cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad816c010 con 0x7f7ad80cff60 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad80d0370 con 0x7f7ad80d37f0 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad816c190 con 0x7f7ad815f3d0 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80cff60 0x7f7ad80c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80cff60 0x7f7ad80c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56154/0 (socket says 172.21.15.106:56154) 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad6a00640 1 -- 172.21.15.106:0/3122014556 learned_addr learned my addr 172.21.15.106:0/3122014556 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad7400640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 0x7f7ad80cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ace000640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ad80d37f0 0x7f7ad80ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad6a00640 1 -- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 msgr2=0x7f7ad80cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad6a00640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 0x7f7ad80cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad6a00640 1 -- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ad80d37f0 msgr2=0x7f7ad80ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad6a00640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ad80d37f0 0x7f7ad80ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad6a00640 1 -- 172.21.15.106:0/3122014556 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad814cce0 con 0x7f7ad80cff60 2024-04-26T21:18:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad7400640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 0x7f7ad80cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ace000640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ad80d37f0 0x7f7ad80ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7ad6a00640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80cff60 0x7f7ad80c9e50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e8a0 tx=0x7f7ac800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7acf400640 1 -- 172.21.15.106:0/3122014556 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8017070 con 0x7f7ad80cff60 2024-04-26T21:18:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7acf400640 1 -- 172.21.15.106:0/3122014556 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac800c940 con 0x7f7ad80cff60 2024-04-26T21:18:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad814cfc0 con 0x7f7ad80cff60 2024-04-26T21:18:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7acf400640 1 -- 172.21.15.106:0/3122014556 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800ccf0 con 0x7f7ad80cff60 2024-04-26T21:18:16.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.014+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad814d580 con 0x7f7ad80cff60 2024-04-26T21:18:16.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.018+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad8069400 con 0x7f7ad80cff60 2024-04-26T21:18:16.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.018+0000 7f7acf400640 1 -- 172.21.15.106:0/3122014556 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ac801a070 con 0x7f7ad80cff60 2024-04-26T21:18:16.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.018+0000 7f7acf400640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7ab40683b0 0x7f7ab406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.018+0000 7f7acf400640 1 -- 172.21.15.106:0/3122014556 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f7ac8086a40 con 0x7f7ad80cff60 2024-04-26T21:18:16.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.018+0000 7f7ace000640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7ab40683b0 0x7f7ab406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.018+0000 7f7ace000640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7ab40683b0 0x7f7ab406a870 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00ad000 tx=0x7f7ac0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:16.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.022+0000 7f7acf400640 1 -- 172.21.15.106:0/3122014556 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ac8056df0 con 0x7f7ad80cff60 2024-04-26T21:18:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.178+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ad80b44c0 con 0x7f7ad80cff60 2024-04-26T21:18:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7acf400640 1 -- 172.21.15.106:0/3122014556 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+17114 (secure 0 0 0) 0x7f7ac80566f0 con 0x7f7ad80cff60 2024-04-26T21:18:16.184 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:16.184 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:18:06.945586+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:17:40.370502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T21:17:41.669690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6836/1043820033":"2024-04-27T21:18:06.945562+0000","172.21.15.106:6834/1043820033":"2024-04-27T21:18:06.945562+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7ab40683b0 msgr2=0x7f7ab406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7ab40683b0 0x7f7ab406a870 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00ad000 tx=0x7f7ac0008040 comp rx=0 tx=0).stop 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80cff60 msgr2=0x7f7ad80c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80cff60 0x7f7ad80c9e50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e8a0 tx=0x7f7ac800eca0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 shutdown_connections 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ad80d37f0 0x7f7ad80ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7ab40683b0 0x7f7ab406a870 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7ad815f3d0 0x7f7ad80cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 --2- 172.21.15.106:0/3122014556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad80cff60 0x7f7ad80c9e50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 >> 172.21.15.106:0/3122014556 conn(0x7f7ad80d2c60 msgr2=0x7f7ad80b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 shutdown_connections 2024-04-26T21:18:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.182+0000 7f7add600640 1 -- 172.21.15.106:0/3122014556 wait complete. 2024-04-26T21:18:16.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:16:08.313788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:17:40.370502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:17:41.669690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:18:16.205 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:18:16.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.338+0000 7f3984c00640 1 Processor -- start 2024-04-26T21:18:16.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f3984c00640 1 -- start start 2024-04-26T21:18:16.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f3984c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f398015c4e0 0x7f398015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f3984c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015d080 0x7f39800b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f3984c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f398015fa20 0x7f398015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f3984c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f398015d5f0 con 0x7f398015fa20 2024-04-26T21:18:16.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f3984c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f398015ce00 con 0x7f398015c4e0 2024-04-26T21:18:16.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f3984c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f39800b4f00 con 0x7f398015d080 2024-04-26T21:18:16.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f398015fa20 0x7f398015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f398015fa20 0x7f398015feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56156/0 (socket says 172.21.15.106:56156) 2024-04-26T21:18:16.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397e800640 1 -- 172.21.15.106:0/3963017049 learned_addr learned my addr 172.21.15.106:0/3963017049 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:16.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f3975400640 1 --2- 172.21.15.106:0/3963017049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015d080 0x7f39800b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397de00640 1 --2- 172.21.15.106:0/3963017049 >> v2:172.21.15.112:3300/0 conn(0x7f398015c4e0 0x7f398015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397e800640 1 -- 172.21.15.106:0/3963017049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015d080 msgr2=0x7f39800b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:16.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397e800640 1 --2- 172.21.15.106:0/3963017049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015d080 0x7f39800b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397e800640 1 -- 172.21.15.106:0/3963017049 >> v2:172.21.15.112:3300/0 conn(0x7f398015c4e0 msgr2=0x7f398015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:16.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397e800640 1 --2- 172.21.15.106:0/3963017049 >> v2:172.21.15.112:3300/0 conn(0x7f398015c4e0 0x7f398015c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397e800640 1 -- 172.21.15.106:0/3963017049 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39800b51e0 con 0x7f398015fa20 2024-04-26T21:18:16.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f3975400640 1 --2- 172.21.15.106:0/3963017049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015d080 0x7f39800b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:16.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.342+0000 7f397de00640 1 --2- 172.21.15.106:0/3963017049 >> v2:172.21.15.112:3300/0 conn(0x7f398015c4e0 0x7f398015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:16.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f397e800640 1 --2- 172.21.15.106:0/3963017049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015fa20 0x7f398015feb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3980070310 tx=0x7f397801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf26e458c842f2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:16.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f397d400640 1 -- 172.21.15.106:0/3963017049 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39780aa610 con 0x7f398015fa20 2024-04-26T21:18:16.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f397d400640 1 -- 172.21.15.106:0/3963017049 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39780af070 con 0x7f398015fa20 2024-04-26T21:18:16.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f397d400640 1 -- 172.21.15.106:0/3963017049 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39780aa9d0 con 0x7f398015fa20 2024-04-26T21:18:16.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 -- 172.21.15.106:0/3963017049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015fa20 msgr2=0x7f398015feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 --2- 172.21.15.106:0/3963017049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015fa20 0x7f398015feb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3980070310 tx=0x7f397801c4f0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 -- 172.21.15.106:0/3963017049 shutdown_connections 2024-04-26T21:18:16.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 --2- 172.21.15.106:0/3963017049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015fa20 0x7f398015feb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 --2- 172.21.15.106:0/3963017049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015d080 0x7f39800b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 --2- 172.21.15.106:0/3963017049 >> v2:172.21.15.112:3300/0 conn(0x7f398015c4e0 0x7f398015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 -- 172.21.15.106:0/3963017049 >> 172.21.15.106:0/3963017049 conn(0x7f39800b2910 msgr2=0x7f39800b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:16.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 -- 172.21.15.106:0/3963017049 shutdown_connections 2024-04-26T21:18:16.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 -- 172.21.15.106:0/3963017049 wait complete. 2024-04-26T21:18:16.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 Processor -- start 2024-04-26T21:18:16.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.346+0000 7f3984c00640 1 -- start start 2024-04-26T21:18:16.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3984c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015c4e0 0x7f3980143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3984c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015d080 0x7f3980144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3984c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f398015fa20 0x7f39801445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3984c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f39800b4b60 con 0x7f398015d080 2024-04-26T21:18:16.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3984c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3980145ba0 con 0x7f398015fa20 2024-04-26T21:18:16.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3984c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f39800b4ce0 con 0x7f398015c4e0 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3975400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015d080 0x7f3980144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3975400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015d080 0x7f3980144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56162/0 (socket says 172.21.15.106:56162) 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3975400640 1 -- 172.21.15.106:0/4182273352 learned_addr learned my addr 172.21.15.106:0/4182273352 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f397de00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015c4e0 0x7f3980143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f397e800640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f398015fa20 0x7f39801445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3975400640 1 -- 172.21.15.106:0/4182273352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015c4e0 msgr2=0x7f3980143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3975400640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015c4e0 0x7f3980143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3975400640 1 -- 172.21.15.106:0/4182273352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f398015fa20 msgr2=0x7f39801445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3975400640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f398015fa20 0x7f39801445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3975400640 1 -- 172.21.15.106:0/4182273352 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3980139ce0 con 0x7f398015d080 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3975400640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015d080 0x7f3980144080 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f396800c820 tx=0x7f396800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3976a00640 1 -- 172.21.15.106:0/4182273352 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968015070 con 0x7f398015d080 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3976a00640 1 -- 172.21.15.106:0/4182273352 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3968007a30 con 0x7f398015d080 2024-04-26T21:18:16.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3976a00640 1 -- 172.21.15.106:0/4182273352 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968007e00 con 0x7f398015d080 2024-04-26T21:18:16.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3980139fc0 con 0x7f398015d080 2024-04-26T21:18:16.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398013a580 con 0x7f398015d080 2024-04-26T21:18:16.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3980069400 con 0x7f398015d080 2024-04-26T21:18:16.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.350+0000 7f3976a00640 1 -- 172.21.15.106:0/4182273352 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3968018070 con 0x7f398015d080 2024-04-26T21:18:16.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.354+0000 7f3976a00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f395c068380 0x7f395c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.354+0000 7f3976a00640 1 -- 172.21.15.106:0/4182273352 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f39680869e0 con 0x7f398015d080 2024-04-26T21:18:16.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.354+0000 7f397de00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f395c068380 0x7f395c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.354+0000 7f397de00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f395c068380 0x7f395c06a840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f397000f500 tx=0x7f3970007700 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:16.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.358+0000 7f3976a00640 1 -- 172.21.15.106:0/4182273352 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f39680567e0 con 0x7f398015d080 2024-04-26T21:18:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f398006e2a0 con 0x7f398015d080 2024-04-26T21:18:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3976a00640 1 -- 172.21.15.106:0/4182273352 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) ==== 93+0+10 (secure 0 0 0) 0x7f396805aae0 con 0x7f398015d080 2024-04-26T21:18:16.517 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-26T21:18:16.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f395c068380 msgr2=0x7f395c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f395c068380 0x7f395c06a840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f397000f500 tx=0x7f3970007700 comp rx=0 tx=0).stop 2024-04-26T21:18:16.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015d080 msgr2=0x7f3980144080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015d080 0x7f3980144080 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f396800c820 tx=0x7f396800cce0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 shutdown_connections 2024-04-26T21:18:16.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f398015fa20 0x7f39801445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f395c068380 0x7f395c06a840 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f398015d080 0x7f3980144080 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 --2- 172.21.15.106:0/4182273352 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f398015c4e0 0x7f3980143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 >> 172.21.15.106:0/4182273352 conn(0x7f39800b2910 msgr2=0x7f398013ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:16.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 shutdown_connections 2024-04-26T21:18:16.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.514+0000 7f3984c00640 1 -- 172.21.15.106:0/4182273352 wait complete. 2024-04-26T21:18:16.538 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:18:16.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d4600640 1 Processor -- start 2024-04-26T21:18:16.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d4600640 1 -- start start 2024-04-26T21:18:16.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d4600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f00cc15ea90 0x7f00cc166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d4600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00cc0b4f00 con 0x7f00cc15c4e0 2024-04-26T21:18:16.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d4600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00cc0b51e0 con 0x7f00cc15d080 2024-04-26T21:18:16.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d4600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f00cc15d5f0 con 0x7f00cc15ea90 2024-04-26T21:18:16.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d1c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f00cc15c4e0 0x7f00cc15c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53754/0 (socket says 172.21.15.106:53754) 2024-04-26T21:18:16.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d1c00640 1 -- 172.21.15.106:0/1718921678 learned_addr learned my addr 172.21.15.106:0/1718921678 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:16.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d2600640 1 --2- 172.21.15.106:0/1718921678 >> v2:172.21.15.112:3300/0 conn(0x7f00cc15ea90 0x7f00cc166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00cbe00640 1 -- 172.21.15.106:0/1718921678 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037257780 0 0) 0x7f00cc0b4f00 con 0x7f00cc15c4e0 2024-04-26T21:18:16.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00cbe00640 1 -- 172.21.15.106:0/1718921678 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b4003530 con 0x7f00cc15c4e0 2024-04-26T21:18:16.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d2600640 1 -- 172.21.15.106:0/1718921678 >> v1:172.21.15.112:6789/0 conn(0x7f00cc15d080 legacy=0x7f00cc0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d2600640 1 -- 172.21.15.106:0/1718921678 >> v1:172.21.15.106:6789/0 conn(0x7f00cc15c4e0 legacy=0x7f00cc15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.674+0000 7f00d2600640 1 -- 172.21.15.106:0/1718921678 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc0b54c0 con 0x7f00cc15ea90 2024-04-26T21:18:16.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00d2600640 1 --2- 172.21.15.106:0/1718921678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 0x7f00cc166db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009d90 tx=0x7f00c401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9625ddc1c76ec5a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:16.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00cbe00640 1 -- 172.21.15.106:0/1718921678 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c40b2070 con 0x7f00cc15ea90 2024-04-26T21:18:16.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00cbe00640 1 -- 172.21.15.106:0/1718921678 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c40a58e0 con 0x7f00cc15ea90 2024-04-26T21:18:16.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00cbe00640 1 -- 172.21.15.106:0/1718921678 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c40a5cb0 con 0x7f00cc15ea90 2024-04-26T21:18:16.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00d4600640 1 -- 172.21.15.106:0/1718921678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 msgr2=0x7f00cc166db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00d4600640 1 --2- 172.21.15.106:0/1718921678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 0x7f00cc166db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009d90 tx=0x7f00c401c970 comp rx=0 tx=0).stop 2024-04-26T21:18:16.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00d4600640 1 -- 172.21.15.106:0/1718921678 shutdown_connections 2024-04-26T21:18:16.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00d4600640 1 --2- 172.21.15.106:0/1718921678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 0x7f00cc166db0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00d4600640 1 -- 172.21.15.106:0/1718921678 >> 172.21.15.106:0/1718921678 conn(0x7f00cc0b2910 msgr2=0x7f00cc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:16.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00d4600640 1 -- 172.21.15.106:0/1718921678 shutdown_connections 2024-04-26T21:18:16.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.678+0000 7f00d4600640 1 -- 172.21.15.106:0/1718921678 wait complete. 2024-04-26T21:18:16.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 Processor -- start 2024-04-26T21:18:16.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 -- start start 2024-04-26T21:18:16.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00cc15c4e0 0x7f00cc15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00cc15d080 0x7f00cc0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 0x7f00cc0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc169ea0 con 0x7f00cc15d080 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc169d20 con 0x7f00cc15ea90 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f00cc16a020 con 0x7f00cc15c4e0 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00cc15d080 0x7f00cc0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00cc15d080 0x7f00cc0ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56166/0 (socket says 172.21.15.106:56166) 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1200640 1 -- 172.21.15.106:0/3768281156 learned_addr learned my addr 172.21.15.106:0/3768281156 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1c00640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00cc15c4e0 0x7f00cc15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1200640 1 -- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00cc15c4e0 msgr2=0x7f00cc15b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d2600640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 0x7f00cc0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1200640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00cc15c4e0 0x7f00cc15b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1200640 1 -- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 msgr2=0x7f00cc0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1200640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 0x7f00cc0d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1200640 1 -- 172.21.15.106:0/3768281156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc0cec20 con 0x7f00cc15d080 2024-04-26T21:18:16.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1c00640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00cc15c4e0 0x7f00cc15b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:16.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d2600640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 0x7f00cc0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:16.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d1200640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00cc15d080 0x7f00cc0ce240 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f00b800c430 tx=0x7f00b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:16.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00c9600640 1 -- 172.21.15.106:0/3768281156 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b80052d0 con 0x7f00cc15d080 2024-04-26T21:18:16.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00c9600640 1 -- 172.21.15.106:0/3768281156 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b8005470 con 0x7f00cc15d080 2024-04-26T21:18:16.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00cc0cef00 con 0x7f00cc15d080 2024-04-26T21:18:16.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00c9600640 1 -- 172.21.15.106:0/3768281156 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b8007260 con 0x7f00cc15d080 2024-04-26T21:18:16.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00cc0cf4c0 con 0x7f00cc15d080 2024-04-26T21:18:16.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.682+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00cc069400 con 0x7f00cc15d080 2024-04-26T21:18:16.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.686+0000 7f00c9600640 1 -- 172.21.15.106:0/3768281156 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00b8007400 con 0x7f00cc15d080 2024-04-26T21:18:16.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.686+0000 7f00c9600640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f00ac0683b0 0x7f00ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.686+0000 7f00c9600640 1 -- 172.21.15.106:0/3768281156 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f00b8086160 con 0x7f00cc15d080 2024-04-26T21:18:16.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.686+0000 7f00d1c00640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f00ac0683b0 0x7f00ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.686+0000 7f00d1c00640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f00ac0683b0 0x7f00ac06a870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f00c00011f0 tx=0x7f00c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:16.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.690+0000 7f00c9600640 1 -- 172.21.15.106:0/3768281156 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f00b8056480 con 0x7f00cc15d080 2024-04-26T21:18:16.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.846+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f00cc06fb90 con 0x7f00cc15d080 2024-04-26T21:18:16.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.846+0000 7f00c9600640 1 -- 172.21.15.106:0/3768281156 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) ==== 104+0+11 (secure 0 0 0) 0x7f00b8055d80 con 0x7f00cc15d080 2024-04-26T21:18:16.851 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-04-26T21:18:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f00ac0683b0 msgr2=0x7f00ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f00ac0683b0 0x7f00ac06a870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f00c00011f0 tx=0x7f00c0009040 comp rx=0 tx=0).stop 2024-04-26T21:18:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00cc15d080 msgr2=0x7f00cc0ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00cc15d080 0x7f00cc0ce240 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f00b800c430 tx=0x7f00b800c8f0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 shutdown_connections 2024-04-26T21:18:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00cc15ea90 0x7f00cc0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f00ac0683b0 0x7f00ac06a870 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00cc15d080 0x7f00cc0ce240 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 --2- 172.21.15.106:0/3768281156 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f00cc15c4e0 0x7f00cc15b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 >> 172.21.15.106:0/3768281156 conn(0x7f00cc0b2910 msgr2=0x7f00cc1449d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 shutdown_connections 2024-04-26T21:18:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:16.850+0000 7f00d4600640 1 -- 172.21.15.106:0/3768281156 wait complete. 2024-04-26T21:18:16.871 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:18:17.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.006+0000 7f85ec000640 1 Processor -- start 2024-04-26T21:18:17.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85ec000640 1 -- start start 2024-04-26T21:18:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85ec000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85e40d1e50 0x7f85e4162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85ec000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e4163510 con 0x7f85e415e8c0 2024-04-26T21:18:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85ec000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e406dee0 con 0x7f85e4162bf0 2024-04-26T21:18:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85ec000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f85e406eaf0 con 0x7f85e40d1e50 2024-04-26T21:18:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85e8c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85e40d1e50 0x7f85e4162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85ea000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f85e415e8c0 0x7f85e415ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47166/0 (socket says 172.21.15.106:47166) 2024-04-26T21:18:17.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85ea000640 1 -- 172.21.15.106:0/3687060620 learned_addr learned my addr 172.21.15.106:0/3687060620 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85e8c00640 1 -- 172.21.15.106:0/3687060620 >> v1:172.21.15.112:6789/0 conn(0x7f85e4162bf0 legacy=0x7f85e406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85e8c00640 1 -- 172.21.15.106:0/3687060620 >> v1:172.21.15.106:6789/0 conn(0x7f85e415e8c0 legacy=0x7f85e415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.010+0000 7f85e8c00640 1 -- 172.21.15.106:0/3687060620 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e406e1c0 con 0x7f85e40d1e50 2024-04-26T21:18:17.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85e8c00640 1 --2- 172.21.15.106:0/3687060620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e40d1e50 0x7f85e4162fd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097c0 tx=0x7f85d001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a526cb21972b92c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85e3e00640 1 -- 172.21.15.106:0/3687060620 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d00a7070 con 0x7f85e40d1e50 2024-04-26T21:18:17.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85e3e00640 1 -- 172.21.15.106:0/3687060620 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d00b0070 con 0x7f85e40d1e50 2024-04-26T21:18:17.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85e3e00640 1 -- 172.21.15.106:0/3687060620 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d00ab890 con 0x7f85e40d1e50 2024-04-26T21:18:17.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85ec000640 1 -- 172.21.15.106:0/3687060620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e40d1e50 msgr2=0x7f85e4162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85ec000640 1 --2- 172.21.15.106:0/3687060620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e40d1e50 0x7f85e4162fd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097c0 tx=0x7f85d001c490 comp rx=0 tx=0).stop 2024-04-26T21:18:17.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85ec000640 1 -- 172.21.15.106:0/3687060620 shutdown_connections 2024-04-26T21:18:17.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85ec000640 1 --2- 172.21.15.106:0/3687060620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e40d1e50 0x7f85e4162fd0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85ec000640 1 -- 172.21.15.106:0/3687060620 >> 172.21.15.106:0/3687060620 conn(0x7f85e40d2c50 msgr2=0x7f85e40d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:17.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85ec000640 1 -- 172.21.15.106:0/3687060620 shutdown_connections 2024-04-26T21:18:17.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85ec000640 1 -- 172.21.15.106:0/3687060620 wait complete. 2024-04-26T21:18:17.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85ec000640 1 Processor -- start 2024-04-26T21:18:17.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.014+0000 7f85ec000640 1 -- start start 2024-04-26T21:18:17.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ec000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85e40d1e50 0x7f85e4153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ec000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e415e8c0 0x7f85e40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ec000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e4162bf0 0x7f85e40b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ec000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f85e416cf80 con 0x7f85e4162bf0 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ec000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f85e40d22c0 con 0x7f85e415e8c0 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ec000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f85e416d100 con 0x7f85e40d1e50 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ea000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e4162bf0 0x7f85e40b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ea000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e4162bf0 0x7f85e40b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39252/0 (socket says 172.21.15.106:39252) 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ea000640 1 -- 172.21.15.106:0/3613949551 learned_addr learned my addr 172.21.15.106:0/3613949551 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85e9600640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85e40d1e50 0x7f85e4153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85e8c00640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e415e8c0 0x7f85e40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ea000640 1 -- 172.21.15.106:0/3613949551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85e40d1e50 msgr2=0x7f85e4153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ea000640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85e40d1e50 0x7f85e4153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ea000640 1 -- 172.21.15.106:0/3613949551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e415e8c0 msgr2=0x7f85e40b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ea000640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e415e8c0 0x7f85e40b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ea000640 1 -- 172.21.15.106:0/3613949551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e41fc9d0 con 0x7f85e4162bf0 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85e8c00640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e415e8c0 0x7f85e40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ea000640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e4162bf0 0x7f85e40b7dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00c3c0 tx=0x7f85dc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85e1600640 1 -- 172.21.15.106:0/3613949551 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc017070 con 0x7f85e4162bf0 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85e1600640 1 -- 172.21.15.106:0/3613949551 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc005cf0 con 0x7f85e4162bf0 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85e1600640 1 -- 172.21.15.106:0/3613949551 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0072f0 con 0x7f85e4162bf0 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e41543c0 con 0x7f85e4162bf0 2024-04-26T21:18:17.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e4154980 con 0x7f85e4162bf0 2024-04-26T21:18:17.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e4069400 con 0x7f85e4162bf0 2024-04-26T21:18:17.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.018+0000 7f85e1600640 1 -- 172.21.15.106:0/3613949551 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f85dc01a070 con 0x7f85e4162bf0 2024-04-26T21:18:17.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.022+0000 7f85e1600640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f85c4068380 0x7f85c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.022+0000 7f85e1600640 1 -- 172.21.15.106:0/3613949551 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f85dc085ea0 con 0x7f85e4162bf0 2024-04-26T21:18:17.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.022+0000 7f85e9600640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f85c4068380 0x7f85c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.022+0000 7f85e9600640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f85c4068380 0x7f85c406a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85d80012f0 tx=0x7f85d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.026+0000 7f85e1600640 1 -- 172.21.15.106:0/3613949551 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f85dc056250 con 0x7f85e4162bf0 2024-04-26T21:18:17.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.182+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f85e40b88a0 con 0x7f85e4162bf0 2024-04-26T21:18:17.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.182+0000 7f85e1600640 1 -- 172.21.15.106:0/3613949551 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) ==== 100+0+11 (secure 0 0 0) 0x7f85dc055b50 con 0x7f85e4162bf0 2024-04-26T21:18:17.187 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-04-26T21:18:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f85c4068380 msgr2=0x7f85c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f85c4068380 0x7f85c406a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85d80012f0 tx=0x7f85d8009040 comp rx=0 tx=0).stop 2024-04-26T21:18:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e4162bf0 msgr2=0x7f85e40b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e4162bf0 0x7f85e40b7dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00c3c0 tx=0x7f85dc00c880 comp rx=0 tx=0).stop 2024-04-26T21:18:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 shutdown_connections 2024-04-26T21:18:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85e415e8c0 0x7f85e40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f85c4068380 0x7f85c406a840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85e4162bf0 0x7f85e40b7dc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 --2- 172.21.15.106:0/3613949551 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f85e40d1e50 0x7f85e4153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 >> 172.21.15.106:0/3613949551 conn(0x7f85e40d2c50 msgr2=0x7f85e40af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:17.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 shutdown_connections 2024-04-26T21:18:17.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.186+0000 7f85ec000640 1 -- 172.21.15.106:0/3613949551 wait complete. 2024-04-26T21:18:17.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:18:17.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f4170a00640 1 Processor -- start 2024-04-26T21:18:17.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f4170a00640 1 -- start start 2024-04-26T21:18:17.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f4170a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c15bb70 0x7f416c160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f4170a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f416c0ccd10 0x7f416c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f4170a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f416c072bc0 0x7f416c073050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f4170a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f416c0cd7d0 con 0x7f416c072bc0 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f4170a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f416c0cdab0 con 0x7f416c0ccd10 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f4170a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f416c15f6a0 con 0x7f416c15bb70 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f416c072bc0 0x7f416c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f416c072bc0 0x7f416c073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39254/0 (socket says 172.21.15.106:39254) 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416be00640 1 -- 172.21.15.106:0/2810304580 learned_addr learned my addr 172.21.15.106:0/2810304580 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416b400640 1 --2- 172.21.15.106:0/2810304580 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c15bb70 0x7f416c160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416aa00640 1 --2- 172.21.15.106:0/2810304580 >> v2:172.21.15.112:3300/0 conn(0x7f416c0ccd10 0x7f416c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416be00640 1 -- 172.21.15.106:0/2810304580 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c15bb70 msgr2=0x7f416c160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:17.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416be00640 1 --2- 172.21.15.106:0/2810304580 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c15bb70 0x7f416c160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416be00640 1 -- 172.21.15.106:0/2810304580 >> v2:172.21.15.112:3300/0 conn(0x7f416c0ccd10 msgr2=0x7f416c0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:17.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416be00640 1 --2- 172.21.15.106:0/2810304580 >> v2:172.21.15.112:3300/0 conn(0x7f416c0ccd10 0x7f416c0cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.342+0000 7f416be00640 1 -- 172.21.15.106:0/2810304580 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c15f980 con 0x7f416c072bc0 2024-04-26T21:18:17.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f416be00640 1 --2- 172.21.15.106:0/2810304580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c072bc0 0x7f416c073050 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f416c0767a0 tx=0x7f416401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd5d0115f48d171 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f416a000640 1 -- 172.21.15.106:0/2810304580 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640a5670 con 0x7f416c072bc0 2024-04-26T21:18:17.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f416a000640 1 -- 172.21.15.106:0/2810304580 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41640a5810 con 0x7f416c072bc0 2024-04-26T21:18:17.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f416a000640 1 -- 172.21.15.106:0/2810304580 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640a5be0 con 0x7f416c072bc0 2024-04-26T21:18:17.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 -- 172.21.15.106:0/2810304580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c072bc0 msgr2=0x7f416c073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 --2- 172.21.15.106:0/2810304580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c072bc0 0x7f416c073050 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f416c0767a0 tx=0x7f416401c9f0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 -- 172.21.15.106:0/2810304580 shutdown_connections 2024-04-26T21:18:17.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 --2- 172.21.15.106:0/2810304580 >> v2:172.21.15.112:3300/0 conn(0x7f416c0ccd10 0x7f416c0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 --2- 172.21.15.106:0/2810304580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c072bc0 0x7f416c073050 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 --2- 172.21.15.106:0/2810304580 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c15bb70 0x7f416c160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 -- 172.21.15.106:0/2810304580 >> 172.21.15.106:0/2810304580 conn(0x7f416c0d1970 msgr2=0x7f416c0d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:17.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 -- 172.21.15.106:0/2810304580 shutdown_connections 2024-04-26T21:18:17.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 -- 172.21.15.106:0/2810304580 wait complete. 2024-04-26T21:18:17.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 Processor -- start 2024-04-26T21:18:17.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.346+0000 7f4170a00640 1 -- start start 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4170a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f416c072bc0 0x7f416c1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4170a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c0ccd10 0x7f416c0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4170a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c15bb70 0x7f416c159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4170a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f416c070430 con 0x7f416c15bb70 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4170a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f416c0702b0 con 0x7f416c072bc0 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4170a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f416c0705b0 con 0x7f416c0ccd10 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c15bb70 0x7f416c159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416b400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f416c072bc0 0x7f416c1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c15bb70 0x7f416c159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39268/0 (socket says 172.21.15.106:39268) 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416be00640 1 -- 172.21.15.106:0/795130670 learned_addr learned my addr 172.21.15.106:0/795130670 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416aa00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c0ccd10 0x7f416c0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416be00640 1 -- 172.21.15.106:0/795130670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c0ccd10 msgr2=0x7f416c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416be00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c0ccd10 0x7f416c0c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416be00640 1 -- 172.21.15.106:0/795130670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f416c072bc0 msgr2=0x7f416c1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416be00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f416c072bc0 0x7f416c1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416be00640 1 -- 172.21.15.106:0/795130670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c15b170 con 0x7f416c15bb70 2024-04-26T21:18:17.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f416be00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c15bb70 0x7f416c159960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f416401b0a0 tx=0x7f4164019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4163400640 1 -- 172.21.15.106:0/795130670 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4164009510 con 0x7f416c15bb70 2024-04-26T21:18:17.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4163400640 1 -- 172.21.15.106:0/795130670 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41640be070 con 0x7f416c15bb70 2024-04-26T21:18:17.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4163400640 1 -- 172.21.15.106:0/795130670 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640b8ae0 con 0x7f416c15bb70 2024-04-26T21:18:17.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c15a0d0 con 0x7f416c15bb70 2024-04-26T21:18:17.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c15a690 con 0x7f416c15bb70 2024-04-26T21:18:17.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c069400 con 0x7f416c15bb70 2024-04-26T21:18:17.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.350+0000 7f4163400640 1 -- 172.21.15.106:0/795130670 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f41640b8c80 con 0x7f416c15bb70 2024-04-26T21:18:17.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.354+0000 7f4163400640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f414c0683b0 0x7f414c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.354+0000 7f4163400640 1 -- 172.21.15.106:0/795130670 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f4164121920 con 0x7f416c15bb70 2024-04-26T21:18:17.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.354+0000 7f416b400640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f414c0683b0 0x7f414c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.354+0000 7f416b400640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f414c0683b0 0x7f414c06a870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f415c0079e0 tx=0x7f415c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.358+0000 7f4163400640 1 -- 172.21.15.106:0/795130670 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f41640165e0 con 0x7f416c15bb70 2024-04-26T21:18:17.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.546+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f416c15b410 con 0x7f416c15bb70 2024-04-26T21:18:17.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.546+0000 7f4163400640 1 -- 172.21.15.106:0/795130670 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5183 (secure 0 0 0) 0x7f41640f1720 con 0x7f416c15bb70 2024-04-26T21:18:17.551 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:17.551 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/791761080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":791761080},{"type":"v1","addr":"172.21.15.106:6836","nonce":791761080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:18:10.975225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5413,"qdb_cluster":[5413]},"id":2}]} 2024-04-26T21:18:17.551 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 24 2024-04-26T21:18:17.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f414c0683b0 msgr2=0x7f414c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f414c0683b0 0x7f414c06a870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f415c0079e0 tx=0x7f415c008040 comp rx=0 tx=0).stop 2024-04-26T21:18:17.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c15bb70 msgr2=0x7f416c159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c15bb70 0x7f416c159960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f416401b0a0 tx=0x7f4164019790 comp rx=0 tx=0).stop 2024-04-26T21:18:17.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 shutdown_connections 2024-04-26T21:18:17.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f414c0683b0 0x7f414c06a870 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f416c15bb70 0x7f416c159960 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f416c0ccd10 0x7f416c0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 --2- 172.21.15.106:0/795130670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f416c072bc0 0x7f416c1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 >> 172.21.15.106:0/795130670 conn(0x7f416c0d1970 msgr2=0x7f416c0cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:17.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 shutdown_connections 2024-04-26T21:18:17.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.550+0000 7f4170a00640 1 -- 172.21.15.106:0/795130670 wait complete. 2024-04-26T21:18:17.572 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:18:17.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be9200640 1 Processor -- start 2024-04-26T21:18:17.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be9200640 1 -- start start 2024-04-26T21:18:17.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be9200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be415d060 0x7f9be40cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be9200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9be40cfb70 0x7f9be40cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be9200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9be40d0830 0x7f9be40d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be9200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f9be40b25a0 con 0x7f9be40cfb70 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be9200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9be40b2250 con 0x7f9be40d0830 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be9200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9be40ce660 con 0x7f9be415d060 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9bd9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9be40cfb70 0x7f9be40cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9bd9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9be40cfb70 0x7f9be40cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39272/0 (socket says 172.21.15.106:39272) 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9bd9400640 1 -- 172.21.15.106:0/2425482923 learned_addr learned my addr 172.21.15.106:0/2425482923 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be2800640 1 --2- 172.21.15.106:0/2425482923 >> v2:172.21.15.112:3300/0 conn(0x7f9be40d0830 0x7f9be40d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9be1e00640 1 --2- 172.21.15.106:0/2425482923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be415d060 0x7f9be40cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9bd9400640 1 -- 172.21.15.106:0/2425482923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be415d060 msgr2=0x7f9be40cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9bd9400640 1 --2- 172.21.15.106:0/2425482923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be415d060 0x7f9be40cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9bd9400640 1 -- 172.21.15.106:0/2425482923 >> v2:172.21.15.112:3300/0 conn(0x7f9be40d0830 msgr2=0x7f9be40d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:17.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9bd9400640 1 --2- 172.21.15.106:0/2425482923 >> v2:172.21.15.112:3300/0 conn(0x7f9be40d0830 0x7f9be40d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.706+0000 7f9bd9400640 1 -- 172.21.15.106:0/2425482923 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be40ce940 con 0x7f9be40cfb70 2024-04-26T21:18:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9bd9400640 1 --2- 172.21.15.106:0/2425482923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40cfb70 0x7f9be40cfff0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9be40cf3d0 tx=0x7f9bcc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d667bbfb1080a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be1400640 1 -- 172.21.15.106:0/2425482923 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0ab5f0 con 0x7f9be40cfb70 2024-04-26T21:18:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be1400640 1 -- 172.21.15.106:0/2425482923 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bcc0b0070 con 0x7f9be40cfb70 2024-04-26T21:18:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be1400640 1 -- 172.21.15.106:0/2425482923 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0ab9b0 con 0x7f9be40cfb70 2024-04-26T21:18:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be9200640 1 -- 172.21.15.106:0/2425482923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40cfb70 msgr2=0x7f9be40cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be9200640 1 --2- 172.21.15.106:0/2425482923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40cfb70 0x7f9be40cfff0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9be40cf3d0 tx=0x7f9bcc01c520 comp rx=0 tx=0).stop 2024-04-26T21:18:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be9200640 1 -- 172.21.15.106:0/2425482923 shutdown_connections 2024-04-26T21:18:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be9200640 1 --2- 172.21.15.106:0/2425482923 >> v2:172.21.15.112:3300/0 conn(0x7f9be40d0830 0x7f9be40d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be9200640 1 --2- 172.21.15.106:0/2425482923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40cfb70 0x7f9be40cfff0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be9200640 1 --2- 172.21.15.106:0/2425482923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be415d060 0x7f9be40cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be9200640 1 -- 172.21.15.106:0/2425482923 >> 172.21.15.106:0/2425482923 conn(0x7f9be40d2c60 msgr2=0x7f9be40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be9200640 1 -- 172.21.15.106:0/2425482923 shutdown_connections 2024-04-26T21:18:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.710+0000 7f9be9200640 1 -- 172.21.15.106:0/2425482923 wait complete. 2024-04-26T21:18:17.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 Processor -- start 2024-04-26T21:18:17.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 -- start start 2024-04-26T21:18:17.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be40cfb70 0x7f9be40c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40d0830 0x7f9be4155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be415d060 0x7f9be40cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9be40b2b90 con 0x7f9be40d0830 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9be40b2a10 con 0x7f9be415d060 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9be40b2d10 con 0x7f9be40cfb70 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bd9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40d0830 0x7f9be4155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bd9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40d0830 0x7f9be4155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39288/0 (socket says 172.21.15.106:39288) 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bd9400640 1 -- 172.21.15.106:0/478306278 learned_addr learned my addr 172.21.15.106:0/478306278 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be2800640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be415d060 0x7f9be40cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be1e00640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be40cfb70 0x7f9be40c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bd9400640 1 -- 172.21.15.106:0/478306278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be40cfb70 msgr2=0x7f9be40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bd9400640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be40cfb70 0x7f9be40c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bd9400640 1 -- 172.21.15.106:0/478306278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be415d060 msgr2=0x7f9be40cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bd9400640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be415d060 0x7f9be40cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bd9400640 1 -- 172.21.15.106:0/478306278 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be40ca3c0 con 0x7f9be40d0830 2024-04-26T21:18:17.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bd9400640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40d0830 0x7f9be4155d30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc01abd0 tx=0x7f9bcc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bdaa00640 1 -- 172.21.15.106:0/478306278 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0be3f0 con 0x7f9be40d0830 2024-04-26T21:18:17.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bdaa00640 1 -- 172.21.15.106:0/478306278 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bcc0be590 con 0x7f9be40d0830 2024-04-26T21:18:17.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be40ca700 con 0x7f9be40d0830 2024-04-26T21:18:17.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9bdaa00640 1 -- 172.21.15.106:0/478306278 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0be960 con 0x7f9be40d0830 2024-04-26T21:18:17.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be40caf40 con 0x7f9be40d0830 2024-04-26T21:18:17.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.714+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be4069400 con 0x7f9be40d0830 2024-04-26T21:18:17.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.718+0000 7f9bdaa00640 1 -- 172.21.15.106:0/478306278 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9bcc0b43f0 con 0x7f9be40d0830 2024-04-26T21:18:17.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.718+0000 7f9bdaa00640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9bc0068380 0x7f9bc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:17.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.718+0000 7f9bdaa00640 1 -- 172.21.15.106:0/478306278 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f9bcc120ea0 con 0x7f9be40d0830 2024-04-26T21:18:17.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.718+0000 7f9be1e00640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9bc0068380 0x7f9bc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:17.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.718+0000 7f9be1e00640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9bc0068380 0x7f9bc006a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009ac0 tx=0x7f9bd4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.722+0000 7f9bdaa00640 1 -- 172.21.15.106:0/478306278 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9be40ca700 con 0x7f9be40d0830 2024-04-26T21:18:17.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.882+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9be40cd090 con 0x7f9be40d0830 2024-04-26T21:18:17.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.882+0000 7f9bdaa00640 1 -- 172.21.15.106:0/478306278 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+17114 (secure 0 0 0) 0x7f9bcc0f7030 con 0x7f9be40d0830 2024-04-26T21:18:17.886 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:17.886 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:18:06.945586+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:17:40.370502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T21:17:41.669690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6836/1043820033":"2024-04-27T21:18:06.945562+0000","172.21.15.106:6834/1043820033":"2024-04-27T21:18:06.945562+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.882+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9bc0068380 msgr2=0x7f9bc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.882+0000 7f9be9200640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9bc0068380 0x7f9bc006a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009ac0 tx=0x7f9bd4009190 comp rx=0 tx=0).stop 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40d0830 msgr2=0x7f9be4155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40d0830 0x7f9be4155d30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc01abd0 tx=0x7f9bcc01ad60 comp rx=0 tx=0).stop 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 shutdown_connections 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be415d060 0x7f9be40cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9bc0068380 0x7f9bc006a840 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40d0830 0x7f9be4155d30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 --2- 172.21.15.106:0/478306278 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9be40cfb70 0x7f9be40c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:17.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 >> 172.21.15.106:0/478306278 conn(0x7f9be40d2c60 msgr2=0x7f9be40d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:17.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 shutdown_connections 2024-04-26T21:18:17.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:17.886+0000 7f9be9200640 1 -- 172.21.15.106:0/478306278 wait complete. 2024-04-26T21:18:17.906 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T21:18:17.906 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:18:18.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad47c00640 1 Processor -- start 2024-04-26T21:18:18.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad47c00640 1 -- start start 2024-04-26T21:18:18.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad47c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40160ac0 0x7fad4015df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad47c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad400b3da0 con 0x7fad40146490 2024-04-26T21:18:18.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad47c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad40160fa0 con 0x7fad40146870 2024-04-26T21:18:18.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad47c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad40161280 con 0x7fad40160ac0 2024-04-26T21:18:18.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad45200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fad40146490 0x7fad400cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47180/0 (socket says 172.21.15.106:47180) 2024-04-26T21:18:18.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad45200640 1 -- 172.21.15.106:0/3753952791 learned_addr learned my addr 172.21.15.106:0/3753952791 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:18.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad37e00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40160ac0 0x7fad4015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378396351 0 0) 0x7fad400b3da0 con 0x7fad40146490 2024-04-26T21:18:18.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.038+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad24003530 con 0x7fad40146490 2024-04-26T21:18:18.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095826303 0 0) 0x7fad40160fa0 con 0x7fad40146870 2024-04-26T21:18:18.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad400b3da0 con 0x7fad40146870 2024-04-26T21:18:18.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2557520001 0 0) 0x7fad24003530 con 0x7fad40146490 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40160ac0 msgr2=0x7fad4015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40160ac0 0x7fad4015df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 >> v1:172.21.15.112:6789/0 conn(0x7fad40146870 legacy=0x7fad400d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad40161560 con 0x7fad40146490 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7fad300016a0 con 0x7fad40146490 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad37e00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40160ac0 0x7fad4015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 >> v1:172.21.15.106:6789/0 conn(0x7fad40146490 legacy=0x7fad400cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad24003b80 0x7fad24003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40160ac0 0x7fad24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fad40161280 con 0x7fad24004d50 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fad2400ba80 con 0x7fad24003b80 2024-04-26T21:18:18.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad2400bc30 con 0x7fad40160ac0 2024-04-26T21:18:18.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad45200640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad24003b80 0x7fad24003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad45c00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad37e00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40160ac0 0x7fad24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad45c00640 1 -- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40160ac0 msgr2=0x7fad24004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:18.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad45c00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40160ac0 0x7fad24004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad45c00640 1 -- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad24003b80 msgr2=0x7fad24003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:18.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad45c00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad24003b80 0x7fad24003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad45c00640 1 -- 172.21.15.106:0/3753952791 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad24003530 con 0x7fad24004d50 2024-04-26T21:18:18.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.042+0000 7fad45200640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad24003b80 0x7fad24003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:18.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad45c00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad240051d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fad40146ce0 tx=0x7fad3801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cbef8c468bf574 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:18.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38001c20 con 0x7fad24004d50 2024-04-26T21:18:18.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad38003ba0 con 0x7fad24004d50 2024-04-26T21:18:18.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad3fe00640 1 -- 172.21.15.106:0/3753952791 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad380050d0 con 0x7fad24004d50 2024-04-26T21:18:18.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 -- 172.21.15.106:0/3753952791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 msgr2=0x7fad240051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 --2- 172.21.15.106:0/3753952791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad240051d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fad40146ce0 tx=0x7fad3801c880 comp rx=0 tx=0).stop 2024-04-26T21:18:18.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad45c00640 1 -- 172.21.15.106:0/3753952791 reap_dead start 2024-04-26T21:18:18.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 -- 172.21.15.106:0/3753952791 shutdown_connections 2024-04-26T21:18:18.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 -- 172.21.15.106:0/3753952791 >> 172.21.15.106:0/3753952791 conn(0x7fad40068340 msgr2=0x7fad40068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:18.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 -- 172.21.15.106:0/3753952791 shutdown_connections 2024-04-26T21:18:18.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 -- 172.21.15.106:0/3753952791 wait complete. 2024-04-26T21:18:18.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 Processor -- start 2024-04-26T21:18:18.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 -- start start 2024-04-26T21:18:18.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad401564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40157b90 0x7fad40157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad40130cb0 0x7fad40131130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fad400d14b0 con 0x7fad24004d50 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fad400b4090 con 0x7fad40130cb0 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad47c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fad400d1630 con 0x7fad40157b90 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad45200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad401564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad45200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad401564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39308/0 (socket says 172.21.15.106:39308) 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.046+0000 7fad45200640 1 -- 172.21.15.106:0/1893400400 learned_addr learned my addr 172.21.15.106:0/1893400400 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad37e00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40157b90 0x7fad40157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad45c00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad40130cb0 0x7fad40131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad45200640 1 -- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40157b90 msgr2=0x7fad40157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad45200640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40157b90 0x7fad40157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad45200640 1 -- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad40130cb0 msgr2=0x7fad40131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad45200640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad40130cb0 0x7fad40131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad45200640 1 -- 172.21.15.106:0/1893400400 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4013f930 con 0x7fad24004d50 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad37e00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40157b90 0x7fad40157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad45c00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad40130cb0 0x7fad40131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:18.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad45200640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad401564f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fad300124c0 tx=0x7fad30012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:18.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad3d600640 1 -- 172.21.15.106:0/1893400400 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3001c070 con 0x7fad24004d50 2024-04-26T21:18:18.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad3d600640 1 -- 172.21.15.106:0/1893400400 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad30014810 con 0x7fad24004d50 2024-04-26T21:18:18.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad3d600640 1 -- 172.21.15.106:0/1893400400 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30014be0 con 0x7fad24004d50 2024-04-26T21:18:18.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4013fc10 con 0x7fad24004d50 2024-04-26T21:18:18.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad401401d0 con 0x7fad24004d50 2024-04-26T21:18:18.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad40069400 con 0x7fad24004d50 2024-04-26T21:18:18.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad3d600640 1 -- 172.21.15.106:0/1893400400 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fad300153e0 con 0x7fad24004d50 2024-04-26T21:18:18.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad3d600640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad1c068380 0x7fad1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad3d600640 1 -- 172.21.15.106:0/1893400400 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7fad30089670 con 0x7fad24004d50 2024-04-26T21:18:18.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.050+0000 7fad37e00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad1c068380 0x7fad1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.054+0000 7fad37e00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad1c068380 0x7fad1c06a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad400cdbd0 tx=0x7fad28008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:18.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.054+0000 7fad3d600640 1 -- 172.21.15.106:0/1893400400 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fad30059900 con 0x7fad24004d50 2024-04-26T21:18:18.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.242+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad40073430 con 0x7fad24004d50 2024-04-26T21:18:18.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.242+0000 7fad3d600640 1 -- 172.21.15.106:0/1893400400 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5183 (secure 0 0 0) 0x7fad30059200 con 0x7fad24004d50 2024-04-26T21:18:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:18.247 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/791761080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":791761080},{"type":"v1","addr":"172.21.15.106:6836","nonce":791761080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:18:10.975225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5413,"qdb_cluster":[5413]},"id":2}]} 2024-04-26T21:18:18.247 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 24 2024-04-26T21:18:18.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad1c068380 msgr2=0x7fad1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad1c068380 0x7fad1c06a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad400cdbd0 tx=0x7fad28008040 comp rx=0 tx=0).stop 2024-04-26T21:18:18.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 msgr2=0x7fad401564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad401564f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fad300124c0 tx=0x7fad30012980 comp rx=0 tx=0).stop 2024-04-26T21:18:18.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 shutdown_connections 2024-04-26T21:18:18.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fad40130cb0 0x7fad40131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fad1c068380 0x7fad1c06a840 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fad40157b90 0x7fad40157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 --2- 172.21.15.106:0/1893400400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad24004d50 0x7fad401564f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 >> 172.21.15.106:0/1893400400 conn(0x7fad40068340 msgr2=0x7fad40160250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:18.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 shutdown_connections 2024-04-26T21:18:18.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.246+0000 7fad47c00640 1 -- 172.21.15.106:0/1893400400 wait complete. 2024-04-26T21:18:18.267 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:18:18.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.398+0000 7fa1b8a00640 1 Processor -- start 2024-04-26T21:18:18.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.398+0000 7fa1b8a00640 1 -- start start 2024-04-26T21:18:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1b8a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b4152710 0x7fa1b406f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1b8a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa1b406fff0 0x7fa1b4071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1b8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa1b4072490 0x7fa1b415f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1b8a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b406faf0 con 0x7fa1b406fff0 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1b8a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b40d0550 con 0x7fa1b4072490 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1b8a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b40d0830 con 0x7fa1b4152710 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1a9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa1b406fff0 0x7fa1b4071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1a9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa1b406fff0 0x7fa1b4071f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39314/0 (socket says 172.21.15.106:39314) 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1a9400640 1 -- 172.21.15.106:0/588997317 learned_addr learned my addr 172.21.15.106:0/588997317 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1b1e00640 1 --2- 172.21.15.106:0/588997317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b4152710 0x7fa1b406f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1b2800640 1 --2- 172.21.15.106:0/588997317 >> v2:172.21.15.112:3300/0 conn(0x7fa1b4072490 0x7fa1b415f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1a9400640 1 -- 172.21.15.106:0/588997317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b4152710 msgr2=0x7fa1b406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1a9400640 1 --2- 172.21.15.106:0/588997317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b4152710 0x7fa1b406f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1a9400640 1 -- 172.21.15.106:0/588997317 >> v2:172.21.15.112:3300/0 conn(0x7fa1b4072490 msgr2=0x7fa1b415f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1a9400640 1 --2- 172.21.15.106:0/588997317 >> v2:172.21.15.112:3300/0 conn(0x7fa1b4072490 0x7fa1b415f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1a9400640 1 -- 172.21.15.106:0/588997317 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b40b3ac0 con 0x7fa1b406fff0 2024-04-26T21:18:18.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.402+0000 7fa1a9400640 1 --2- 172.21.15.106:0/588997317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b406fff0 0x7fa1b4071f50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4073f80 tx=0x7fa19c01d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc521af47399de7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:18.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b1400640 1 -- 172.21.15.106:0/588997317 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00b040 con 0x7fa1b406fff0 2024-04-26T21:18:18.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b1400640 1 -- 172.21.15.106:0/588997317 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa19c0a7710 con 0x7fa1b406fff0 2024-04-26T21:18:18.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b1400640 1 -- 172.21.15.106:0/588997317 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0a7ae0 con 0x7fa1b406fff0 2024-04-26T21:18:18.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 -- 172.21.15.106:0/588997317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b406fff0 msgr2=0x7fa1b4071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/588997317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b406fff0 0x7fa1b4071f50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4073f80 tx=0x7fa19c01d8f0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 -- 172.21.15.106:0/588997317 shutdown_connections 2024-04-26T21:18:18.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/588997317 >> v2:172.21.15.112:3300/0 conn(0x7fa1b4072490 0x7fa1b415f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/588997317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b406fff0 0x7fa1b4071f50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/588997317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b4152710 0x7fa1b406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 -- 172.21.15.106:0/588997317 >> 172.21.15.106:0/588997317 conn(0x7fa1b4068340 msgr2=0x7fa1b4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:18.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 -- 172.21.15.106:0/588997317 shutdown_connections 2024-04-26T21:18:18.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 -- 172.21.15.106:0/588997317 wait complete. 2024-04-26T21:18:18.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 Processor -- start 2024-04-26T21:18:18.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 -- start start 2024-04-26T21:18:18.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b406fff0 0x7fa1b4150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b4072490 0x7fa1b414b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1b4152710 0x7fa1b41532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b40b4930 con 0x7fa1b4072490 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b40b47b0 con 0x7fa1b4152710 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b8a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b40b4ab0 con 0x7fa1b406fff0 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1a9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b4072490 0x7fa1b414b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1a9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b4072490 0x7fa1b414b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39318/0 (socket says 172.21.15.106:39318) 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1a9400640 1 -- 172.21.15.106:0/1944161220 learned_addr learned my addr 172.21.15.106:0/1944161220 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b1e00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b406fff0 0x7fa1b4150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.406+0000 7fa1b2800640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1b4152710 0x7fa1b41532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1a9400640 1 -- 172.21.15.106:0/1944161220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b406fff0 msgr2=0x7fa1b4150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1a9400640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b406fff0 0x7fa1b4150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1a9400640 1 -- 172.21.15.106:0/1944161220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1b4152710 msgr2=0x7fa1b41532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1a9400640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1b4152710 0x7fa1b41532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1a9400640 1 -- 172.21.15.106:0/1944161220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b40ce6c0 con 0x7fa1b4072490 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1b2800640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1b4152710 0x7fa1b41532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:18.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1a9400640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b4072490 0x7fa1b414b170 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00a1c0 tx=0x7fa19c01c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:18.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1aaa00640 1 -- 172.21.15.106:0/1944161220 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0af630 con 0x7fa1b4072490 2024-04-26T21:18:18.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1aaa00640 1 -- 172.21.15.106:0/1944161220 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa19c0bf070 con 0x7fa1b4072490 2024-04-26T21:18:18.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1aaa00640 1 -- 172.21.15.106:0/1944161220 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0afa10 con 0x7fa1b4072490 2024-04-26T21:18:18.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b40ce9a0 con 0x7fa1b4072490 2024-04-26T21:18:18.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b4152da0 con 0x7fa1b4072490 2024-04-26T21:18:18.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b4152fa0 con 0x7fa1b4072490 2024-04-26T21:18:18.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1aaa00640 1 -- 172.21.15.106:0/1944161220 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa19c0afbb0 con 0x7fa1b4072490 2024-04-26T21:18:18.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1aaa00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa190068380 0x7fa19006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1aaa00640 1 -- 172.21.15.106:0/1944161220 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7fa19c121a10 con 0x7fa1b4072490 2024-04-26T21:18:18.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.410+0000 7fa1b1e00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa190068380 0x7fa19006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.414+0000 7fa1b1e00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa190068380 0x7fa19006a840 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40cf4a0 tx=0x7fa1a400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:18.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.414+0000 7fa1aaa00640 1 -- 172.21.15.106:0/1944161220 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa1b4152fa0 con 0x7fa1b4072490 2024-04-26T21:18:18.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1b4069400 con 0x7fa1b4072490 2024-04-26T21:18:18.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1aaa00640 1 -- 172.21.15.106:0/1944161220 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5183 (secure 0 0 0) 0x7fa19c0174e0 con 0x7fa1b4072490 2024-04-26T21:18:18.609 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:18.609 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/791761080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":791761080},{"type":"v1","addr":"172.21.15.106:6836","nonce":791761080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:17:42.703325+0000","modified":"2024-04-26T21:18:10.975225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5413},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5413":{"gid":5413,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6837/967590660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":967590660},{"type":"v1","addr":"172.21.15.106:6837","nonce":967590660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5413,"qdb_cluster":[5413]},"id":2}]} 2024-04-26T21:18:18.609 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 24 2024-04-26T21:18:18.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa190068380 msgr2=0x7fa19006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa190068380 0x7fa19006a840 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40cf4a0 tx=0x7fa1a400b040 comp rx=0 tx=0).stop 2024-04-26T21:18:18.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b4072490 msgr2=0x7fa1b414b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b4072490 0x7fa1b414b170 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00a1c0 tx=0x7fa19c01c130 comp rx=0 tx=0).stop 2024-04-26T21:18:18.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 shutdown_connections 2024-04-26T21:18:18.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1b4152710 0x7fa1b41532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fa190068380 0x7fa19006a840 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b4072490 0x7fa1b414b170 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 --2- 172.21.15.106:0/1944161220 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa1b406fff0 0x7fa1b4150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 >> 172.21.15.106:0/1944161220 conn(0x7fa1b4068340 msgr2=0x7fa1b40cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:18.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 shutdown_connections 2024-04-26T21:18:18.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.606+0000 7fa1b8a00640 1 -- 172.21.15.106:0/1944161220 wait complete. 2024-04-26T21:18:18.630 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:18:18.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5dd600640 1 Processor -- start 2024-04-26T21:18:18.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5dd600640 1 -- start start 2024-04-26T21:18:18.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5dd600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 0x7fd5d80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5dd600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5d80cdc50 0x7fd5d80ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5dd600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d80d1d70 con 0x7fd5d815f3d0 2024-04-26T21:18:18.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5dd600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d80d2050 con 0x7fd5d80cdc50 2024-04-26T21:18:18.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5dd600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d80cd450 con 0x7fd5d80d37f0 2024-04-26T21:18:18.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5d7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5d80cdc50 0x7fd5d80ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5d6a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd5d815f3d0 0x7fd5d80cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47194/0 (socket says 172.21.15.106:47194) 2024-04-26T21:18:18.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5d6a00640 1 -- 172.21.15.106:0/1499407508 learned_addr learned my addr 172.21.15.106:0/1499407508 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:18.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5d6000640 1 --2- 172.21.15.106:0/1499407508 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 0x7fd5d80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5d7400640 1 -- 172.21.15.106:0/1499407508 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 msgr2=0x7fd5d80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:18.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5d7400640 1 --2- 172.21.15.106:0/1499407508 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 0x7fd5d80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5d7400640 1 -- 172.21.15.106:0/1499407508 >> v1:172.21.15.106:6789/0 conn(0x7fd5d815f3d0 legacy=0x7fd5d80cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5d7400640 1 -- 172.21.15.106:0/1499407508 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d80cd730 con 0x7fd5d80cdc50 2024-04-26T21:18:18.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.762+0000 7fd5d6000640 1 --2- 172.21.15.106:0/1499407508 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 0x7fd5d80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5d7400640 1 --2- 172.21.15.106:0/1499407508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 0x7fd5d80ce0e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009d90 tx=0x7fd5d001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3aaeb45c5ea34c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5d5600640 1 -- 172.21.15.106:0/1499407508 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d00b2070 con 0x7fd5d80cdc50 2024-04-26T21:18:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5d5600640 1 -- 172.21.15.106:0/1499407508 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d00a5830 con 0x7fd5d80cdc50 2024-04-26T21:18:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5d5600640 1 -- 172.21.15.106:0/1499407508 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d00a5c00 con 0x7fd5d80cdc50 2024-04-26T21:18:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5dd600640 1 -- 172.21.15.106:0/1499407508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 msgr2=0x7fd5d80ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5dd600640 1 --2- 172.21.15.106:0/1499407508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 0x7fd5d80ce0e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009d90 tx=0x7fd5d001c970 comp rx=0 tx=0).stop 2024-04-26T21:18:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5dd600640 1 -- 172.21.15.106:0/1499407508 shutdown_connections 2024-04-26T21:18:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5dd600640 1 --2- 172.21.15.106:0/1499407508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 0x7fd5d80ce0e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5dd600640 1 --2- 172.21.15.106:0/1499407508 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 0x7fd5d80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5dd600640 1 -- 172.21.15.106:0/1499407508 >> 172.21.15.106:0/1499407508 conn(0x7fd5d80d2c60 msgr2=0x7fd5d80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5dd600640 1 -- 172.21.15.106:0/1499407508 shutdown_connections 2024-04-26T21:18:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.766+0000 7fd5dd600640 1 -- 172.21.15.106:0/1499407508 wait complete. 2024-04-26T21:18:18.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 Processor -- start 2024-04-26T21:18:18.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 -- start start 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 0x7fd5d815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 0x7fd5d814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d815f3d0 0x7fd5d815d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d816c010 con 0x7fd5d80cdc50 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d80d0340 con 0x7fd5d815f3d0 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d816c190 con 0x7fd5d80d37f0 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 0x7fd5d815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 0x7fd5d815ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39346/0 (socket says 172.21.15.106:39346) 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6a00640 1 -- 172.21.15.106:0/3708039717 learned_addr learned my addr 172.21.15.106:0/3708039717 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6000640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 0x7fd5d814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d7400640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d815f3d0 0x7fd5d815d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6a00640 1 -- 172.21.15.106:0/3708039717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 msgr2=0x7fd5d814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6a00640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 0x7fd5d814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6a00640 1 -- 172.21.15.106:0/3708039717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d815f3d0 msgr2=0x7fd5d815d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6a00640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d815f3d0 0x7fd5d815d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6a00640 1 -- 172.21.15.106:0/3708039717 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d815c250 con 0x7fd5d80cdc50 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5d6a00640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 0x7fd5d815ccc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c370 tx=0x7fd5c800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5cea00640 1 -- 172.21.15.106:0/3708039717 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8017070 con 0x7fd5d80cdc50 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5cea00640 1 -- 172.21.15.106:0/3708039717 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c8005cf0 con 0x7fd5d80cdc50 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d815de40 con 0x7fd5d80cdc50 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5cea00640 1 -- 172.21.15.106:0/3708039717 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80072f0 con 0x7fd5d80cdc50 2024-04-26T21:18:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.770+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d815c7a0 con 0x7fd5d80cdc50 2024-04-26T21:18:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.774+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d8069400 con 0x7fd5d80cdc50 2024-04-26T21:18:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.774+0000 7fd5cea00640 1 -- 172.21.15.106:0/3708039717 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd5c801a070 con 0x7fd5d80cdc50 2024-04-26T21:18:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.774+0000 7fd5cea00640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd5b8068380 0x7fd5b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.774+0000 7fd5cea00640 1 -- 172.21.15.106:0/3708039717 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7fd5c8085ef0 con 0x7fd5d80cdc50 2024-04-26T21:18:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.774+0000 7fd5d6000640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd5b8068380 0x7fd5b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:18.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.774+0000 7fd5d6000640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd5b8068380 0x7fd5b806a840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80b3a50 tx=0x7fd5c4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:18.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.778+0000 7fd5cea00640 1 -- 172.21.15.106:0/3708039717 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd5c8056210 con 0x7fd5d80cdc50 2024-04-26T21:18:18.902 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:18:18.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:18:18.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.934+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5d806e2a0 con 0x7fd5d80cdc50 2024-04-26T21:18:18.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5cea00640 1 -- 172.21.15.106:0/3708039717 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+17114 (secure 0 0 0) 0x7fd5c8055b10 con 0x7fd5d80cdc50 2024-04-26T21:18:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:18.941 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:18:06.945586+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:17:40.370502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-26T21:17:41.669690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6836/1043820033":"2024-04-27T21:18:06.945562+0000","172.21.15.106:6834/1043820033":"2024-04-27T21:18:06.945562+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:18:18.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd5b8068380 msgr2=0x7fd5b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd5b8068380 0x7fd5b806a840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80b3a50 tx=0x7fd5c4008040 comp rx=0 tx=0).stop 2024-04-26T21:18:18.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 msgr2=0x7fd5d815ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:18.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 0x7fd5d815ccc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c370 tx=0x7fd5c800c830 comp rx=0 tx=0).stop 2024-04-26T21:18:18.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 shutdown_connections 2024-04-26T21:18:18.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5d815f3d0 0x7fd5d815d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fd5b8068380 0x7fd5b806a840 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd5d80d37f0 0x7fd5d814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 --2- 172.21.15.106:0/3708039717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d80cdc50 0x7fd5d815ccc0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:18.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 >> 172.21.15.106:0/3708039717 conn(0x7fd5d80d2c60 msgr2=0x7fd5d815ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:18.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 shutdown_connections 2024-04-26T21:18:18.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:18.938+0000 7fd5dd600640 1 -- 172.21.15.106:0/3708039717 wait complete. 2024-04-26T21:18:18.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T21:18:19.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f734c200640 1 Processor -- start 2024-04-26T21:18:19.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f734c200640 1 -- start start 2024-04-26T21:18:19.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f734c200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 0x7f734415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f734c200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f734406eb70 0x7f73440d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f734c200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73440b3d10 con 0x7f734413f140 2024-04-26T21:18:19.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f734c200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f73440b3ac0 con 0x7f734406eb70 2024-04-26T21:18:19.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f734c200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f73440b4920 con 0x7f734413ed60 2024-04-26T21:18:19.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f7348e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f734413f140 0x7f73440b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47210/0 (socket says 172.21.15.106:47210) 2024-04-26T21:18:19.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f7348e00640 1 -- 172.21.15.106:0/2211085475 learned_addr learned my addr 172.21.15.106:0/2211085475 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:19.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f7349800640 1 --2- 172.21.15.106:0/2211085475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 0x7f734415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.142+0000 7f734a200640 1 --2- 172.21.15.106:0/2211085475 >> v2:172.21.15.112:3300/0 conn(0x7f734406eb70 0x7f73440d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.146+0000 7f7343e00640 1 -- 172.21.15.106:0/2211085475 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253885357 0 0) 0x7f73440b3d10 con 0x7f734413f140 2024-04-26T21:18:19.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.146+0000 7f7343e00640 1 -- 172.21.15.106:0/2211085475 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f732c003530 con 0x7f734413f140 2024-04-26T21:18:19.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.146+0000 7f734a200640 1 -- 172.21.15.106:0/2211085475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 msgr2=0x7f734415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:19.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.146+0000 7f734a200640 1 --2- 172.21.15.106:0/2211085475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 0x7f734415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.146+0000 7f734a200640 1 -- 172.21.15.106:0/2211085475 >> v1:172.21.15.106:6789/0 conn(0x7f734413f140 legacy=0x7f73440b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.146+0000 7f734a200640 1 -- 172.21.15.106:0/2211085475 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73440b3ff0 con 0x7f734406eb70 2024-04-26T21:18:19.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.146+0000 7f7349800640 1 --2- 172.21.15.106:0/2211085475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 0x7f734415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:19.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.146+0000 7f734a200640 1 --2- 172.21.15.106:0/2211085475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f734406eb70 0x7f73440d0df0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f733c009d90 tx=0x7f733c01c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b09993a7a2f62741 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:19.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f7343e00640 1 -- 172.21.15.106:0/2211085475 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c0b2070 con 0x7f734406eb70 2024-04-26T21:18:19.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f7343e00640 1 -- 172.21.15.106:0/2211085475 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c0a5820 con 0x7f734406eb70 2024-04-26T21:18:19.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f7343e00640 1 -- 172.21.15.106:0/2211085475 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c0a5bf0 con 0x7f734406eb70 2024-04-26T21:18:19.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 -- 172.21.15.106:0/2211085475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f734406eb70 msgr2=0x7f73440d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 --2- 172.21.15.106:0/2211085475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f734406eb70 0x7f73440d0df0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f733c009d90 tx=0x7f733c01c850 comp rx=0 tx=0).stop 2024-04-26T21:18:19.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 -- 172.21.15.106:0/2211085475 shutdown_connections 2024-04-26T21:18:19.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 --2- 172.21.15.106:0/2211085475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f734406eb70 0x7f73440d0df0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 --2- 172.21.15.106:0/2211085475 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 0x7f734415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 -- 172.21.15.106:0/2211085475 >> 172.21.15.106:0/2211085475 conn(0x7f7344068340 msgr2=0x7f7344068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:19.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 -- 172.21.15.106:0/2211085475 shutdown_connections 2024-04-26T21:18:19.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 -- 172.21.15.106:0/2211085475 wait complete. 2024-04-26T21:18:19.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 Processor -- start 2024-04-26T21:18:19.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 -- start start 2024-04-26T21:18:19.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 0x7f7344139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f734413a1c0 0x7f734413db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73441f7c50 0x7f734415e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7344160790 con 0x7f734413a1c0 2024-04-26T21:18:19.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7344160610 con 0x7f73441f7c50 2024-04-26T21:18:19.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734c200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7344071f50 con 0x7f734413ed60 2024-04-26T21:18:19.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f7348e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f734413a1c0 0x7f734413db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f7348e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f734413a1c0 0x7f734413db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39360/0 (socket says 172.21.15.106:39360) 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f7348e00640 1 -- 172.21.15.106:0/391013539 learned_addr learned my addr 172.21.15.106:0/391013539 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f7349800640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 0x7f7344139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.150+0000 7f734a200640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73441f7c50 0x7f734415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7348e00640 1 -- 172.21.15.106:0/391013539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 msgr2=0x7f7344139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7348e00640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 0x7f7344139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7348e00640 1 -- 172.21.15.106:0/391013539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73441f7c50 msgr2=0x7f734415e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7348e00640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73441f7c50 0x7f734415e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7348e00640 1 -- 172.21.15.106:0/391013539 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734413e050 con 0x7f734413a1c0 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f734a200640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73441f7c50 0x7f734415e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7348e00640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f734413a1c0 0x7f734413db10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f733000c400 tx=0x7f733000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7341600640 1 -- 172.21.15.106:0/391013539 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330017070 con 0x7f734413a1c0 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7341600640 1 -- 172.21.15.106:0/391013539 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7330005d10 con 0x7f734413a1c0 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7341600640 1 -- 172.21.15.106:0/391013539 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330007310 con 0x7f734413a1c0 2024-04-26T21:18:19.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73440b1a40 con 0x7f734413a1c0 2024-04-26T21:18:19.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73440b2000 con 0x7f734413a1c0 2024-04-26T21:18:19.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7344069400 con 0x7f734413a1c0 2024-04-26T21:18:19.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7341600640 1 -- 172.21.15.106:0/391013539 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f733001a070 con 0x7f734413a1c0 2024-04-26T21:18:19.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7341600640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f73240683b0 0x7f732406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7341600640 1 -- 172.21.15.106:0/391013539 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f7330085f50 con 0x7f734413a1c0 2024-04-26T21:18:19.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.154+0000 7f7349800640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f73240683b0 0x7f732406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.158+0000 7f7349800640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f73240683b0 0x7f732406a870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7338009580 tx=0x7f7338009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:19.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.158+0000 7f7341600640 1 -- 172.21.15.106:0/391013539 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7330055c20 con 0x7f734413a1c0 2024-04-26T21:18:19.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.350+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f73440cd4c0 con 0x7f734413a1c0 2024-04-26T21:18:19.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T21:18:19.350+0000 7fc9b4000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:18:19.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.354+0000 7f7341600640 1 -- 172.21.15.106:0/391013539 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 161+0+0 (secure 0 0 0) 0x7f7330059f20 con 0x7f734413a1c0 2024-04-26T21:18:19.357 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T21:18:19.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f73240683b0 msgr2=0x7f732406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f73240683b0 0x7f732406a870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7338009580 tx=0x7f7338009190 comp rx=0 tx=0).stop 2024-04-26T21:18:19.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f734413a1c0 msgr2=0x7f734413db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f734413a1c0 0x7f734413db10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f733000c400 tx=0x7f733000c8c0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 shutdown_connections 2024-04-26T21:18:19.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73441f7c50 0x7f734415e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f73240683b0 0x7f732406a870 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f734413a1c0 0x7f734413db10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 --2- 172.21.15.106:0/391013539 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f734413ed60 0x7f7344139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 >> 172.21.15.106:0/391013539 conn(0x7f7344068340 msgr2=0x7f73440cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:19.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 shutdown_connections 2024-04-26T21:18:19.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.358+0000 7f734c200640 1 -- 172.21.15.106:0/391013539 wait complete. 2024-04-26T21:18:19.369 INFO:tasks.ceph.mds.a.smithi106.stderr: -527> 2024-04-26T21:18:12.294+0000 7f485cc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:18:19.380 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T21:18:19.412 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2024-04-26T21:18:19.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.518+0000 7fcb65c00640 1 Processor -- start 2024-04-26T21:18:19.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.518+0000 7fcb65c00640 1 -- start start 2024-04-26T21:18:19.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb65c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb6015c4e0 0x7fcb6015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb65c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 0x7fcb600b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb65c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6015ce00 con 0x7fcb6015fa20 2024-04-26T21:18:19.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb65c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6015d5f0 con 0x7fcb6015c4e0 2024-04-26T21:18:19.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb65c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcb600b4f00 con 0x7fcb6015d080 2024-04-26T21:18:19.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb5ea00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb6015c4e0 0x7fcb6015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb5f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcb6015fa20 0x7fcb6015feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47236/0 (socket says 172.21.15.106:47236) 2024-04-26T21:18:19.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb5f400640 1 -- 172.21.15.106:0/3308873634 learned_addr learned my addr 172.21.15.106:0/3308873634 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:19.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb57e00640 1 --2- 172.21.15.106:0/3308873634 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 0x7fcb600b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb5ea00640 1 -- 172.21.15.106:0/3308873634 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 msgr2=0x7fcb600b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:19.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb5ea00640 1 --2- 172.21.15.106:0/3308873634 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 0x7fcb600b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb5ea00640 1 -- 172.21.15.106:0/3308873634 >> v1:172.21.15.106:6789/0 conn(0x7fcb6015fa20 legacy=0x7fcb6015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.522+0000 7fcb5ea00640 1 -- 172.21.15.106:0/3308873634 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb600b51e0 con 0x7fcb6015c4e0 2024-04-26T21:18:19.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb5ea00640 1 --2- 172.21.15.106:0/3308873634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 0x7fcb6015c8c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcb500097c0 tx=0x7fcb5001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e07a603182a27f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:19.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb5e000640 1 -- 172.21.15.106:0/3308873634 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500a7070 con 0x7fcb6015c4e0 2024-04-26T21:18:19.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb5e000640 1 -- 172.21.15.106:0/3308873634 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb500b0070 con 0x7fcb6015c4e0 2024-04-26T21:18:19.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb5e000640 1 -- 172.21.15.106:0/3308873634 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500ab890 con 0x7fcb6015c4e0 2024-04-26T21:18:19.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 -- 172.21.15.106:0/3308873634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 msgr2=0x7fcb6015c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 --2- 172.21.15.106:0/3308873634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 0x7fcb6015c8c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcb500097c0 tx=0x7fcb5001c470 comp rx=0 tx=0).stop 2024-04-26T21:18:19.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 -- 172.21.15.106:0/3308873634 shutdown_connections 2024-04-26T21:18:19.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 --2- 172.21.15.106:0/3308873634 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 0x7fcb600b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 --2- 172.21.15.106:0/3308873634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 0x7fcb6015c8c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 -- 172.21.15.106:0/3308873634 >> 172.21.15.106:0/3308873634 conn(0x7fcb600b2910 msgr2=0x7fcb600b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:19.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 -- 172.21.15.106:0/3308873634 shutdown_connections 2024-04-26T21:18:19.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 -- 172.21.15.106:0/3308873634 wait complete. 2024-04-26T21:18:19.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 Processor -- start 2024-04-26T21:18:19.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.526+0000 7fcb65c00640 1 -- start start 2024-04-26T21:18:19.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb65c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 0x7fcb6013f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb65c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 0x7fcb60141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb65c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6015fa20 0x7fcb60140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb65c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcb600b4ce0 con 0x7fcb6015c4e0 2024-04-26T21:18:19.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb65c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcb600b4b60 con 0x7fcb6015fa20 2024-04-26T21:18:19.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb65c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcb601695d0 con 0x7fcb6015d080 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 0x7fcb6013f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 0x7fcb6013f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39388/0 (socket says 172.21.15.106:39388) 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5ea00640 1 -- 172.21.15.106:0/3886966468 learned_addr learned my addr 172.21.15.106:0/3886966468 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5f400640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6015fa20 0x7fcb60140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb57e00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 0x7fcb60141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5ea00640 1 -- 172.21.15.106:0/3886966468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 msgr2=0x7fcb60141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5ea00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 0x7fcb60141160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5ea00640 1 -- 172.21.15.106:0/3886966468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6015fa20 msgr2=0x7fcb60140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5ea00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6015fa20 0x7fcb60140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:19.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5ea00640 1 -- 172.21.15.106:0/3886966468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6013f870 con 0x7fcb6015c4e0 2024-04-26T21:18:19.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb5ea00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 0x7fcb6013f250 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fcb500ad040 tx=0x7fcb5001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:19.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb56a00640 1 -- 172.21.15.106:0/3886966468 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500bf610 con 0x7fcb6015c4e0 2024-04-26T21:18:19.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb56a00640 1 -- 172.21.15.106:0/3886966468 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb500bf7f0 con 0x7fcb6015c4e0 2024-04-26T21:18:19.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb56a00640 1 -- 172.21.15.106:0/3886966468 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500bfbe0 con 0x7fcb6015c4e0 2024-04-26T21:18:19.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6013fb50 con 0x7fcb6015c4e0 2024-04-26T21:18:19.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb60140110 con 0x7fcb6015c4e0 2024-04-26T21:18:19.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb60069400 con 0x7fcb6015c4e0 2024-04-26T21:18:19.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.530+0000 7fcb56a00640 1 -- 172.21.15.106:0/3886966468 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb500bd020 con 0x7fcb6015c4e0 2024-04-26T21:18:19.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.534+0000 7fcb56a00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb3c068380 0x7fcb3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:19.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.534+0000 7fcb56a00640 1 -- 172.21.15.106:0/3886966468 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6302+0+0 (secure 0 0 0) 0x7fcb50120fe0 con 0x7fcb6015c4e0 2024-04-26T21:18:19.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.534+0000 7fcb57e00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb3c068380 0x7fcb3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:19.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.534+0000 7fcb57e00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb3c068380 0x7fcb3c06a840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcb60074150 tx=0x7fcb48008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:19.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.538+0000 7fcb56a00640 1 -- 172.21.15.106:0/3886966468 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb500c6030 con 0x7fcb6015c4e0 2024-04-26T21:18:19.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:19.730+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcb6006e2a0 con 0x7fcb6015c4e0 2024-04-26T21:18:20.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.354+0000 7fcb56a00640 1 -- 172.21.15.106:0/3886966468 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) ==== 104+0+0 (secure 0 0 0) 0x7fcb50016090 con 0x7fcb6015c4e0 2024-04-26T21:18:20.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb3c068380 msgr2=0x7fcb3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:20.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb3c068380 0x7fcb3c06a840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcb60074150 tx=0x7fcb48008040 comp rx=0 tx=0).stop 2024-04-26T21:18:20.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 msgr2=0x7fcb6013f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:20.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 0x7fcb6013f250 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fcb500ad040 tx=0x7fcb5001acb0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 shutdown_connections 2024-04-26T21:18:20.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb6015fa20 0x7fcb60140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fcb3c068380 0x7fcb3c06a840 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcb6015d080 0x7fcb60141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 --2- 172.21.15.106:0/3886966468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6015c4e0 0x7fcb6013f250 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 >> 172.21.15.106:0/3886966468 conn(0x7fcb600b2910 msgr2=0x7fcb6006e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:20.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 shutdown_connections 2024-04-26T21:18:20.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.358+0000 7fcb65c00640 1 -- 172.21.15.106:0/3886966468 wait complete. 2024-04-26T21:18:20.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T21:18:20.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab8c00640 1 Processor -- start 2024-04-26T21:18:20.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab8c00640 1 -- start start 2024-04-26T21:18:20.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab8c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feab40b3e00 0x7feab40cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:20.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab8c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b38b0 0x7feab4163510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:20.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab8c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab40b53c0 con 0x7feab4163130 2024-04-26T21:18:20.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab8c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7feab40d1690 con 0x7feab40b3e00 2024-04-26T21:18:20.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab8c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7feab40b5170 con 0x7feab40b38b0 2024-04-26T21:18:20.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b38b0 0x7feab4163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:20.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab3e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b38b0 0x7feab4163510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:52492/0 (socket says 172.21.15.106:52492) 2024-04-26T21:18:20.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab3e00640 1 -- 172.21.15.106:0/4072421942 learned_addr learned my addr 172.21.15.106:0/4072421942 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:20.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab2a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feab40b3e00 0x7feab40cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:20.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab3e00640 1 -- 172.21.15.106:0/4072421942 >> v2:172.21.15.112:3300/0 conn(0x7feab40b3e00 msgr2=0x7feab40cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:20.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab3e00640 1 --2- 172.21.15.106:0/4072421942 >> v2:172.21.15.112:3300/0 conn(0x7feab40b3e00 0x7feab40cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab3e00640 1 -- 172.21.15.106:0/4072421942 >> v1:172.21.15.112:6789/0 conn(0x7feab4163130 legacy=0x7feab40cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:20.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab3e00640 1 -- 172.21.15.106:0/4072421942 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab4163ca0 con 0x7feab40b38b0 2024-04-26T21:18:20.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.570+0000 7feab2a00640 1 --2- 172.21.15.106:0/4072421942 >> v2:172.21.15.112:3300/0 conn(0x7feab40b3e00 0x7feab40cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:20.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab3e00640 1 --2- 172.21.15.106:0/4072421942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b38b0 0x7feab4163510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feaac009e50 tx=0x7feaac01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a1ef50c2458fa08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:20.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab2000640 1 -- 172.21.15.106:0/4072421942 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0a5810 con 0x7feab40b38b0 2024-04-26T21:18:20.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab2000640 1 -- 172.21.15.106:0/4072421942 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaac0a59b0 con 0x7feab40b38b0 2024-04-26T21:18:20.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab2000640 1 -- 172.21.15.106:0/4072421942 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0a5d80 con 0x7feab40b38b0 2024-04-26T21:18:20.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab8c00640 1 -- 172.21.15.106:0/4072421942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b38b0 msgr2=0x7feab4163510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:20.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab8c00640 1 --2- 172.21.15.106:0/4072421942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b38b0 0x7feab4163510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feaac009e50 tx=0x7feaac01ca30 comp rx=0 tx=0).stop 2024-04-26T21:18:20.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab8c00640 1 -- 172.21.15.106:0/4072421942 shutdown_connections 2024-04-26T21:18:20.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab8c00640 1 --2- 172.21.15.106:0/4072421942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b38b0 0x7feab4163510 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab8c00640 1 --2- 172.21.15.106:0/4072421942 >> v2:172.21.15.112:3300/0 conn(0x7feab40b3e00 0x7feab40cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab8c00640 1 -- 172.21.15.106:0/4072421942 >> 172.21.15.106:0/4072421942 conn(0x7feab40b4680 msgr2=0x7feab40b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:20.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab8c00640 1 -- 172.21.15.106:0/4072421942 shutdown_connections 2024-04-26T21:18:20.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.574+0000 7feab8c00640 1 -- 172.21.15.106:0/4072421942 wait complete. 2024-04-26T21:18:20.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 Processor -- start 2024-04-26T21:18:20.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 -- start start 2024-04-26T21:18:20.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab40b38b0 0x7feab4156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:20.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b3e00 0x7feab41455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:20.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab4163130 0x7feab415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:20.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feab406e670 con 0x7feab4163130 2024-04-26T21:18:20.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feab406e4f0 con 0x7feab40b38b0 2024-04-26T21:18:20.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7feab406e7f0 con 0x7feab40b3e00 2024-04-26T21:18:20.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab4163130 0x7feab415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:20.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b3e00 0x7feab41455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:20.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab2a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b3e00 0x7feab41455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:52502/0 (socket says 172.21.15.106:52502) 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab3400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab40b38b0 0x7feab4156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab2a00640 1 -- 172.21.15.106:0/2812764770 learned_addr learned my addr 172.21.15.106:0/2812764770 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab3e00640 1 -- 172.21.15.106:0/2812764770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b3e00 msgr2=0x7feab41455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab3e00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b3e00 0x7feab41455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab3e00640 1 -- 172.21.15.106:0/2812764770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab40b38b0 msgr2=0x7feab4156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab3e00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab40b38b0 0x7feab4156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab3e00640 1 -- 172.21.15.106:0/2812764770 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab4145b00 con 0x7feab4163130 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab2a00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b3e00 0x7feab41455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab3400640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab40b38b0 0x7feab4156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:20.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab3e00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab4163130 0x7feab415e2d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feaac0ab000 tx=0x7feaac0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:20.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feaab400640 1 -- 172.21.15.106:0/2812764770 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0bc030 con 0x7feab4163130 2024-04-26T21:18:20.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feaab400640 1 -- 172.21.15.106:0/2812764770 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaac0b8470 con 0x7feab4163130 2024-04-26T21:18:20.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab40b5cf0 con 0x7feab4163130 2024-04-26T21:18:20.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feaab400640 1 -- 172.21.15.106:0/2812764770 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0b8820 con 0x7feab4163130 2024-04-26T21:18:20.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab40b62b0 con 0x7feab4163130 2024-04-26T21:18:20.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.578+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab4069400 con 0x7feab4163130 2024-04-26T21:18:20.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.582+0000 7feaab400640 1 -- 172.21.15.106:0/2812764770 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feaac0bf070 con 0x7feab4163130 2024-04-26T21:18:20.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.582+0000 7feaab400640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fea940683b0 0x7fea9406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:20.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.582+0000 7feaab400640 1 -- 172.21.15.106:0/2812764770 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6302+0+0 (secure 0 0 0) 0x7feaac121340 con 0x7feab4163130 2024-04-26T21:18:20.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.582+0000 7feab3400640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fea940683b0 0x7fea9406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:20.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.582+0000 7feab3400640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fea940683b0 0x7fea9406a870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feab40b4c80 tx=0x7feaa4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:20.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.586+0000 7feaab400640 1 -- 172.21.15.106:0/2812764770 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feab4145b00 con 0x7feab4163130 2024-04-26T21:18:20.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:20.746+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7feab40b8af0 con 0x7feab4163130 2024-04-26T21:18:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feaab400640 1 -- 172.21.15.106:0/2812764770 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) ==== 181+0+0 (secure 0 0 0) 0x7feaac016620 con 0x7feab4163130 2024-04-26T21:18:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' removed 2024-04-26T21:18:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fea940683b0 msgr2=0x7fea9406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fea940683b0 0x7fea9406a870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feab40b4c80 tx=0x7feaa4009040 comp rx=0 tx=0).stop 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab4163130 msgr2=0x7feab415e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab4163130 0x7feab415e2d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feaac0ab000 tx=0x7feaac0197d0 comp rx=0 tx=0).stop 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 shutdown_connections 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fea940683b0 0x7fea9406a870 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feab4163130 0x7feab415e2d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feab40b3e00 0x7feab41455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 --2- 172.21.15.106:0/2812764770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feab40b38b0 0x7feab4156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.358+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 >> 172.21.15.106:0/2812764770 conn(0x7feab40b4680 msgr2=0x7feab40b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.362+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 shutdown_connections 2024-04-26T21:18:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.362+0000 7feab8c00640 1 -- 172.21.15.106:0/2812764770 wait complete. 2024-04-26T21:18:21.384 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T21:18:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.522+0000 7fc296800640 1 Processor -- start 2024-04-26T21:18:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.522+0000 7fc296800640 1 -- start start 2024-04-26T21:18:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc296800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc29015efd0 0x7fc29006df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc296800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2900b1720 con 0x7fc29006e470 2024-04-26T21:18:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc296800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29006e870 con 0x7fc29015f3b0 2024-04-26T21:18:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc296800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fc2900b0680 con 0x7fc29015efd0 2024-04-26T21:18:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc295400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc29015efd0 0x7fc29006df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc295e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc29006e470 0x7fc2900b7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47244/0 (socket says 172.21.15.106:47244) 2024-04-26T21:18:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc295e00640 1 -- 172.21.15.106:0/2829798620 learned_addr learned my addr 172.21.15.106:0/2829798620 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc295400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc29015efd0 0x7fc29006df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39408/0 (socket says 172.21.15.106:39408) 2024-04-26T21:18:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc295400640 1 -- 172.21.15.106:0/2829798620 >> v1:172.21.15.112:6789/0 conn(0x7fc29015f3b0 legacy=0x7fc2900b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc295400640 1 -- 172.21.15.106:0/2829798620 >> v1:172.21.15.106:6789/0 conn(0x7fc29006e470 legacy=0x7fc2900b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc295400640 1 -- 172.21.15.106:0/2829798620 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2900b0960 con 0x7fc29015efd0 2024-04-26T21:18:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.526+0000 7fc28fe00640 1 -- 172.21.15.106:0/2829798620 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537396762 0 0) 0x7fc2900b1720 con 0x7fc29006e470 2024-04-26T21:18:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc295400640 1 --2- 172.21.15.106:0/2829798620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015efd0 0x7fc29006df30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc284009d90 tx=0x7fc28401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aaa442ed61e2cc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc28fe00640 1 -- 172.21.15.106:0/2829798620 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840b2070 con 0x7fc29015efd0 2024-04-26T21:18:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc28fe00640 1 -- 172.21.15.106:0/2829798620 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2840a5a00 con 0x7fc29015efd0 2024-04-26T21:18:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc28fe00640 1 -- 172.21.15.106:0/2829798620 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840a5dd0 con 0x7fc29015efd0 2024-04-26T21:18:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 -- 172.21.15.106:0/2829798620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015efd0 msgr2=0x7fc29006df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 --2- 172.21.15.106:0/2829798620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015efd0 0x7fc29006df30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc284009d90 tx=0x7fc28401c940 comp rx=0 tx=0).stop 2024-04-26T21:18:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 -- 172.21.15.106:0/2829798620 shutdown_connections 2024-04-26T21:18:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 --2- 172.21.15.106:0/2829798620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015efd0 0x7fc29006df30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 -- 172.21.15.106:0/2829798620 >> 172.21.15.106:0/2829798620 conn(0x7fc2900b7ee0 msgr2=0x7fc2900b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 -- 172.21.15.106:0/2829798620 shutdown_connections 2024-04-26T21:18:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 -- 172.21.15.106:0/2829798620 wait complete. 2024-04-26T21:18:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 Processor -- start 2024-04-26T21:18:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 -- start start 2024-04-26T21:18:21.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc29006e470 0x7fc29014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29015efd0 0x7fc29014c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015f3b0 0x7fc2901f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc2900b7b40 con 0x7fc29015f3b0 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc2900b0300 con 0x7fc29006e470 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc296800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc2900b7cc0 con 0x7fc29015efd0 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.530+0000 7fc295e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015f3b0 0x7fc2901f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015f3b0 0x7fc2901f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39424/0 (socket says 172.21.15.106:39424) 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295e00640 1 -- 172.21.15.106:0/4176633507 learned_addr learned my addr 172.21.15.106:0/4176633507 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295400640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc29006e470 0x7fc29014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc294a00640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29015efd0 0x7fc29014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295e00640 1 -- 172.21.15.106:0/4176633507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29015efd0 msgr2=0x7fc29014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295e00640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29015efd0 0x7fc29014c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295e00640 1 -- 172.21.15.106:0/4176633507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc29006e470 msgr2=0x7fc29014f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295e00640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc29006e470 0x7fc29014f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295e00640 1 -- 172.21.15.106:0/4176633507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29014e0a0 con 0x7fc29015f3b0 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc294a00640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29015efd0 0x7fc29014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295e00640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015f3b0 0x7fc2901f8560 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc28800c4b0 tx=0x7fc28800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc28d600640 1 -- 172.21.15.106:0/4176633507 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288018070 con 0x7fc29015f3b0 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc28d600640 1 -- 172.21.15.106:0/4176633507 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2880074e0 con 0x7fc29015f3b0 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc28d600640 1 -- 172.21.15.106:0/4176633507 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288004a30 con 0x7fc29015f3b0 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29014e380 con 0x7fc29015f3b0 2024-04-26T21:18:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29014e940 con 0x7fc29015f3b0 2024-04-26T21:18:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29014ee20 con 0x7fc29015f3b0 2024-04-26T21:18:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc28d600640 1 -- 172.21.15.106:0/4176633507 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc28801b070 con 0x7fc29015f3b0 2024-04-26T21:18:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc28d600640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc270068380 0x7fc27006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc28d600640 1 -- 172.21.15.106:0/4176633507 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5864+0+0 (secure 0 0 0) 0x7fc288085c40 con 0x7fc29015f3b0 2024-04-26T21:18:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.534+0000 7fc295400640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc270068380 0x7fc27006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.538+0000 7fc295400640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc270068380 0x7fc27006a840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc2840af000 tx=0x7fc2840a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.538+0000 7fc28d600640 1 -- 172.21.15.106:0/4176633507 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc29014ee20 con 0x7fc29015f3b0 2024-04-26T21:18:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:21.702+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc2900b4310 con 0x7fc29015f3b0 2024-04-26T21:18:22.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.358+0000 7fc28d600640 1 -- 172.21.15.106:0/4176633507 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) ==== 169+0+0 (secure 0 0 0) 0x7fc288055b00 con 0x7fc29015f3b0 2024-04-26T21:18:22.363 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' removed 2024-04-26T21:18:22.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc270068380 msgr2=0x7fc27006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc270068380 0x7fc27006a840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc2840af000 tx=0x7fc2840a7070 comp rx=0 tx=0).stop 2024-04-26T21:18:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015f3b0 msgr2=0x7fc2901f8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015f3b0 0x7fc2901f8560 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc28800c4b0 tx=0x7fc28800c970 comp rx=0 tx=0).stop 2024-04-26T21:18:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 shutdown_connections 2024-04-26T21:18:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc270068380 0x7fc27006a840 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29015f3b0 0x7fc2901f8560 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc29015efd0 0x7fc29014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 --2- 172.21.15.106:0/4176633507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc29006e470 0x7fc29014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 >> 172.21.15.106:0/4176633507 conn(0x7fc2900b7ee0 msgr2=0x7fc29006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:22.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 shutdown_connections 2024-04-26T21:18:22.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.362+0000 7fc296800640 1 -- 172.21.15.106:0/4176633507 wait complete. 2024-04-26T21:18:22.391 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T21:18:22.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f972ba00640 1 Processor -- start 2024-04-26T21:18:22.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f972ba00640 1 -- start start 2024-04-26T21:18:22.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f972ba00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f972415ea90 0x7f9724166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f972ba00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97240b4f00 con 0x7f972415c4e0 2024-04-26T21:18:22.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f972ba00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97240b51e0 con 0x7f972415d080 2024-04-26T21:18:22.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f972ba00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f972415d5f0 con 0x7f972415ea90 2024-04-26T21:18:22.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f9729a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f972415ea90 0x7f9724166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f9729000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f972415c4e0 0x7f972415c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47252/0 (socket says 172.21.15.106:47252) 2024-04-26T21:18:22.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f9729000640 1 -- 172.21.15.106:0/3061554766 learned_addr learned my addr 172.21.15.106:0/3061554766 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:22.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f9729a00640 1 -- 172.21.15.106:0/3061554766 >> v1:172.21.15.112:6789/0 conn(0x7f972415d080 legacy=0x7f97240b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:22.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f9729a00640 1 -- 172.21.15.106:0/3061554766 >> v1:172.21.15.106:6789/0 conn(0x7f972415c4e0 legacy=0x7f972415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f9729a00640 1 -- 172.21.15.106:0/3061554766 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97240b54c0 con 0x7f972415ea90 2024-04-26T21:18:22.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.530+0000 7f9723400640 1 -- 172.21.15.106:0/3061554766 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240995857 0 0) 0x7f97240b4f00 con 0x7f972415c4e0 2024-04-26T21:18:22.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f9729a00640 1 --2- 172.21.15.106:0/3061554766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415ea90 0x7f9724166db0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f971c0097c0 tx=0x7f971c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1754d53b27a36f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:22.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f9723400640 1 -- 172.21.15.106:0/3061554766 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c0b1070 con 0x7f972415ea90 2024-04-26T21:18:22.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f9723400640 1 -- 172.21.15.106:0/3061554766 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f971c0ac640 con 0x7f972415ea90 2024-04-26T21:18:22.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f9723400640 1 -- 172.21.15.106:0/3061554766 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c0aca10 con 0x7f972415ea90 2024-04-26T21:18:22.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f972ba00640 1 -- 172.21.15.106:0/3061554766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415ea90 msgr2=0x7f9724166db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f972ba00640 1 --2- 172.21.15.106:0/3061554766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415ea90 0x7f9724166db0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f971c0097c0 tx=0x7f971c01c460 comp rx=0 tx=0).stop 2024-04-26T21:18:22.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f972ba00640 1 -- 172.21.15.106:0/3061554766 shutdown_connections 2024-04-26T21:18:22.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f972ba00640 1 --2- 172.21.15.106:0/3061554766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415ea90 0x7f9724166db0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f972ba00640 1 -- 172.21.15.106:0/3061554766 >> 172.21.15.106:0/3061554766 conn(0x7f97240b2910 msgr2=0x7f97240b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:22.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f972ba00640 1 -- 172.21.15.106:0/3061554766 shutdown_connections 2024-04-26T21:18:22.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.534+0000 7f972ba00640 1 -- 172.21.15.106:0/3061554766 wait complete. 2024-04-26T21:18:22.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 Processor -- start 2024-04-26T21:18:22.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 -- start start 2024-04-26T21:18:22.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972415c4e0 0x7f9724159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415d080 0x7f97240ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f972415ea90 0x7f9724135400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9724169ea0 con 0x7f972415d080 2024-04-26T21:18:22.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9724169d20 con 0x7f972415c4e0 2024-04-26T21:18:22.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f972416a020 con 0x7f972415ea90 2024-04-26T21:18:22.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9723e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415d080 0x7f97240ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9723e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415d080 0x7f97240ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39446/0 (socket says 172.21.15.106:39446) 2024-04-26T21:18:22.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9723e00640 1 -- 172.21.15.106:0/2248608072 learned_addr learned my addr 172.21.15.106:0/2248608072 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:22.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9729000640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972415c4e0 0x7f9724159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9729a00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f972415ea90 0x7f9724135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9723e00640 1 -- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f972415ea90 msgr2=0x7f9724135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9723e00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f972415ea90 0x7f9724135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9723e00640 1 -- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972415c4e0 msgr2=0x7f9724159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9723e00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972415c4e0 0x7f9724159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9723e00640 1 -- 172.21.15.106:0/2248608072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97240cfcc0 con 0x7f972415d080 2024-04-26T21:18:22.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9729000640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972415c4e0 0x7f9724159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:22.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9729a00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f972415ea90 0x7f9724135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:22.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9723e00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415d080 0x7f97240ce400 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f971000c410 tx=0x7f971000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:22.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9720c00640 1 -- 172.21.15.106:0/2248608072 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710011790 con 0x7f972415d080 2024-04-26T21:18:22.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9720c00640 1 -- 172.21.15.106:0/2248608072 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9710017070 con 0x7f972415d080 2024-04-26T21:18:22.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9724135940 con 0x7f972415d080 2024-04-26T21:18:22.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f9720c00640 1 -- 172.21.15.106:0/2248608072 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710011b70 con 0x7f972415d080 2024-04-26T21:18:22.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9724133700 con 0x7f972415d080 2024-04-26T21:18:22.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.538+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9724069400 con 0x7f972415d080 2024-04-26T21:18:22.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.542+0000 7f9720c00640 1 -- 172.21.15.106:0/2248608072 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9710011d10 con 0x7f972415d080 2024-04-26T21:18:22.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.542+0000 7f9720c00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9704068380 0x7f970406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.542+0000 7f9720c00640 1 -- 172.21.15.106:0/2248608072 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f9710086540 con 0x7f972415d080 2024-04-26T21:18:22.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.542+0000 7f9729000640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9704068380 0x7f970406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.542+0000 7f9729000640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9704068380 0x7f970406a840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9714007fd0 tx=0x7f9714009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:22.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.546+0000 7f9720c00640 1 -- 172.21.15.106:0/2248608072 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9710021020 con 0x7f972415d080 2024-04-26T21:18:22.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.710+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f972406fb90 con 0x7f972415d080 2024-04-26T21:18:22.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f9720c00640 1 -- 172.21.15.106:0/2248608072 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f97240cfcc0 con 0x7f972415d080 2024-04-26T21:18:22.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9704068380 msgr2=0x7f970406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9704068380 0x7f970406a840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9714007fd0 tx=0x7f9714009040 comp rx=0 tx=0).stop 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415d080 msgr2=0x7f97240ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415d080 0x7f97240ce400 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f971000c410 tx=0x7f971000c8d0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 shutdown_connections 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9704068380 0x7f970406a840 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f972415ea90 0x7f9724135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f972415d080 0x7f97240ce400 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 --2- 172.21.15.106:0/2248608072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f972415c4e0 0x7f9724159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.714+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 >> 172.21.15.106:0/2248608072 conn(0x7f97240b2910 msgr2=0x7f972406f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.718+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 shutdown_connections 2024-04-26T21:18:22.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.718+0000 7f972ba00640 1 -- 172.21.15.106:0/2248608072 wait complete. 2024-04-26T21:18:22.738 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create' 2024-04-26T21:18:22.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f3891800640 1 Processor -- start 2024-04-26T21:18:22.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f3891800640 1 -- start start 2024-04-26T21:18:22.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f3891800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f388c15f3d0 0x7f388c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f3891800640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f388c0cdc50 0x7f388c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f3891800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f388c0d1d70 con 0x7f388c0d37f0 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f3891800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f388c0d2050 con 0x7f388c15f3d0 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f3891800640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f388c0cd450 con 0x7f388c0cdc50 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f388aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f388c15f3d0 0x7f388c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f3883e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f388c0d37f0 0x7f388c0cfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47254/0 (socket says 172.21.15.106:47254) 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f388aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f388c15f3d0 0x7f388c0cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39456/0 (socket says 172.21.15.106:39456) 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f3883e00640 1 -- 172.21.15.106:0/1752940770 learned_addr learned my addr 172.21.15.106:0/1752940770 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.870+0000 7f388b400640 1 --2- 172.21.15.106:0/1752940770 >> v2:172.21.15.112:3300/0 conn(0x7f388c0cdc50 0x7f388c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f388aa00640 1 -- 172.21.15.106:0/1752940770 >> v2:172.21.15.112:3300/0 conn(0x7f388c0cdc50 msgr2=0x7f388c0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f388aa00640 1 --2- 172.21.15.106:0/1752940770 >> v2:172.21.15.112:3300/0 conn(0x7f388c0cdc50 0x7f388c0ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f388aa00640 1 -- 172.21.15.106:0/1752940770 >> v1:172.21.15.106:6789/0 conn(0x7f388c0d37f0 legacy=0x7f388c0cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f388aa00640 1 -- 172.21.15.106:0/1752940770 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c0cd730 con 0x7f388c15f3d0 2024-04-26T21:18:22.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f388aa00640 1 --2- 172.21.15.106:0/1752940770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 0x7f388c0cf4e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f388c06fcb0 tx=0x7f387c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6add8972431ba6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:22.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f388a000640 1 -- 172.21.15.106:0/1752940770 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c0b0070 con 0x7f388c15f3d0 2024-04-26T21:18:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f388a000640 1 -- 172.21.15.106:0/1752940770 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c0ab600 con 0x7f388c15f3d0 2024-04-26T21:18:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f388a000640 1 -- 172.21.15.106:0/1752940770 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c0ab9d0 con 0x7f388c15f3d0 2024-04-26T21:18:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f3891800640 1 -- 172.21.15.106:0/1752940770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 msgr2=0x7f388c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f3891800640 1 --2- 172.21.15.106:0/1752940770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 0x7f388c0cf4e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f388c06fcb0 tx=0x7f387c01c480 comp rx=0 tx=0).stop 2024-04-26T21:18:22.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f3891800640 1 -- 172.21.15.106:0/1752940770 shutdown_connections 2024-04-26T21:18:22.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f3891800640 1 --2- 172.21.15.106:0/1752940770 >> v2:172.21.15.112:3300/0 conn(0x7f388c0cdc50 0x7f388c0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f3891800640 1 --2- 172.21.15.106:0/1752940770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 0x7f388c0cf4e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f3891800640 1 -- 172.21.15.106:0/1752940770 >> 172.21.15.106:0/1752940770 conn(0x7f388c0d2c60 msgr2=0x7f388c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:22.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f3891800640 1 -- 172.21.15.106:0/1752940770 shutdown_connections 2024-04-26T21:18:22.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.874+0000 7f3891800640 1 -- 172.21.15.106:0/1752940770 wait complete. 2024-04-26T21:18:22.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 Processor -- start 2024-04-26T21:18:22.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 -- start start 2024-04-26T21:18:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f388c0cdc50 0x7f388c156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f388c0d37f0 0x7f388c0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 0x7f388c06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f388c16c010 con 0x7f388c15f3d0 2024-04-26T21:18:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f388c0d0340 con 0x7f388c0cdc50 2024-04-26T21:18:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f388c16c190 con 0x7f388c0d37f0 2024-04-26T21:18:22.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 0x7f388c06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 0x7f388c06dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39462/0 (socket says 172.21.15.106:39462) 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388b400640 1 -- 172.21.15.106:0/2132453608 learned_addr learned my addr 172.21.15.106:0/2132453608 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388aa00640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f388c0cdc50 0x7f388c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3883e00640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f388c0d37f0 0x7f388c0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388b400640 1 -- 172.21.15.106:0/2132453608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f388c0d37f0 msgr2=0x7f388c0cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388b400640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f388c0d37f0 0x7f388c0cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388b400640 1 -- 172.21.15.106:0/2132453608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f388c0cdc50 msgr2=0x7f388c156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388b400640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f388c0cdc50 0x7f388c156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388b400640 1 -- 172.21.15.106:0/2132453608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c15f950 con 0x7f388c15f3d0 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3883e00640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f388c0d37f0 0x7f388c0cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f388b400640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 0x7f388c06dab0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3884007e70 tx=0x7f388400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3882a00640 1 -- 172.21.15.106:0/2132453608 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884014620 con 0x7f388c15f3d0 2024-04-26T21:18:22.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3882a00640 1 -- 172.21.15.106:0/2132453608 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3884019070 con 0x7f388c15f3d0 2024-04-26T21:18:22.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c0cc520 con 0x7f388c15f3d0 2024-04-26T21:18:22.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3882a00640 1 -- 172.21.15.106:0/2132453608 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884014a20 con 0x7f388c15f3d0 2024-04-26T21:18:22.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.878+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c156ca0 con 0x7f388c15f3d0 2024-04-26T21:18:22.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.882+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388c069400 con 0x7f388c15f3d0 2024-04-26T21:18:22.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.882+0000 7f3882a00640 1 -- 172.21.15.106:0/2132453608 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3884014bc0 con 0x7f388c15f3d0 2024-04-26T21:18:22.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.882+0000 7f3882a00640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3868068380 0x7f386806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:22.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.882+0000 7f3882a00640 1 -- 172.21.15.106:0/2132453608 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f3884087120 con 0x7f388c15f3d0 2024-04-26T21:18:22.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.882+0000 7f388aa00640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3868068380 0x7f386806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:22.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.886+0000 7f388aa00640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3868068380 0x7f386806a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f387c0ad000 tx=0x7f387c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:22.886+0000 7f3882a00640 1 -- 172.21.15.106:0/2132453608 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3884057800 con 0x7f388c15f3d0 2024-04-26T21:18:23.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.098+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]} v 0) -- 0x7f388c0cca40 con 0x7f388c15f3d0 2024-04-26T21:18:23.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3882a00640 1 -- 172.21.15.106:0/2132453608 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]}]=0 v137) ==== 138+0+0 (secure 0 0 0) 0x7f3884057100 con 0x7f388c15f3d0 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3868068380 msgr2=0x7f386806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3868068380 0x7f386806a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f387c0ad000 tx=0x7f387c0a6000 comp rx=0 tx=0).stop 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 msgr2=0x7f388c06dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 0x7f388c06dab0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3884007e70 tx=0x7f388400e4b0 comp rx=0 tx=0).stop 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 shutdown_connections 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3868068380 0x7f386806a840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f388c15f3d0 0x7f388c06dab0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f388c0d37f0 0x7f388c0cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 --2- 172.21.15.106:0/2132453608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f388c0cdc50 0x7f388c156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.362+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 >> 172.21.15.106:0/2132453608 conn(0x7f388c0d2c60 msgr2=0x7f388c0c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.366+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 shutdown_connections 2024-04-26T21:18:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:23.366+0000 7f3891800640 1 -- 172.21.15.106:0/2132453608 wait complete. 2024-04-26T21:18:23.388 INFO:tasks.cephfs_test_runner:MDS starts to handle client caps when it enters clientreplay stage. ... ok 2024-04-26T21:18:23.388 INFO:tasks.cephfs_test_runner: 2024-04-26T21:18:23.388 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T21:18:23.388 INFO:tasks.cephfs_test_runner:Ran 1 test in 76.453s 2024-04-26T21:18:23.388 INFO:tasks.cephfs_test_runner: 2024-04-26T21:18:23.389 INFO:tasks.cephfs_test_runner:OK 2024-04-26T21:18:23.389 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-26T21:18:23.399 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T21:18:23.437 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T21:18:23.437 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:18:23.437 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:18:23.446 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350300k,nr_inodes=4087575,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2516 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T21:18:23.446 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-26T21:18:23.447 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:18:23.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350300k,nr_inodes=4087575,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2516 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T21:18:23.499 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:18:23.499 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:18:23.508 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350236k,nr_inodes=4087559,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5493 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T21:18:23.508 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T21:18:23.508 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:18:23.559 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350236k,nr_inodes=4087559,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5493 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T21:18:23.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:23.559 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-04-26T21:18:23.611 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T21:18:23.611 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T21:18:23.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:23.612 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:18:23.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:23.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T21:18:23.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:23.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-04-26T21:18:24.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:24.069 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-26T21:18:24.078 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T21:18:24.078 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T21:18:24.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:24.079 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:18:24.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:24.145 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:18:24.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:18:24.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-04-26T21:18:24.470 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T21:18:24.479 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T21:18:24.479 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:18:24.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.610+0000 7fac4d600640 1 Processor -- start 2024-04-26T21:18:24.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.610+0000 7fac4d600640 1 -- start start 2024-04-26T21:18:24.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac4d600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146490 0x7fac4815df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac4d600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fac48146870 0x7fac480d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac4d600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac480b3da0 con 0x7fac48160ac0 2024-04-26T21:18:24.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac4d600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fac48160fa0 con 0x7fac48146870 2024-04-26T21:18:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac4d600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fac48161280 con 0x7fac48146490 2024-04-26T21:18:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac47400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fac48146870 0x7fac480d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac47400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fac48146870 0x7fac480d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39474/0 (socket says 172.21.15.106:39474) 2024-04-26T21:18:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac47400640 1 -- 172.21.15.106:0/2210546507 learned_addr learned my addr 172.21.15.106:0/2210546507 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac46a00640 1 --2- 172.21.15.106:0/2210546507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146490 0x7fac4815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac47400640 1 -- 172.21.15.106:0/2210546507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146490 msgr2=0x7fac4815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac47400640 1 --2- 172.21.15.106:0/2210546507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146490 0x7fac4815df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac47400640 1 -- 172.21.15.106:0/2210546507 >> v1:172.21.15.112:6789/0 conn(0x7fac48160ac0 legacy=0x7fac480cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac47400640 1 -- 172.21.15.106:0/2210546507 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48161560 con 0x7fac48146870 2024-04-26T21:18:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac47400640 1 --2- 172.21.15.106:0/2210546507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146870 0x7fac480d0da0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fac40009e50 tx=0x7fac4001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a6f5ba94022eaa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.614+0000 7fac46000640 1 -- 172.21.15.106:0/2210546507 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac400a5700 con 0x7fac48146870 2024-04-26T21:18:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac46000640 1 -- 172.21.15.106:0/2210546507 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac400a58a0 con 0x7fac48146870 2024-04-26T21:18:24.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac46000640 1 -- 172.21.15.106:0/2210546507 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac400a5c70 con 0x7fac48146870 2024-04-26T21:18:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 -- 172.21.15.106:0/2210546507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146870 msgr2=0x7fac480d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 --2- 172.21.15.106:0/2210546507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146870 0x7fac480d0da0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fac40009e50 tx=0x7fac4001ca30 comp rx=0 tx=0).stop 2024-04-26T21:18:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 -- 172.21.15.106:0/2210546507 shutdown_connections 2024-04-26T21:18:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 --2- 172.21.15.106:0/2210546507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146870 0x7fac480d0da0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 --2- 172.21.15.106:0/2210546507 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146490 0x7fac4815df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 -- 172.21.15.106:0/2210546507 >> 172.21.15.106:0/2210546507 conn(0x7fac48068340 msgr2=0x7fac48068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:24.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 -- 172.21.15.106:0/2210546507 shutdown_connections 2024-04-26T21:18:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 -- 172.21.15.106:0/2210546507 wait complete. 2024-04-26T21:18:24.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 Processor -- start 2024-04-26T21:18:24.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 -- start start 2024-04-26T21:18:24.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146490 0x7fac481638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146870 0x7fac4806f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac48160ac0 0x7fac4806fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fac480b5150 con 0x7fac48146490 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fac480b4fd0 con 0x7fac48160ac0 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac4d600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fac48169e60 con 0x7fac48146870 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac46a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146490 0x7fac481638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac46a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146490 0x7fac481638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39484/0 (socket says 172.21.15.106:39484) 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac46a00640 1 -- 172.21.15.106:0/151109338 learned_addr learned my addr 172.21.15.106:0/151109338 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac3fe00640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146870 0x7fac4806f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.618+0000 7fac47400640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac48160ac0 0x7fac4806fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac46a00640 1 -- 172.21.15.106:0/151109338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146870 msgr2=0x7fac4806f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac46a00640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146870 0x7fac4806f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac46a00640 1 -- 172.21.15.106:0/151109338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac48160ac0 msgr2=0x7fac4806fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac46a00640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac48160ac0 0x7fac4806fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac46a00640 1 -- 172.21.15.106:0/151109338 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48163e10 con 0x7fac48146490 2024-04-26T21:18:24.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac46a00640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146490 0x7fac481638d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fac3800d620 tx=0x7fac3800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac3ea00640 1 -- 172.21.15.106:0/151109338 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3800b620 con 0x7fac48146490 2024-04-26T21:18:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac3ea00640 1 -- 172.21.15.106:0/151109338 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac38019070 con 0x7fac48146490 2024-04-26T21:18:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac3ea00640 1 -- 172.21.15.106:0/151109338 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3800ba20 con 0x7fac48146490 2024-04-26T21:18:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac481fbb70 con 0x7fac48146490 2024-04-26T21:18:24.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481fc130 con 0x7fac48146490 2024-04-26T21:18:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac48069400 con 0x7fac48146490 2024-04-26T21:18:24.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac3ea00640 1 -- 172.21.15.106:0/151109338 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac3800bbc0 con 0x7fac48146490 2024-04-26T21:18:24.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac3ea00640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fac24068380 0x7fac2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac3ea00640 1 -- 172.21.15.106:0/151109338 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7fac38086c30 con 0x7fac48146490 2024-04-26T21:18:24.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.622+0000 7fac3fe00640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fac24068380 0x7fac2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.626+0000 7fac3fe00640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fac24068380 0x7fac2406a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fac48068b50 tx=0x7fac30009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:24.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.626+0000 7fac3ea00640 1 -- 172.21.15.106:0/151109338 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fac38056c20 con 0x7fac48146490 2024-04-26T21:18:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.782+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac480d10c0 con 0x7fac24068380 2024-04-26T21:18:24.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.782+0000 7fac3ea00640 1 -- 172.21.15.106:0/151109338 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13471 (secure 0 0 0) 0x7fac480d10c0 con 0x7fac24068380 2024-04-26T21:18:24.787 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:24.787 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fac24068380 msgr2=0x7fac2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fac24068380 0x7fac2406a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fac48068b50 tx=0x7fac30009040 comp rx=0 tx=0).stop 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146490 msgr2=0x7fac481638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146490 0x7fac481638d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fac3800d620 tx=0x7fac3800dae0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 shutdown_connections 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac48160ac0 0x7fac4806fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fac24068380 0x7fac2406a840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac48146870 0x7fac4806f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 --2- 172.21.15.106:0/151109338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac48146490 0x7fac481638d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 >> 172.21.15.106:0/151109338 conn(0x7fac48068340 msgr2=0x7fac480aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:24.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 shutdown_connections 2024-04-26T21:18:24.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.786+0000 7fac4d600640 1 -- 172.21.15.106:0/151109338 wait complete. 2024-04-26T21:18:24.807 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-04-26T21:18:24.315450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221420,"kb_used_data":5264,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753300,"statfs":{"total":773094113280,"available":772867379200,"internally_reserved":0,"allocated":5390336,"data_stored":3009978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16523,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-86,"num_read_kb":-88,"num_write":-79,"num_write_kb":-43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001161"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T21:18:22.370845+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:18:22.370845+0000","last_peered":"2024-04-26T21:18:22.370845+0000","last_clean":"2024-04-26T21:18:22.370845+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:18:22.370845+0000","last_undegraded":"2024-04-26T21:18:22.370845+0000","last_fullsized":"2024-04-26T21:18:22.370845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":823002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":232634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":232634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":226728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":232634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":226214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":816526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":219606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:18:24.807 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:18:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7488000640 1 Processor -- start 2024-04-26T21:18:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7488000640 1 -- start start 2024-04-26T21:18:24.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7488000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7480146490 0x7f748015df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7488000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146870 0x7f74800d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7488000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74800b3da0 con 0x7f7480160ac0 2024-04-26T21:18:24.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7488000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7480160fa0 con 0x7f7480146490 2024-04-26T21:18:24.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7488000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7480161280 con 0x7f7480146870 2024-04-26T21:18:24.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7486000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146870 0x7f74800d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7484c00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7480160ac0 0x7f74800cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:45638/0 (socket says 172.21.15.106:45638) 2024-04-26T21:18:24.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7485600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7480146490 0x7f748015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7484c00640 1 -- 172.21.15.106:0/3434903590 learned_addr learned my addr 172.21.15.106:0/3434903590 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:24.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f747fe00640 1 -- 172.21.15.106:0/3434903590 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082192973 0 0) 0x7f74800b3da0 con 0x7f7480160ac0 2024-04-26T21:18:24.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f747fe00640 1 -- 172.21.15.106:0/3434903590 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7468003530 con 0x7f7480160ac0 2024-04-26T21:18:24.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7486000640 1 -- 172.21.15.106:0/3434903590 >> v2:172.21.15.112:3300/0 conn(0x7f7480146490 msgr2=0x7f748015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:24.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7486000640 1 --2- 172.21.15.106:0/3434903590 >> v2:172.21.15.112:3300/0 conn(0x7f7480146490 0x7f748015df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7486000640 1 -- 172.21.15.106:0/3434903590 >> v1:172.21.15.112:6789/0 conn(0x7f7480160ac0 legacy=0x7f74800cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7486000640 1 -- 172.21.15.106:0/3434903590 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7480161560 con 0x7f7480146870 2024-04-26T21:18:24.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.942+0000 7f7485600640 1 --2- 172.21.15.106:0/3434903590 >> v2:172.21.15.112:3300/0 conn(0x7f7480146490 0x7f748015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:24.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f7486000640 1 --2- 172.21.15.106:0/3434903590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146870 0x7f74800d0da0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7478009d90 tx=0x7f747801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1558e118a70c8a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:24.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f747fe00640 1 -- 172.21.15.106:0/3434903590 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74780b2070 con 0x7f7480146870 2024-04-26T21:18:24.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f747fe00640 1 -- 172.21.15.106:0/3434903590 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74780a5830 con 0x7f7480146870 2024-04-26T21:18:24.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f747fe00640 1 -- 172.21.15.106:0/3434903590 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74780a5c00 con 0x7f7480146870 2024-04-26T21:18:24.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f7488000640 1 -- 172.21.15.106:0/3434903590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146870 msgr2=0x7f74800d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f7488000640 1 --2- 172.21.15.106:0/3434903590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146870 0x7f74800d0da0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7478009d90 tx=0x7f747801c970 comp rx=0 tx=0).stop 2024-04-26T21:18:24.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f7488000640 1 -- 172.21.15.106:0/3434903590 shutdown_connections 2024-04-26T21:18:24.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f7488000640 1 --2- 172.21.15.106:0/3434903590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146870 0x7f74800d0da0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f7488000640 1 --2- 172.21.15.106:0/3434903590 >> v2:172.21.15.112:3300/0 conn(0x7f7480146490 0x7f748015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f7488000640 1 -- 172.21.15.106:0/3434903590 >> 172.21.15.106:0/3434903590 conn(0x7f7480068340 msgr2=0x7f7480068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:24.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f7488000640 1 -- 172.21.15.106:0/3434903590 shutdown_connections 2024-04-26T21:18:24.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.946+0000 7f7488000640 1 -- 172.21.15.106:0/3434903590 wait complete. 2024-04-26T21:18:24.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 Processor -- start 2024-04-26T21:18:24.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 -- start start 2024-04-26T21:18:24.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146490 0x7f7480140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480146870 0x7f748013d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7480160ac0 0x7f7480156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f74800b5150 con 0x7f7480160ac0 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f74800b4fd0 con 0x7f7480146870 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7480169e60 con 0x7f7480146490 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7486000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7480160ac0 0x7f7480156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7486000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7480160ac0 0x7f7480156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39494/0 (socket says 172.21.15.106:39494) 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7486000640 1 -- 172.21.15.106:0/1204744246 learned_addr learned my addr 172.21.15.106:0/1204744246 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7485600640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146490 0x7f7480140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7484c00640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480146870 0x7f748013d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7486000640 1 -- 172.21.15.106:0/1204744246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146490 msgr2=0x7f7480140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7486000640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146490 0x7f7480140520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7486000640 1 -- 172.21.15.106:0/1204744246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480146870 msgr2=0x7f748013d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7486000640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480146870 0x7f748013d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7486000640 1 -- 172.21.15.106:0/1204744246 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748013f480 con 0x7f7480160ac0 2024-04-26T21:18:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7484c00640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480146870 0x7f748013d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7486000640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7480160ac0 0x7f7480156e40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f74780b0040 tx=0x7f7478019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:24.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f747d600640 1 -- 172.21.15.106:0/1204744246 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74780b2050 con 0x7f7480160ac0 2024-04-26T21:18:24.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f747d600640 1 -- 172.21.15.106:0/1204744246 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74780be070 con 0x7f7480160ac0 2024-04-26T21:18:24.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748013f760 con 0x7f7480160ac0 2024-04-26T21:18:24.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f747d600640 1 -- 172.21.15.106:0/1204744246 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74780ad890 con 0x7f7480160ac0 2024-04-26T21:18:24.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748013fd20 con 0x7f7480160ac0 2024-04-26T21:18:24.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.950+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7480069400 con 0x7f7480160ac0 2024-04-26T21:18:24.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.954+0000 7f747d600640 1 -- 172.21.15.106:0/1204744246 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f74780ada30 con 0x7f7480160ac0 2024-04-26T21:18:24.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.954+0000 7f747d600640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7460068380 0x7f746006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:24.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.954+0000 7f747d600640 1 -- 172.21.15.106:0/1204744246 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f7478121b80 con 0x7f7480160ac0 2024-04-26T21:18:24.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.954+0000 7f7485600640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7460068380 0x7f746006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:24.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.954+0000 7f7485600640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7460068380 0x7f746006a840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7474009580 tx=0x7f7474009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:24.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:24.958+0000 7f747d600640 1 -- 172.21.15.106:0/1204744246 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7478016560 con 0x7f7480160ac0 2024-04-26T21:18:25.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.114+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7480073d70 con 0x7f7460068380 2024-04-26T21:18:25.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.114+0000 7f747d600640 1 -- 172.21.15.106:0/1204744246 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13471 (secure 0 0 0) 0x7f7480073d70 con 0x7f7460068380 2024-04-26T21:18:25.118 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:18:25.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7460068380 msgr2=0x7f746006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7460068380 0x7f746006a840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7474009580 tx=0x7f7474009190 comp rx=0 tx=0).stop 2024-04-26T21:18:25.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7480160ac0 msgr2=0x7f7480156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7480160ac0 0x7f7480156e40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f74780b0040 tx=0x7f7478019710 comp rx=0 tx=0).stop 2024-04-26T21:18:25.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 shutdown_connections 2024-04-26T21:18:25.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480146870 0x7f748013d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f7460068380 0x7f746006a840 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7480160ac0 0x7f7480156e40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 --2- 172.21.15.106:0/1204744246 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7480146490 0x7f7480140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 >> 172.21.15.106:0/1204744246 conn(0x7f7480068340 msgr2=0x7f74800b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:25.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 shutdown_connections 2024-04-26T21:18:25.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.118+0000 7f7488000640 1 -- 172.21.15.106:0/1204744246 wait complete. 2024-04-26T21:18:25.138 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-04-26T21:18:24.315450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221420,"kb_used_data":5264,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753300,"statfs":{"total":773094113280,"available":772867379200,"internally_reserved":0,"allocated":5390336,"data_stored":3009978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16523,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-86,"num_read_kb":-88,"num_write":-79,"num_write_kb":-43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001161"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T21:18:22.370845+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:18:22.370845+0000","last_peered":"2024-04-26T21:18:22.370845+0000","last_clean":"2024-04-26T21:18:22.370845+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:18:22.370845+0000","last_undegraded":"2024-04-26T21:18:22.370845+0000","last_fullsized":"2024-04-26T21:18:22.370845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":823002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":232634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":232634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":226728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":232634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":226214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":816526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":219606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:18:25.139 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T21:18:25.139 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:18:25.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.270+0000 7ff897c00640 1 Processor -- start 2024-04-26T21:18:25.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.270+0000 7ff897c00640 1 -- start start 2024-04-26T21:18:25.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.270+0000 7ff897c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff89013ed60 0x7ff89015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.270+0000 7ff897c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff89013f140 0x7ff8900b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.270+0000 7ff897c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8900b3d10 con 0x7ff89006eb70 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.270+0000 7ff897c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff8900b3ac0 con 0x7ff89013ed60 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.270+0000 7ff897c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff8900b4920 con 0x7ff89013f140 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.270+0000 7ff895c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff89006eb70 0x7ff8900d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47264/0 (socket says 172.21.15.106:47264) 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.270+0000 7ff895c00640 1 -- 172.21.15.106:0/1030374457 learned_addr learned my addr 172.21.15.106:0/1030374457 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff895200640 1 --2- 172.21.15.106:0/1030374457 >> v2:172.21.15.112:3300/0 conn(0x7ff89013ed60 0x7ff89015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff88fe00640 1 --2- 172.21.15.106:0/1030374457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff89013f140 0x7ff8900b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff88f400640 1 -- 172.21.15.106:0/1030374457 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59705013 0 0) 0x7ff8900b3d10 con 0x7ff89006eb70 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff88f400640 1 -- 172.21.15.106:0/1030374457 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff878003530 con 0x7ff89006eb70 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff895200640 1 -- 172.21.15.106:0/1030374457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff89013f140 msgr2=0x7ff8900b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff895200640 1 --2- 172.21.15.106:0/1030374457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff89013f140 0x7ff8900b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff895200640 1 -- 172.21.15.106:0/1030374457 >> v1:172.21.15.106:6789/0 conn(0x7ff89006eb70 legacy=0x7ff8900d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff895200640 1 -- 172.21.15.106:0/1030374457 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8900b3ff0 con 0x7ff89013ed60 2024-04-26T21:18:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff895200640 1 --2- 172.21.15.106:0/1030374457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff89013ed60 0x7ff89015c3e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff8840097c0 tx=0x7ff88401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=481b6feee236f8a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff88f400640 1 -- 172.21.15.106:0/1030374457 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8840b2070 con 0x7ff89013ed60 2024-04-26T21:18:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff88f400640 1 -- 172.21.15.106:0/1030374457 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8840ad680 con 0x7ff89013ed60 2024-04-26T21:18:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.274+0000 7ff88f400640 1 -- 172.21.15.106:0/1030374457 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8840ada30 con 0x7ff89013ed60 2024-04-26T21:18:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 -- 172.21.15.106:0/1030374457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff89013ed60 msgr2=0x7ff89015c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 --2- 172.21.15.106:0/1030374457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff89013ed60 0x7ff89015c3e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff8840097c0 tx=0x7ff88401c380 comp rx=0 tx=0).stop 2024-04-26T21:18:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 -- 172.21.15.106:0/1030374457 shutdown_connections 2024-04-26T21:18:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 --2- 172.21.15.106:0/1030374457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff89013f140 0x7ff8900b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 --2- 172.21.15.106:0/1030374457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff89013ed60 0x7ff89015c3e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 -- 172.21.15.106:0/1030374457 >> 172.21.15.106:0/1030374457 conn(0x7ff890068340 msgr2=0x7ff890068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 -- 172.21.15.106:0/1030374457 shutdown_connections 2024-04-26T21:18:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 -- 172.21.15.106:0/1030374457 wait complete. 2024-04-26T21:18:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 Processor -- start 2024-04-26T21:18:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 -- start start 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff89013ed60 0x7ff8900b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900b1040 0x7ff89013d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900725d0 0x7ff890072a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff8900d1680 con 0x7ff89013ed60 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8900d1500 con 0x7ff8900725d0 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff897c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff890160420 con 0x7ff8900b1040 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff89013ed60 0x7ff8900b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff89013ed60 0x7ff8900b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39504/0 (socket says 172.21.15.106:39504) 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895200640 1 -- 172.21.15.106:0/2258737834 learned_addr learned my addr 172.21.15.106:0/2258737834 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:25.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff88fe00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900b1040 0x7ff89013d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895c00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900725d0 0x7ff890072a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895200640 1 -- 172.21.15.106:0/2258737834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900b1040 msgr2=0x7ff89013d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895200640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900b1040 0x7ff89013d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895200640 1 -- 172.21.15.106:0/2258737834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900725d0 msgr2=0x7ff890072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895200640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900725d0 0x7ff890072a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895200640 1 -- 172.21.15.106:0/2258737834 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff890073d00 con 0x7ff89013ed60 2024-04-26T21:18:25.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.278+0000 7ff895200640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff89013ed60 0x7ff8900b31d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff8840b0040 tx=0x7ff884019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:25.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff88cc00640 1 -- 172.21.15.106:0/2258737834 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8840b2040 con 0x7ff89013ed60 2024-04-26T21:18:25.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff88cc00640 1 -- 172.21.15.106:0/2258737834 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff884004230 con 0x7ff89013ed60 2024-04-26T21:18:25.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff88cc00640 1 -- 172.21.15.106:0/2258737834 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8840ad830 con 0x7ff89013ed60 2024-04-26T21:18:25.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8900b3710 con 0x7ff89013ed60 2024-04-26T21:18:25.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8900b18c0 con 0x7ff89013ed60 2024-04-26T21:18:25.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff890069400 con 0x7ff89013ed60 2024-04-26T21:18:25.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff88cc00640 1 -- 172.21.15.106:0/2258737834 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8840ad9d0 con 0x7ff89013ed60 2024-04-26T21:18:25.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff88cc00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff8700683b0 0x7ff87006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff88cc00640 1 -- 172.21.15.106:0/2258737834 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7ff884120350 con 0x7ff89013ed60 2024-04-26T21:18:25.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff88fe00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff8700683b0 0x7ff87006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.282+0000 7ff88fe00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff8700683b0 0x7ff87006a870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009ac0 tx=0x7ff87c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.286+0000 7ff88cc00640 1 -- 172.21.15.106:0/2258737834 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff8840ba020 con 0x7ff89013ed60 2024-04-26T21:18:25.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.442+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8900b1a90 con 0x7ff8700683b0 2024-04-26T21:18:25.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.442+0000 7ff88cc00640 1 -- 172.21.15.106:0/2258737834 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13471 (secure 0 0 0) 0x7ff8900b1a90 con 0x7ff8700683b0 2024-04-26T21:18:25.447 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:25.447 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:18:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff8700683b0 msgr2=0x7ff87006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff8700683b0 0x7ff87006a870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009ac0 tx=0x7ff87c009190 comp rx=0 tx=0).stop 2024-04-26T21:18:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff89013ed60 msgr2=0x7ff8900b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff89013ed60 0x7ff8900b31d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff8840b0040 tx=0x7ff884019120 comp rx=0 tx=0).stop 2024-04-26T21:18:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 shutdown_connections 2024-04-26T21:18:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8900725d0 0x7ff890072a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7ff8700683b0 0x7ff87006a870 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff8900b1040 0x7ff89013d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 --2- 172.21.15.106:0/2258737834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff89013ed60 0x7ff8900b31d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 >> 172.21.15.106:0/2258737834 conn(0x7ff890068340 msgr2=0x7ff8900cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 shutdown_connections 2024-04-26T21:18:25.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.446+0000 7ff897c00640 1 -- 172.21.15.106:0/2258737834 wait complete. 2024-04-26T21:18:25.468 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-04-26T21:18:24.315450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221420,"kb_used_data":5264,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753300,"statfs":{"total":773094113280,"available":772867379200,"internally_reserved":0,"allocated":5390336,"data_stored":3009978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16523,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-86,"num_read_kb":-88,"num_write":-79,"num_write_kb":-43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001161"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T21:18:22.370845+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:18:22.370845+0000","last_peered":"2024-04-26T21:18:22.370845+0000","last_clean":"2024-04-26T21:18:22.370845+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:18:22.370845+0000","last_undegraded":"2024-04-26T21:18:22.370845+0000","last_fullsized":"2024-04-26T21:18:22.370845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":823002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":232634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":232634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":226728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":232634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":226214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":816526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":219606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:18:25.469 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:18:25.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2ae5600640 1 Processor -- start 2024-04-26T21:18:25.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2ae5600640 1 -- start start 2024-04-26T21:18:25.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2ae5600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2ae015f5a0 0x7f2ae00710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2ae5600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ae015f980 0x7f2ae00d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2ae5600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae00d1e30 0x7f2ae0162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2ae5600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae0070030 con 0x7f2ae015f5a0 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2ae5600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae0070310 con 0x7f2ae015f980 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2ae5600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae00705f0 con 0x7f2ae00d1e30 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2adfe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2ae015f5a0 0x7f2ae00710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2adfe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2ae015f5a0 0x7f2ae00710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39506/0 (socket says 172.21.15.106:39506) 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2adfe00640 1 -- 172.21.15.106:0/421651297 learned_addr learned my addr 172.21.15.106:0/421651297 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2ae4c00640 1 --2- 172.21.15.106:0/421651297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae00d1e30 0x7f2ae0162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2adf400640 1 --2- 172.21.15.106:0/421651297 >> v2:172.21.15.112:3300/0 conn(0x7f2ae015f980 0x7f2ae00d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2adfe00640 1 -- 172.21.15.106:0/421651297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae00d1e30 msgr2=0x7f2ae0162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2adfe00640 1 --2- 172.21.15.106:0/421651297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae00d1e30 0x7f2ae0162ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2adfe00640 1 -- 172.21.15.106:0/421651297 >> v2:172.21.15.112:3300/0 conn(0x7f2ae015f980 msgr2=0x7f2ae00d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:25.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2adfe00640 1 --2- 172.21.15.106:0/421651297 >> v2:172.21.15.112:3300/0 conn(0x7f2ae015f980 0x7f2ae00d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.602+0000 7f2adfe00640 1 -- 172.21.15.106:0/421651297 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae00708d0 con 0x7f2ae015f5a0 2024-04-26T21:18:25.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2adfe00640 1 --2- 172.21.15.106:0/421651297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae015f5a0 0x7f2ae00710d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00cd1a0 tx=0x7f2ad001c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a340ae0149d1776 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:25.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2adea00640 1 -- 172.21.15.106:0/421651297 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00b0070 con 0x7f2ae015f5a0 2024-04-26T21:18:25.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2adea00640 1 -- 172.21.15.106:0/421651297 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad00ab600 con 0x7f2ae015f5a0 2024-04-26T21:18:25.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2adea00640 1 -- 172.21.15.106:0/421651297 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00ab9d0 con 0x7f2ae015f5a0 2024-04-26T21:18:25.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 -- 172.21.15.106:0/421651297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae015f5a0 msgr2=0x7f2ae00710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 --2- 172.21.15.106:0/421651297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae015f5a0 0x7f2ae00710d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00cd1a0 tx=0x7f2ad001c1a0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 -- 172.21.15.106:0/421651297 shutdown_connections 2024-04-26T21:18:25.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 --2- 172.21.15.106:0/421651297 >> v2:172.21.15.112:3300/0 conn(0x7f2ae015f980 0x7f2ae00d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 --2- 172.21.15.106:0/421651297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae00d1e30 0x7f2ae0162ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 --2- 172.21.15.106:0/421651297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae015f5a0 0x7f2ae00710d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 -- 172.21.15.106:0/421651297 >> 172.21.15.106:0/421651297 conn(0x7f2ae00b46f0 msgr2=0x7f2ae00b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:25.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 -- 172.21.15.106:0/421651297 shutdown_connections 2024-04-26T21:18:25.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 -- 172.21.15.106:0/421651297 wait complete. 2024-04-26T21:18:25.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 Processor -- start 2024-04-26T21:18:25.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.606+0000 7f2ae5600640 1 -- start start 2024-04-26T21:18:25.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae5600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae00d1e30 0x7f2ae00af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae5600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae015f5a0 0x7f2ae0147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae5600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae015f980 0x7f2ae01621f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae5600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae015d520 con 0x7f2ae00d1e30 2024-04-26T21:18:25.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae5600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae015d3a0 con 0x7f2ae015f5a0 2024-04-26T21:18:25.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae5600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae015d6a0 con 0x7f2ae015f980 2024-04-26T21:18:25.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae00d1e30 0x7f2ae00af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae00d1e30 0x7f2ae00af960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39508/0 (socket says 172.21.15.106:39508) 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adfe00640 1 -- 172.21.15.106:0/260233873 learned_addr learned my addr 172.21.15.106:0/260233873 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae4c00640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae015f980 0x7f2ae01621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adf400640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae015f5a0 0x7f2ae0147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adfe00640 1 -- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae015f980 msgr2=0x7f2ae01621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adfe00640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae015f980 0x7f2ae01621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adfe00640 1 -- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae015f5a0 msgr2=0x7f2ae0147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adfe00640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae015f5a0 0x7f2ae0147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adfe00640 1 -- 172.21.15.106:0/260233873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae0156dc0 con 0x7f2ae00d1e30 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adf400640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae015f5a0 0x7f2ae0147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae4c00640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae015f980 0x7f2ae01621f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2adfe00640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae00d1e30 0x7f2ae00af960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ae040 tx=0x7f2ad001a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ad7e00640 1 -- 172.21.15.106:0/260233873 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00ba020 con 0x7f2ae00d1e30 2024-04-26T21:18:25.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ad7e00640 1 -- 172.21.15.106:0/260233873 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad00b6620 con 0x7f2ae00d1e30 2024-04-26T21:18:25.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ad7e00640 1 -- 172.21.15.106:0/260233873 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00b0040 con 0x7f2ae00d1e30 2024-04-26T21:18:25.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae01570a0 con 0x7f2ae00d1e30 2024-04-26T21:18:25.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae00b7490 con 0x7f2ae00d1e30 2024-04-26T21:18:25.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae0069b10 con 0x7f2ae00d1e30 2024-04-26T21:18:25.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.610+0000 7f2ad7e00640 1 -- 172.21.15.106:0/260233873 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ad00bd020 con 0x7f2ae00d1e30 2024-04-26T21:18:25.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.614+0000 7f2ad7e00640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2ac0068380 0x7f2ac006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.614+0000 7f2ad7e00640 1 -- 172.21.15.106:0/260233873 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f2ad0120bd0 con 0x7f2ae00d1e30 2024-04-26T21:18:25.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.614+0000 7f2adf400640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2ac0068380 0x7f2ac006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.614+0000 7f2adf400640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2ac0068380 0x7f2ac006a840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2ae01fb8b0 tx=0x7f2acc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:25.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.618+0000 7f2ad7e00640 1 -- 172.21.15.106:0/260233873 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2ad00c4030 con 0x7f2ae00d1e30 2024-04-26T21:18:25.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ae0068e30 con 0x7f2ae00d1e30 2024-04-26T21:18:25.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ad7e00640 1 -- 172.21.15.106:0/260233873 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+13473 (secure 0 0 0) 0x7f2ad0016110 con 0x7f2ae00d1e30 2024-04-26T21:18:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:25.777 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":47,"fsid":"f2bfe958-5421-4d89-8d8f-237a3ca1f771","created":"2024-04-26T21:15:55.247825+0000","modified":"2024-04-26T21:18:22.362648+0000","last_up_change":"2024-04-26T21:16:07.121139+0000","last_in_change":"2024-04-26T21:15:57.726501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:16:08.313788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1272518-db2d-43bd-bb42-452c2492611a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6825","nonce":2880453688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6827","nonce":2880453688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6831","nonce":2880453688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2880453688},{"type":"v1","addr":"172.21.15.106:6829","nonce":2880453688}]},"public_addr":"172.21.15.106:6825/2880453688","cluster_addr":"172.21.15.106:6827/2880453688","heartbeat_back_addr":"172.21.15.106:6831/2880453688","heartbeat_front_addr":"172.21.15.106:6829/2880453688","state":["exists","up"]},{"osd":1,"uuid":"d5376c79-a72d-4e12-86c4-643ce6ae38e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6809","nonce":1511992084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6811","nonce":1511992084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6815","nonce":1511992084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1511992084},{"type":"v1","addr":"172.21.15.106:6813","nonce":1511992084}]},"public_addr":"172.21.15.106:6809/1511992084","cluster_addr":"172.21.15.106:6811/1511992084","heartbeat_back_addr":"172.21.15.106:6815/1511992084","heartbeat_front_addr":"172.21.15.106:6813/1511992084","state":["exists","up"]},{"osd":2,"uuid":"68db141c-79ad-4bc7-a259-803774f3197d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6801","nonce":522723976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6803","nonce":522723976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6807","nonce":522723976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":522723976},{"type":"v1","addr":"172.21.15.106:6805","nonce":522723976}]},"public_addr":"172.21.15.106:6801/522723976","cluster_addr":"172.21.15.106:6803/522723976","heartbeat_back_addr":"172.21.15.106:6807/522723976","heartbeat_front_addr":"172.21.15.106:6805/522723976","state":["exists","up"]},{"osd":3,"uuid":"d6259c38-3360-46fe-9ce2-150a5547d7b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6817","nonce":1343890463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6819","nonce":1343890463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6823","nonce":1343890463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1343890463},{"type":"v1","addr":"172.21.15.106:6821","nonce":1343890463}]},"public_addr":"172.21.15.106:6817/1343890463","cluster_addr":"172.21.15.106:6819/1343890463","heartbeat_back_addr":"172.21.15.106:6823/1343890463","heartbeat_front_addr":"172.21.15.106:6821/1343890463","state":["exists","up"]},{"osd":4,"uuid":"e70f89d8-c8c2-4138-bd5b-104118bedc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6809","nonce":4133025482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6811","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6813","nonce":4133025482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6819","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6821","nonce":4133025482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6815","nonce":4133025482},{"type":"v1","addr":"172.21.15.112:6817","nonce":4133025482}]},"public_addr":"172.21.15.112:6809/4133025482","cluster_addr":"172.21.15.112:6813/4133025482","heartbeat_back_addr":"172.21.15.112:6821/4133025482","heartbeat_front_addr":"172.21.15.112:6817/4133025482","state":["exists","up"]},{"osd":5,"uuid":"89ea2c27-08e1-4f52-acd4-72d25a625acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6801","nonce":2195698135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6803","nonce":2195698135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6807","nonce":2195698135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2195698135},{"type":"v1","addr":"172.21.15.112:6805","nonce":2195698135}]},"public_addr":"172.21.15.112:6801/2195698135","cluster_addr":"172.21.15.112:6803/2195698135","heartbeat_back_addr":"172.21.15.112:6807/2195698135","heartbeat_front_addr":"172.21.15.112:6805/2195698135","state":["exists","up"]},{"osd":6,"uuid":"c13e8b3d-a247-43b7-b6cc-14bff507589a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6812","nonce":3830481749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6816","nonce":3830481749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6823","nonce":3830481749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3830481749},{"type":"v1","addr":"172.21.15.112:6820","nonce":3830481749}]},"public_addr":"172.21.15.112:6812/3830481749","cluster_addr":"172.21.15.112:6816/3830481749","heartbeat_back_addr":"172.21.15.112:6823/3830481749","heartbeat_front_addr":"172.21.15.112:6820/3830481749","state":["exists","up"]},{"osd":7,"uuid":"e5167609-1c53-43f5-95c7-ffbcb284ce9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6825","nonce":2983510698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6827","nonce":2983510698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6831","nonce":2983510698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":2983510698},{"type":"v1","addr":"172.21.15.112:6829","nonce":2983510698}]},"public_addr":"172.21.15.112:6825/2983510698","cluster_addr":"172.21.15.112:6827/2983510698","heartbeat_back_addr":"172.21.15.112:6831/2983510698","heartbeat_front_addr":"172.21.15.112:6829/2983510698","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.472320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.504336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.282877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.441727+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.513311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.448557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.475175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:16:03.509054+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6837/967590660":"2024-04-27T21:18:19.356718+0000","172.21.15.106:6835/967590660":"2024-04-27T21:18:19.356718+0000","172.21.15.106:6836/1043820033":"2024-04-27T21:18:06.945562+0000","172.21.15.106:6834/1043820033":"2024-04-27T21:18:06.945562+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:18:25.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2ac0068380 msgr2=0x7f2ac006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2ac0068380 0x7f2ac006a840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2ae01fb8b0 tx=0x7f2acc008040 comp rx=0 tx=0).stop 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae00d1e30 msgr2=0x7f2ae00af960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae00d1e30 0x7f2ae00af960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ae040 tx=0x7f2ad001a9e0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 shutdown_connections 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ae015f5a0 0x7f2ae0147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2ac0068380 0x7f2ac006a840 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2ae015f980 0x7f2ae01621f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 --2- 172.21.15.106:0/260233873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ae00d1e30 0x7f2ae00af960 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.774+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 >> 172.21.15.106:0/260233873 conn(0x7f2ae00b46f0 msgr2=0x7f2ae00b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.778+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 shutdown_connections 2024-04-26T21:18:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:25.778+0000 7f2ae5600640 1 -- 172.21.15.106:0/260233873 wait complete. 2024-04-26T21:18:26.799 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T21:18:26.799 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T21:18:26.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97e00640 1 Processor -- start 2024-04-26T21:18:26.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97e00640 1 -- start start 2024-04-26T21:18:26.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fde9806e5a0 0x7fde980b3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde980b28d0 con 0x7fde9815f060 2024-04-26T21:18:26.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde980b2bb0 con 0x7fde980b7510 2024-04-26T21:18:26.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fde980b34e0 con 0x7fde9806e5a0 2024-04-26T21:18:26.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde96a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fde9815f060 0x7fde98160650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39116/0 (socket says 172.21.15.106:39116) 2024-04-26T21:18:26.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde96a00640 1 -- 172.21.15.106:0/1325913335 learned_addr learned my addr 172.21.15.106:0/1325913335 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:26.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97400640 1 --2- 172.21.15.106:0/1325913335 >> v2:172.21.15.106:3300/0 conn(0x7fde9806e5a0 0x7fde980b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde95600640 1 -- 172.21.15.106:0/1325913335 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279996663 0 0) 0x7fde980b28d0 con 0x7fde9815f060 2024-04-26T21:18:26.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde95600640 1 -- 172.21.15.106:0/1325913335 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde7c003530 con 0x7fde9815f060 2024-04-26T21:18:26.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97400640 1 -- 172.21.15.106:0/1325913335 >> v1:172.21.15.112:6789/0 conn(0x7fde980b7510 legacy=0x7fde9806de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97400640 1 -- 172.21.15.106:0/1325913335 >> v1:172.21.15.106:6789/0 conn(0x7fde9815f060 legacy=0x7fde98160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.946+0000 7fde97400640 1 -- 172.21.15.106:0/1325913335 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde980b2e90 con 0x7fde9806e5a0 2024-04-26T21:18:26.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97400640 1 --2- 172.21.15.106:0/1325913335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9806e5a0 0x7fde980b3970 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fde900097c0 tx=0x7fde9001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f97add19fff56b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:26.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde95600640 1 -- 172.21.15.106:0/1325913335 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde900b2070 con 0x7fde9806e5a0 2024-04-26T21:18:26.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde95600640 1 -- 172.21.15.106:0/1325913335 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde900ad680 con 0x7fde9806e5a0 2024-04-26T21:18:26.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde95600640 1 -- 172.21.15.106:0/1325913335 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde900ada50 con 0x7fde9806e5a0 2024-04-26T21:18:26.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97e00640 1 -- 172.21.15.106:0/1325913335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9806e5a0 msgr2=0x7fde980b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97e00640 1 --2- 172.21.15.106:0/1325913335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9806e5a0 0x7fde980b3970 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fde900097c0 tx=0x7fde9001c470 comp rx=0 tx=0).stop 2024-04-26T21:18:26.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97e00640 1 -- 172.21.15.106:0/1325913335 shutdown_connections 2024-04-26T21:18:26.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97e00640 1 --2- 172.21.15.106:0/1325913335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9806e5a0 0x7fde980b3970 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97e00640 1 -- 172.21.15.106:0/1325913335 >> 172.21.15.106:0/1325913335 conn(0x7fde980b7ee0 msgr2=0x7fde980b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:26.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97e00640 1 -- 172.21.15.106:0/1325913335 shutdown_connections 2024-04-26T21:18:26.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97e00640 1 -- 172.21.15.106:0/1325913335 wait complete. 2024-04-26T21:18:26.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97e00640 1 Processor -- start 2024-04-26T21:18:26.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.950+0000 7fde97e00640 1 -- start start 2024-04-26T21:18:26.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde9806e5a0 0x7fde98157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde980b7510 0x7fde98156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9815f060 0x7fde9806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fde9816d470 con 0x7fde9815f060 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fde9816d2f0 con 0x7fde9806e5a0 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fde9816d5f0 con 0x7fde980b7510 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9815f060 0x7fde9806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9815f060 0x7fde9806ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33814/0 (socket says 172.21.15.106:33814) 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97400640 1 -- 172.21.15.106:0/1873672695 learned_addr learned my addr 172.21.15.106:0/1873672695 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde96a00640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde9806e5a0 0x7fde98157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97400640 1 -- 172.21.15.106:0/1873672695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde980b7510 msgr2=0x7fde98156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde96000640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde980b7510 0x7fde98156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97400640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde980b7510 0x7fde98156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97400640 1 -- 172.21.15.106:0/1873672695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde9806e5a0 msgr2=0x7fde98157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97400640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde9806e5a0 0x7fde98157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97400640 1 -- 172.21.15.106:0/1873672695 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde980507d0 con 0x7fde9815f060 2024-04-26T21:18:26.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde96a00640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde9806e5a0 0x7fde98157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:26.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde96000640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fde980b7510 0x7fde98156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:26.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97400640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9815f060 0x7fde9806ff60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fde90019080 tx=0x7fde9001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:26.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde8ea00640 1 -- 172.21.15.106:0/1873672695 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde900b2040 con 0x7fde9815f060 2024-04-26T21:18:26.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde8ea00640 1 -- 172.21.15.106:0/1873672695 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde900bd070 con 0x7fde9815f060 2024-04-26T21:18:26.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde98158300 con 0x7fde9815f060 2024-04-26T21:18:26.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde8ea00640 1 -- 172.21.15.106:0/1873672695 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde900add30 con 0x7fde9815f060 2024-04-26T21:18:26.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde981588c0 con 0x7fde9815f060 2024-04-26T21:18:26.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde98069400 con 0x7fde9815f060 2024-04-26T21:18:26.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.954+0000 7fde8ea00640 1 -- 172.21.15.106:0/1873672695 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fde900b8450 con 0x7fde9815f060 2024-04-26T21:18:26.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde8ea00640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde74068380 0x7fde7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde8ea00640 1 -- 172.21.15.106:0/1873672695 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7fde90121530 con 0x7fde9815f060 2024-04-26T21:18:26.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde96a00640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde74068380 0x7fde7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde8ea00640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7fde7406e8c0 0x7fde74070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde8ea00640 1 -- 172.21.15.106:0/1873672695 --> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde900c4e70 con 0x7fde7406e8c0 2024-04-26T21:18:26.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde8ea00640 1 -- 172.21.15.106:0/1873672695 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fde901218e0 con 0x7fde9815f060 2024-04-26T21:18:26.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde96000640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7fde7406e8c0 0x7fde74070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde96a00640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde74068380 0x7fde7406a840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde800011f0 tx=0x7fde80009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:26.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde96000640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7fde7406e8c0 0x7fde74070d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:26.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.958+0000 7fde8ea00640 1 -- 172.21.15.106:0/1873672695 <== osd.0 v2:172.21.15.106:6824/2880453688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde900c4e70 con 0x7fde7406e8c0 2024-04-26T21:18:26.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.970+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 --> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fde980719b0 con 0x7fde7406e8c0 2024-04-26T21:18:26.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.970+0000 7fde8ea00640 1 -- 172.21.15.106:0/1873672695 <== osd.0 v2:172.21.15.106:6824/2880453688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fde980719b0 con 0x7fde7406e8c0 2024-04-26T21:18:26.975 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:18:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T21:18:26.975 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:18:26.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7fde7406e8c0 msgr2=0x7fde74070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6824/2880453688,v1:172.21.15.106:6825/2880453688] conn(0x7fde7406e8c0 0x7fde74070d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde74068380 msgr2=0x7fde7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fde74068380 0x7fde7406a840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde800011f0 tx=0x7fde80009040 comp rx=0 tx=0).stop 2024-04-26T21:18:26.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9815f060 msgr2=0x7fde9806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 --2- 172.21.15.106:0/1873672695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde9815f060 0x7fde9806ff60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fde90019080 tx=0x7fde9001acb0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97400640 1 -- 172.21.15.106:0/1873672695 reap_dead start 2024-04-26T21:18:26.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 shutdown_connections 2024-04-26T21:18:26.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 >> 172.21.15.106:0/1873672695 conn(0x7fde980b7ee0 msgr2=0x7fde9815a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:26.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 shutdown_connections 2024-04-26T21:18:26.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:26.974+0000 7fde97e00640 1 -- 172.21.15.106:0/1873672695 wait complete. 2024-04-26T21:18:26.994 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T21:18:27.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.126+0000 7f12a8c00640 1 Processor -- start 2024-04-26T21:18:27.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a8c00640 1 -- start start 2024-04-26T21:18:27.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a8c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a40b4900 0x7f12a415b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a8c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f12a4073770 0x7f12a415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a8c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a4073bb0 con 0x7f12a4144a50 2024-04-26T21:18:27.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a8c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f12a4144e30 con 0x7f12a4073770 2024-04-26T21:18:27.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a8c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f12a4072ba0 con 0x7f12a40b4900 2024-04-26T21:18:27.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f12a4144a50 0x7f12a40b41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39130/0 (socket says 172.21.15.106:39130) 2024-04-26T21:18:27.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1e00640 1 -- 172.21.15.106:0/1246075630 learned_addr learned my addr 172.21.15.106:0/1246075630 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:27.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f129be00640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a40b4900 0x7f12a415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a2800640 1 --2- 172.21.15.106:0/1246075630 >> v2:172.21.15.112:3300/0 conn(0x7f12a4073770 0x7f12a415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556556856 0 0) 0x7f12a4073bb0 con 0x7f12a4144a50 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1288005740 con 0x7f12a4144a50 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 452118408 0 0) 0x7f1288005740 con 0x7f12a4144a50 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a40b4900 msgr2=0x7f12a415b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a40b4900 0x7f12a415b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 >> v2:172.21.15.112:3300/0 conn(0x7f12a4073770 msgr2=0x7f12a415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 --2- 172.21.15.106:0/1246075630 >> v2:172.21.15.112:3300/0 conn(0x7f12a4073770 0x7f12a415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a415bbc0 con 0x7f12a4144a50 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f1294001680 con 0x7f12a4144a50 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 >> v1:172.21.15.106:6789/0 conn(0x7f12a4144a50 legacy=0x7f12a40b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1288005c00 0x7f1288006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288006a20 0x7f1288006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a40b4900 0x7f12880073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f12a4144e30 con 0x7f1288005c00 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f12a4072ba0 con 0x7f1288006a20 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f128800dbe0 con 0x7f12a40b4900 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1e00640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1288005c00 0x7f1288006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a2800640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a40b4900 0x7f12880073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f129be00640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288006a20 0x7f1288006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1e00640 1 -- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a40b4900 msgr2=0x7f12880073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1e00640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a40b4900 0x7f12880073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1e00640 1 -- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288006a20 msgr2=0x7f1288006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1e00640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288006a20 0x7f1288006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.130+0000 7f12a1e00640 1 -- 172.21.15.106:0/1246075630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1288005740 con 0x7f1288005c00 2024-04-26T21:18:27.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a1e00640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1288005c00 0x7f1288006020 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f129400c240 tx=0x7f129401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db52ff54debe42f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294007d20 con 0x7f1288005c00 2024-04-26T21:18:27.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12940a9070 con 0x7f1288005c00 2024-04-26T21:18:27.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a1400640 1 -- 172.21.15.106:0/1246075630 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294005d40 con 0x7f1288005c00 2024-04-26T21:18:27.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a8c00640 1 -- 172.21.15.106:0/1246075630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1288005c00 msgr2=0x7f1288006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a8c00640 1 --2- 172.21.15.106:0/1246075630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1288005c00 0x7f1288006020 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f129400c240 tx=0x7f129401cc50 comp rx=0 tx=0).stop 2024-04-26T21:18:27.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a2800640 1 -- 172.21.15.106:0/1246075630 reap_dead start 2024-04-26T21:18:27.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a8c00640 1 -- 172.21.15.106:0/1246075630 shutdown_connections 2024-04-26T21:18:27.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a8c00640 1 -- 172.21.15.106:0/1246075630 >> 172.21.15.106:0/1246075630 conn(0x7f12a406e440 msgr2=0x7f12a406e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a8c00640 1 -- 172.21.15.106:0/1246075630 shutdown_connections 2024-04-26T21:18:27.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.134+0000 7f12a8c00640 1 -- 172.21.15.106:0/1246075630 wait complete. 2024-04-26T21:18:27.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 Processor -- start 2024-04-26T21:18:27.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 -- start start 2024-04-26T21:18:27.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288005c00 0x7f12a414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a41614f0 0x7f12a415ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12a413da40 0x7f12a413dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f12a415d9b0 con 0x7f12a413da40 2024-04-26T21:18:27.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f12a415c740 con 0x7f1288005c00 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f12a415db30 con 0x7f12a41614f0 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12a413da40 0x7f12a413dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12a413da40 0x7f12a413dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33840/0 (socket says 172.21.15.106:33840) 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a2800640 1 -- 172.21.15.106:0/3595007808 learned_addr learned my addr 172.21.15.106:0/3595007808 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f129be00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a41614f0 0x7f12a415ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a1e00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288005c00 0x7f12a414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a2800640 1 -- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a41614f0 msgr2=0x7f12a415ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a2800640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a41614f0 0x7f12a415ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a2800640 1 -- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288005c00 msgr2=0x7f12a414fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a2800640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288005c00 0x7f12a414fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a2800640 1 -- 172.21.15.106:0/3595007808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a413b310 con 0x7f12a413da40 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f129be00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a41614f0 0x7f12a415ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:27.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a1e00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288005c00 0x7f12a414fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:27.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a2800640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12a413da40 0x7f12a413dec0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f12a40724b0 tx=0x7f129c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f129a000640 1 -- 172.21.15.106:0/3595007808 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c015430 con 0x7f12a413da40 2024-04-26T21:18:27.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f129a000640 1 -- 172.21.15.106:0/3595007808 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c0155f0 con 0x7f12a413da40 2024-04-26T21:18:27.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f129a000640 1 -- 172.21.15.106:0/3595007808 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0159e0 con 0x7f12a413da40 2024-04-26T21:18:27.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a415e270 con 0x7f12a413da40 2024-04-26T21:18:27.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a4161970 con 0x7f12a413da40 2024-04-26T21:18:27.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.138+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a4069400 con 0x7f12a413da40 2024-04-26T21:18:27.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.142+0000 7f129a000640 1 -- 172.21.15.106:0/3595007808 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f129c015b80 con 0x7f12a413da40 2024-04-26T21:18:27.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.142+0000 7f129a000640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f12800683b0 0x7f128006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.142+0000 7f129a000640 1 -- 172.21.15.106:0/3595007808 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f129c087330 con 0x7f12a413da40 2024-04-26T21:18:27.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.142+0000 7f12a1e00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f12800683b0 0x7f128006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.142+0000 7f12a1e00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f12800683b0 0x7f128006a870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12940ab000 tx=0x7f12940b1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.146+0000 7f129a000640 1 -- 172.21.15.106:0/3595007808 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f129c024030 con 0x7f12a413da40 2024-04-26T21:18:27.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.302+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f12a40741a0 con 0x7f12800683b0 2024-04-26T21:18:27.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.302+0000 7f129a000640 1 -- 172.21.15.106:0/3595007808 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f12a40741a0 con 0x7f12800683b0 2024-04-26T21:18:27.305 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T21:18:27.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.302+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f12800683b0 msgr2=0x7f128006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.302+0000 7f12a8c00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f12800683b0 0x7f128006a870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12940ab000 tx=0x7f12940b1040 comp rx=0 tx=0).stop 2024-04-26T21:18:27.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.302+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12a413da40 msgr2=0x7f12a413dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.302+0000 7f12a8c00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12a413da40 0x7f12a413dec0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f12a40724b0 tx=0x7f129c00f580 comp rx=0 tx=0).stop 2024-04-26T21:18:27.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.306+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 shutdown_connections 2024-04-26T21:18:27.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.306+0000 7f12a8c00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f12800683b0 0x7f128006a870 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.306+0000 7f12a8c00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12a413da40 0x7f12a413dec0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.306+0000 7f12a8c00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f12a41614f0 0x7f12a415ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.306+0000 7f12a8c00640 1 --2- 172.21.15.106:0/3595007808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1288005c00 0x7f12a414fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.306+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 >> 172.21.15.106:0/3595007808 conn(0x7f12a406e440 msgr2=0x7f12a40b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.306+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 shutdown_connections 2024-04-26T21:18:27.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.306+0000 7f12a8c00640 1 -- 172.21.15.106:0/3595007808 wait complete. 2024-04-26T21:18:27.326 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T21:18:27.326 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T21:18:27.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.462+0000 7fec99000640 1 Processor -- start 2024-04-26T21:18:27.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.462+0000 7fec99000640 1 -- start start 2024-04-26T21:18:27.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec99000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec941599a0 0x7fec940b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec99000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec94159d80 con 0x7fec94072010 2024-04-26T21:18:27.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec99000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec940b5cb0 con 0x7fec940b5810 2024-04-26T21:18:27.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec99000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fec9415cda0 con 0x7fec941599a0 2024-04-26T21:18:27.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec91400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fec94072010 0x7fec9406f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39136/0 (socket says 172.21.15.106:39136) 2024-04-26T21:18:27.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec91400640 1 -- 172.21.15.106:0/1599415627 learned_addr learned my addr 172.21.15.106:0/1599415627 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec91e00640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec941599a0 0x7fec940b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545133287 0 0) 0x7fec94159d80 con 0x7fec94072010 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec78003530 con 0x7fec94072010 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426005782 0 0) 0x7fec940b5cb0 con 0x7fec940b5810 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec94159d80 con 0x7fec940b5810 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982541547 0 0) 0x7fec78003530 con 0x7fec94072010 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec941599a0 msgr2=0x7fec940b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec941599a0 0x7fec940b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 >> v1:172.21.15.112:6789/0 conn(0x7fec940b5810 legacy=0x7fec940b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9415c750 con 0x7fec94072010 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7fec84001680 con 0x7fec94072010 2024-04-26T21:18:27.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 >> v1:172.21.15.106:6789/0 conn(0x7fec94072010 legacy=0x7fec9406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec78003b80 0x7fec78003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec941599a0 0x7fec78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec78004d50 0x7fec780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fec9415cda0 con 0x7fec78004d50 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec7800bad0 con 0x7fec78003b80 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fec7800bcd0 con 0x7fec941599a0 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec91400640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec941599a0 0x7fec78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec92800640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec78004d50 0x7fec780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec91e00640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec78003b80 0x7fec78003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec92800640 1 -- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec941599a0 msgr2=0x7fec78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec92800640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec941599a0 0x7fec78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec92800640 1 -- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec78003b80 msgr2=0x7fec78003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec92800640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec78003b80 0x7fec78003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec92800640 1 -- 172.21.15.106:0/1599415627 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec78003530 con 0x7fec78004d50 2024-04-26T21:18:27.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.466+0000 7fec91400640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec941599a0 0x7fec78004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:27.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec92800640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec78004d50 0x7fec780051d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fec940b37d0 tx=0x7fec8c01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dafc32025a87969 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c001c20 con 0x7fec78004d50 2024-04-26T21:18:27.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c0a8c90 con 0x7fec78004d50 2024-04-26T21:18:27.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec90a00640 1 -- 172.21.15.106:0/1599415627 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c003bc0 con 0x7fec78004d50 2024-04-26T21:18:27.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec99000640 1 -- 172.21.15.106:0/1599415627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec78004d50 msgr2=0x7fec780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec99000640 1 --2- 172.21.15.106:0/1599415627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec78004d50 0x7fec780051d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fec940b37d0 tx=0x7fec8c01f050 comp rx=0 tx=0).stop 2024-04-26T21:18:27.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec92800640 1 -- 172.21.15.106:0/1599415627 reap_dead start 2024-04-26T21:18:27.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec99000640 1 -- 172.21.15.106:0/1599415627 shutdown_connections 2024-04-26T21:18:27.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec99000640 1 -- 172.21.15.106:0/1599415627 >> 172.21.15.106:0/1599415627 conn(0x7fec940b27a0 msgr2=0x7fec940b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec99000640 1 -- 172.21.15.106:0/1599415627 shutdown_connections 2024-04-26T21:18:27.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.470+0000 7fec99000640 1 -- 172.21.15.106:0/1599415627 wait complete. 2024-04-26T21:18:27.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 Processor -- start 2024-04-26T21:18:27.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 -- start start 2024-04-26T21:18:27.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec78004d50 0x7fec941f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9415a330 0x7fec9415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec94148da0 0x7fec941491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fec9415d3b0 con 0x7fec94148da0 2024-04-26T21:18:27.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec9415d230 con 0x7fec9415a330 2024-04-26T21:18:27.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fec9415c3b0 con 0x7fec78004d50 2024-04-26T21:18:27.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec92800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec94148da0 0x7fec941491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec92800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec94148da0 0x7fec941491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33848/0 (socket says 172.21.15.106:33848) 2024-04-26T21:18:27.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec92800640 1 -- 172.21.15.106:0/2598890904 learned_addr learned my addr 172.21.15.106:0/2598890904 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec91e00640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec78004d50 0x7fec941f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec91400640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9415a330 0x7fec9415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec92800640 1 -- 172.21.15.106:0/2598890904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec78004d50 msgr2=0x7fec941f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec92800640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec78004d50 0x7fec941f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec92800640 1 -- 172.21.15.106:0/2598890904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9415a330 msgr2=0x7fec9415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec92800640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec9415a330 0x7fec9415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec92800640 1 -- 172.21.15.106:0/2598890904 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9415bc70 con 0x7fec94148da0 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec91e00640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec78004d50 0x7fec941f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec92800640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec94148da0 0x7fec941491e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fec8c01ee80 tx=0x7fec78005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec8a000640 1 -- 172.21.15.106:0/2598890904 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0c0070 con 0x7fec94148da0 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec8a000640 1 -- 172.21.15.106:0/2598890904 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c001c00 con 0x7fec94148da0 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9415b060 con 0x7fec94148da0 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec8a000640 1 -- 172.21.15.106:0/2598890904 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84007cb0 con 0x7fec94148da0 2024-04-26T21:18:27.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9415b620 con 0x7fec94148da0 2024-04-26T21:18:27.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.474+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec94069400 con 0x7fec94148da0 2024-04-26T21:18:27.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec8a000640 1 -- 172.21.15.106:0/2598890904 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec8c0c3070 con 0x7fec94148da0 2024-04-26T21:18:27.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec8a000640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fec70068380 0x7fec7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec8a000640 1 -- 172.21.15.106:0/2598890904 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7fec8c123a50 con 0x7fec94148da0 2024-04-26T21:18:27.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec91e00640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fec70068380 0x7fec7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec8a000640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7fec7006e8c0 0x7fec70070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec8a000640 1 -- 172.21.15.106:0/2598890904 --> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec8c005830 con 0x7fec7006e8c0 2024-04-26T21:18:27.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec8a000640 1 -- 172.21.15.106:0/2598890904 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fec8c123ee0 con 0x7fec94148da0 2024-04-26T21:18:27.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec91400640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7fec7006e8c0 0x7fec70070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec91e00640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fec70068380 0x7fec7006a840 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009be0 tx=0x7fec7c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec91400640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7fec7006e8c0 0x7fec70070d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.478+0000 7fec8a000640 1 -- 172.21.15.106:0/2598890904 <== osd.1 v2:172.21.15.106:6808/1511992084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec8c005830 con 0x7fec7006e8c0 2024-04-26T21:18:27.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 --> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fec9406e210 con 0x7fec7006e8c0 2024-04-26T21:18:27.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec8a000640 1 -- 172.21.15.106:0/2598890904 <== osd.1 v2:172.21.15.106:6808/1511992084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fec9406e210 con 0x7fec7006e8c0 2024-04-26T21:18:27.496 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:18:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T21:18:27.496 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:18:27.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7fec7006e8c0 msgr2=0x7fec70070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6808/1511992084,v1:172.21.15.106:6809/1511992084] conn(0x7fec7006e8c0 0x7fec70070d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fec70068380 msgr2=0x7fec7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fec70068380 0x7fec7006a840 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009be0 tx=0x7fec7c008040 comp rx=0 tx=0).stop 2024-04-26T21:18:27.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec94148da0 msgr2=0x7fec941491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 --2- 172.21.15.106:0/2598890904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec94148da0 0x7fec941491e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fec8c01ee80 tx=0x7fec78005840 comp rx=0 tx=0).stop 2024-04-26T21:18:27.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec92800640 1 -- 172.21.15.106:0/2598890904 reap_dead start 2024-04-26T21:18:27.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 shutdown_connections 2024-04-26T21:18:27.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 >> 172.21.15.106:0/2598890904 conn(0x7fec940b27a0 msgr2=0x7fec94072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 shutdown_connections 2024-04-26T21:18:27.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.494+0000 7fec99000640 1 -- 172.21.15.106:0/2598890904 wait complete. 2024-04-26T21:18:27.514 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T21:18:27.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b4200640 1 Processor -- start 2024-04-26T21:18:27.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b4200640 1 -- start start 2024-04-26T21:18:27.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b4200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac1624a0 0x7f65ac0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b4200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f65ac0aeae0 0x7f65ac0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b4200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac0b55e0 con 0x7f65ac0b3820 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b4200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f65ac0b58c0 con 0x7f65ac0aeae0 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b4200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f65ac0b5ba0 con 0x7f65ac1624a0 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b0e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f65ac0aeae0 0x7f65ac0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b2200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f65ac0b3820 0x7f65ac072750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39146/0 (socket says 172.21.15.106:39146) 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.646+0000 7f65b2200640 1 -- 172.21.15.106:0/3871409374 learned_addr learned my addr 172.21.15.106:0/3871409374 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.650+0000 7f65b1800640 1 --2- 172.21.15.106:0/3871409374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac1624a0 0x7f65ac0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.650+0000 7f65b0e00640 1 -- 172.21.15.106:0/3871409374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac1624a0 msgr2=0x7f65ac0b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.650+0000 7f65b0e00640 1 --2- 172.21.15.106:0/3871409374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac1624a0 0x7f65ac0b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.650+0000 7f65b0e00640 1 -- 172.21.15.106:0/3871409374 >> v1:172.21.15.106:6789/0 conn(0x7f65ac0b3820 legacy=0x7f65ac072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.650+0000 7f65b0e00640 1 -- 172.21.15.106:0/3871409374 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac06e810 con 0x7f65ac0aeae0 2024-04-26T21:18:27.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.650+0000 7f65b0e00640 1 --2- 172.21.15.106:0/3871409374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac0aeae0 0x7f65ac0b32e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f65980097c0 tx=0x7f659801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba38bc8cdcfb81c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.650+0000 7f65abe00640 1 -- 172.21.15.106:0/3871409374 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65980b0070 con 0x7f65ac0aeae0 2024-04-26T21:18:27.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.650+0000 7f65abe00640 1 -- 172.21.15.106:0/3871409374 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6598004230 con 0x7f65ac0aeae0 2024-04-26T21:18:27.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.650+0000 7f65abe00640 1 -- 172.21.15.106:0/3871409374 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598003620 con 0x7f65ac0aeae0 2024-04-26T21:18:27.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 -- 172.21.15.106:0/3871409374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac0aeae0 msgr2=0x7f65ac0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 --2- 172.21.15.106:0/3871409374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac0aeae0 0x7f65ac0b32e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f65980097c0 tx=0x7f659801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 -- 172.21.15.106:0/3871409374 shutdown_connections 2024-04-26T21:18:27.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 --2- 172.21.15.106:0/3871409374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac0aeae0 0x7f65ac0b32e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 --2- 172.21.15.106:0/3871409374 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac1624a0 0x7f65ac0b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 -- 172.21.15.106:0/3871409374 >> 172.21.15.106:0/3871409374 conn(0x7f65ac06c5d0 msgr2=0x7f65ac06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 -- 172.21.15.106:0/3871409374 shutdown_connections 2024-04-26T21:18:27.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 -- 172.21.15.106:0/3871409374 wait complete. 2024-04-26T21:18:27.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 Processor -- start 2024-04-26T21:18:27.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 -- start start 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac0aeae0 0x7f65ac14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac0b3820 0x7f65ac14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac1624a0 0x7f65ac159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac16bda0 con 0x7f65ac1624a0 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac16bc20 con 0x7f65ac0b3820 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b4200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f65ac16bf20 con 0x7f65ac0aeae0 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b2200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac1624a0 0x7f65ac159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b2200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac1624a0 0x7f65ac159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33866/0 (socket says 172.21.15.106:33866) 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b2200640 1 -- 172.21.15.106:0/3632475481 learned_addr learned my addr 172.21.15.106:0/3632475481 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b1800640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac0aeae0 0x7f65ac14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b0e00640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac0b3820 0x7f65ac14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b2200640 1 -- 172.21.15.106:0/3632475481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac0aeae0 msgr2=0x7f65ac14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b2200640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac0aeae0 0x7f65ac14db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b2200640 1 -- 172.21.15.106:0/3632475481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac0b3820 msgr2=0x7f65ac14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b2200640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac0b3820 0x7f65ac14c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.654+0000 7f65b2200640 1 -- 172.21.15.106:0/3632475481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac153b10 con 0x7f65ac1624a0 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65b2200640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac1624a0 0x7f65ac159c60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f65a400ca80 tx=0x7f65a400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65a9600640 1 -- 172.21.15.106:0/3632475481 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4017070 con 0x7f65ac1624a0 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65a9600640 1 -- 172.21.15.106:0/3632475481 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a400ac30 con 0x7f65ac1624a0 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65a9600640 1 -- 172.21.15.106:0/3632475481 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4012600 con 0x7f65ac1624a0 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ac153df0 con 0x7f65ac1624a0 2024-04-26T21:18:27.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ac152240 con 0x7f65ac1624a0 2024-04-26T21:18:27.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ac069400 con 0x7f65ac1624a0 2024-04-26T21:18:27.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65a9600640 1 -- 172.21.15.106:0/3632475481 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f65a401a070 con 0x7f65ac1624a0 2024-04-26T21:18:27.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65a9600640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f658c068380 0x7f658c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65a9600640 1 -- 172.21.15.106:0/3632475481 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f65a4086480 con 0x7f65ac1624a0 2024-04-26T21:18:27.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.658+0000 7f65b1800640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f658c068380 0x7f658c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.662+0000 7f65b1800640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f658c068380 0x7f658c06a840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0d06a0 tx=0x7f65a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.666+0000 7f65a9600640 1 -- 172.21.15.106:0/3632475481 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f65a400ae20 con 0x7f65ac1624a0 2024-04-26T21:18:27.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.818+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f65ac06d730 con 0x7f658c068380 2024-04-26T21:18:27.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.818+0000 7f65a9600640 1 -- 172.21.15.106:0/3632475481 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f65ac06d730 con 0x7f658c068380 2024-04-26T21:18:27.823 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T21:18:27.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f658c068380 msgr2=0x7f658c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f658c068380 0x7f658c06a840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0d06a0 tx=0x7f65a0008040 comp rx=0 tx=0).stop 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac1624a0 msgr2=0x7f65ac159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac1624a0 0x7f65ac159c60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f65a400ca80 tx=0x7f65a400cf40 comp rx=0 tx=0).stop 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 shutdown_connections 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac0b3820 0x7f65ac14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f658c068380 0x7f658c06a840 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65ac1624a0 0x7f65ac159c60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 --2- 172.21.15.106:0/3632475481 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f65ac0aeae0 0x7f65ac14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 >> 172.21.15.106:0/3632475481 conn(0x7f65ac06c5d0 msgr2=0x7f65ac161140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 shutdown_connections 2024-04-26T21:18:27.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.822+0000 7f65b4200640 1 -- 172.21.15.106:0/3632475481 wait complete. 2024-04-26T21:18:27.845 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T21:18:27.845 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T21:18:27.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f9880600640 1 Processor -- start 2024-04-26T21:18:27.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f9880600640 1 -- start start 2024-04-26T21:18:27.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f9880600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073740 0x7f987806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f9880600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9878073b80 0x7f987806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f9880600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98780d15d0 con 0x7f98780d11f0 2024-04-26T21:18:27.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f9880600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f98780b15d0 con 0x7f9878073b80 2024-04-26T21:18:27.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f9880600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f98780b0a50 con 0x7f9878073740 2024-04-26T21:18:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f987d200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073740 0x7f987806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f987e600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9878073b80 0x7f987806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f987dc00640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f98780d11f0 0x7f98780d19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:46194/0 (socket says 172.21.15.106:46194) 2024-04-26T21:18:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f987dc00640 1 -- 172.21.15.106:0/1807592441 learned_addr learned my addr 172.21.15.106:0/1807592441 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f9877e00640 1 -- 172.21.15.106:0/1807592441 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79990446 0 0) 0x7f98780d15d0 con 0x7f98780d11f0 2024-04-26T21:18:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f9877e00640 1 -- 172.21.15.106:0/1807592441 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9860003530 con 0x7f98780d11f0 2024-04-26T21:18:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f987d200640 1 -- 172.21.15.106:0/1807592441 >> v2:172.21.15.112:3300/0 conn(0x7f9878073b80 msgr2=0x7f987806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f987d200640 1 --2- 172.21.15.106:0/1807592441 >> v2:172.21.15.112:3300/0 conn(0x7f9878073b80 0x7f987806c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f987d200640 1 -- 172.21.15.106:0/1807592441 >> v1:172.21.15.112:6789/0 conn(0x7f98780d11f0 legacy=0x7f98780d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f987d200640 1 -- 172.21.15.106:0/1807592441 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98780b0d30 con 0x7f9878073740 2024-04-26T21:18:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.982+0000 7f987e600640 1 --2- 172.21.15.106:0/1807592441 >> v2:172.21.15.112:3300/0 conn(0x7f9878073b80 0x7f987806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:27.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.986+0000 7f987d200640 1 --2- 172.21.15.106:0/1807592441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073740 0x7f987806c400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98640097c0 tx=0x7f986401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7026d2a8c9071b23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.986+0000 7f9877e00640 1 -- 172.21.15.106:0/1807592441 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98640a7070 con 0x7f9878073740 2024-04-26T21:18:27.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.986+0000 7f9877e00640 1 -- 172.21.15.106:0/1807592441 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98640b0070 con 0x7f9878073740 2024-04-26T21:18:27.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.986+0000 7f9877e00640 1 -- 172.21.15.106:0/1807592441 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98640ab890 con 0x7f9878073740 2024-04-26T21:18:27.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.986+0000 7f9880600640 1 -- 172.21.15.106:0/1807592441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073740 msgr2=0x7f987806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.986+0000 7f9880600640 1 --2- 172.21.15.106:0/1807592441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073740 0x7f987806c400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98640097c0 tx=0x7f986401c470 comp rx=0 tx=0).stop 2024-04-26T21:18:27.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.986+0000 7f9880600640 1 -- 172.21.15.106:0/1807592441 shutdown_connections 2024-04-26T21:18:27.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 --2- 172.21.15.106:0/1807592441 >> v2:172.21.15.112:3300/0 conn(0x7f9878073b80 0x7f987806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 --2- 172.21.15.106:0/1807592441 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073740 0x7f987806c400 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 -- 172.21.15.106:0/1807592441 >> 172.21.15.106:0/1807592441 conn(0x7f9878068140 msgr2=0x7f9878068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 -- 172.21.15.106:0/1807592441 shutdown_connections 2024-04-26T21:18:27.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 -- 172.21.15.106:0/1807592441 wait complete. 2024-04-26T21:18:27.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 Processor -- start 2024-04-26T21:18:27.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 -- start start 2024-04-26T21:18:27.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9878073740 0x7f987813b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073b80 0x7f987814e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98780d11f0 0x7f98781559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9878160180 con 0x7f98780d11f0 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98780b5300 con 0x7f9878073740 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f9880600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9878160300 con 0x7f9878073b80 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987e600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98780d11f0 0x7f98781559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987e600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98780d11f0 0x7f98781559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33876/0 (socket says 172.21.15.106:33876) 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987e600640 1 -- 172.21.15.106:0/3199480779 learned_addr learned my addr 172.21.15.106:0/3199480779 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987d200640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073b80 0x7f987814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987dc00640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9878073740 0x7f987813b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987e600640 1 -- 172.21.15.106:0/3199480779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073b80 msgr2=0x7f987814e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987e600640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073b80 0x7f987814e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987e600640 1 -- 172.21.15.106:0/3199480779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9878073740 msgr2=0x7f987813b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987e600640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9878073740 0x7f987813b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987e600640 1 -- 172.21.15.106:0/3199480779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987815dbd0 con 0x7f98780d11f0 2024-04-26T21:18:27.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987d200640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9878073b80 0x7f987814e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:27.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.990+0000 7f987e600640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98780d11f0 0x7f98781559f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f987000efc0 tx=0x7f9870009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9875600640 1 -- 172.21.15.106:0/3199480779 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870018030 con 0x7f98780d11f0 2024-04-26T21:18:27.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9875600640 1 -- 172.21.15.106:0/3199480779 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f987000cde0 con 0x7f98780d11f0 2024-04-26T21:18:27.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9875600640 1 -- 172.21.15.106:0/3199480779 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870003bc0 con 0x7f98780d11f0 2024-04-26T21:18:27.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9878152610 con 0x7f98780d11f0 2024-04-26T21:18:27.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987815de70 con 0x7f98780d11f0 2024-04-26T21:18:27.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9878069400 con 0x7f98780d11f0 2024-04-26T21:18:27.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9875600640 1 -- 172.21.15.106:0/3199480779 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f987001b070 con 0x7f98780d11f0 2024-04-26T21:18:27.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9875600640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9858068380 0x7f985806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9875600640 1 -- 172.21.15.106:0/3199480779 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f98700873c0 con 0x7f98780d11f0 2024-04-26T21:18:27.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f987dc00640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9858068380 0x7f985806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9875600640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f985806e8c0 0x7f9858070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9875600640 1 -- 172.21.15.106:0/3199480779 --> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98580713d0 con 0x7f985806e8c0 2024-04-26T21:18:27.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f9875600640 1 -- 172.21.15.106:0/3199480779 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f987008e050 con 0x7f98780d11f0 2024-04-26T21:18:27.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f987d200640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f985806e8c0 0x7f9858070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.994+0000 7f987dc00640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9858068380 0x7f985806a840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f986c005890 tx=0x7f986c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.998+0000 7f987d200640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f985806e8c0 0x7f9858070d00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:27.998+0000 7f9875600640 1 -- 172.21.15.106:0/3199480779 <== osd.2 v2:172.21.15.106:6800/522723976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f98580713d0 con 0x7f985806e8c0 2024-04-26T21:18:28.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 --> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f98780af4c0 con 0x7f985806e8c0 2024-04-26T21:18:28.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9875600640 1 -- 172.21.15.106:0/3199480779 <== osd.2 v2:172.21.15.106:6800/522723976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f98780af4c0 con 0x7f985806e8c0 2024-04-26T21:18:28.014 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:18:28.014 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T21:18:28.014 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f985806e8c0 msgr2=0x7f9858070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6800/522723976,v1:172.21.15.106:6801/522723976] conn(0x7f985806e8c0 0x7f9858070d00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9858068380 msgr2=0x7f985806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f9858068380 0x7f985806a840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f986c005890 tx=0x7f986c009040 comp rx=0 tx=0).stop 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98780d11f0 msgr2=0x7f98781559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 --2- 172.21.15.106:0/3199480779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98780d11f0 0x7f98781559f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f987000efc0 tx=0x7f9870009f90 comp rx=0 tx=0).stop 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f987e600640 1 -- 172.21.15.106:0/3199480779 reap_dead start 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 shutdown_connections 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 >> 172.21.15.106:0/3199480779 conn(0x7f9878068140 msgr2=0x7f98780d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 shutdown_connections 2024-04-26T21:18:28.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.010+0000 7f9880600640 1 -- 172.21.15.106:0/3199480779 wait complete. 2024-04-26T21:18:28.033 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T21:18:28.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d15e00640 1 Processor -- start 2024-04-26T21:18:28.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d15e00640 1 -- start start 2024-04-26T21:18:28.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d15e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1015d060 0x7f8d100cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d15e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d100b2250 con 0x7f8d100cfb70 2024-04-26T21:18:28.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d15e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d100ce660 con 0x7f8d100b3a40 2024-04-26T21:18:28.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d15e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8d100b25a0 con 0x7f8d1015d060 2024-04-26T21:18:28.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0e000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8d100cfb70 0x7f8d100d0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39162/0 (socket says 172.21.15.106:39162) 2024-04-26T21:18:28.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0e000640 1 -- 172.21.15.106:0/335675231 learned_addr learned my addr 172.21.15.106:0/335675231 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:28.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498854133 0 0) 0x7f8d100b2250 con 0x7f8d100cfb70 2024-04-26T21:18:28.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cf4003530 con 0x7f8d100cfb70 2024-04-26T21:18:28.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0ea00640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1015d060 0x7f8d100cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1937050102 0 0) 0x7f8cf4003530 con 0x7f8d100cfb70 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1015d060 msgr2=0x7f8d100cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1015d060 0x7f8d100cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 >> v1:172.21.15.112:6789/0 conn(0x7f8d100b3a40 legacy=0x7f8d100d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d100ce940 con 0x7f8d100cfb70 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1104279792 0 0) 0x7f8d00001680 con 0x7f8d100cfb70 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 >> v1:172.21.15.106:6789/0 conn(0x7f8d100cfb70 legacy=0x7f8d100d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cf40039f0 0x7f8cf4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cf4004810 0x7f8cf4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1015d060 0x7f8cf40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8d100b25a0 con 0x7f8cf40039f0 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf400ba80 con 0x7f8cf4004810 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.166+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf400bc80 con 0x7f8d1015d060 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0ea00640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cf40039f0 0x7f8cf4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0f400640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1015d060 0x7f8cf40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0e000640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cf4004810 0x7f8cf4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0ea00640 1 -- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1015d060 msgr2=0x7f8cf40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0ea00640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d1015d060 0x7f8cf40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0ea00640 1 -- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cf4004810 msgr2=0x7f8cf4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0ea00640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cf4004810 0x7f8cf4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0ea00640 1 -- 172.21.15.106:0/335675231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf4003530 con 0x7f8cf40039f0 2024-04-26T21:18:28.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0ea00640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cf40039f0 0x7f8cf4003e10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009ab0 tx=0x7f8cf801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4444b84ae62cb1a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80b2070 con 0x7f8cf40039f0 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf80a5510 con 0x7f8cf40039f0 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0d600640 1 -- 172.21.15.106:0/335675231 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80096b0 con 0x7f8cf40039f0 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d15e00640 1 -- 172.21.15.106:0/335675231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cf40039f0 msgr2=0x7f8cf4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d15e00640 1 --2- 172.21.15.106:0/335675231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cf40039f0 0x7f8cf4003e10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009ab0 tx=0x7f8cf801ca30 comp rx=0 tx=0).stop 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.170+0000 7f8d0f400640 1 -- 172.21.15.106:0/335675231 reap_dead start 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 -- 172.21.15.106:0/335675231 shutdown_connections 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 -- 172.21.15.106:0/335675231 >> 172.21.15.106:0/335675231 conn(0x7f8d100d2c60 msgr2=0x7f8d100d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 -- 172.21.15.106:0/335675231 shutdown_connections 2024-04-26T21:18:28.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 -- 172.21.15.106:0/335675231 wait complete. 2024-04-26T21:18:28.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 Processor -- start 2024-04-26T21:18:28.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 -- start start 2024-04-26T21:18:28.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cf40039f0 0x7f8d101490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d100c9d30 0x7f8d100ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d10156630 0x7f8d10156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8d100ce400 con 0x7f8d10156630 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d100ce280 con 0x7f8d100c9d30 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d15e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8d100d1650 con 0x7f8cf40039f0 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d10156630 0x7f8d10156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d10156630 0x7f8d10156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33892/0 (socket says 172.21.15.106:33892) 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0f400640 1 -- 172.21.15.106:0/2780176570 learned_addr learned my addr 172.21.15.106:0/2780176570 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0e000640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d100c9d30 0x7f8d100ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0ea00640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cf40039f0 0x7f8d101490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0f400640 1 -- 172.21.15.106:0/2780176570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cf40039f0 msgr2=0x7f8d101490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0f400640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cf40039f0 0x7f8d101490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0f400640 1 -- 172.21.15.106:0/2780176570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d100c9d30 msgr2=0x7f8d100ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0f400640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d100c9d30 0x7f8d100ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0f400640 1 -- 172.21.15.106:0/2780176570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d10156ff0 con 0x7f8d10156630 2024-04-26T21:18:28.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d0f400640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d10156630 0x7f8d10156ab0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800e780 tx=0x7f8d0800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d07400640 1 -- 172.21.15.106:0/2780176570 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08003980 con 0x7f8d10156630 2024-04-26T21:18:28.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.174+0000 7f8d07400640 1 -- 172.21.15.106:0/2780176570 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d08018070 con 0x7f8d10156630 2024-04-26T21:18:28.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.178+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d10157280 con 0x7f8d10156630 2024-04-26T21:18:28.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.178+0000 7f8d07400640 1 -- 172.21.15.106:0/2780176570 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08003d60 con 0x7f8d10156630 2024-04-26T21:18:28.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.178+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1006d920 con 0x7f8d10156630 2024-04-26T21:18:28.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.178+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d10069400 con 0x7f8d10156630 2024-04-26T21:18:28.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.178+0000 7f8d07400640 1 -- 172.21.15.106:0/2780176570 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d080050d0 con 0x7f8d10156630 2024-04-26T21:18:28.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.178+0000 7f8d07400640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8cec0683b0 0x7f8cec06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.178+0000 7f8d07400640 1 -- 172.21.15.106:0/2780176570 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f8d080864c0 con 0x7f8d10156630 2024-04-26T21:18:28.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.178+0000 7f8d0ea00640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8cec0683b0 0x7f8cec06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.178+0000 7f8d0ea00640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8cec0683b0 0x7f8cec06a870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80af000 tx=0x7f8cf80046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.182+0000 7f8d07400640 1 -- 172.21.15.106:0/2780176570 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8d08056c30 con 0x7f8d10156630 2024-04-26T21:18:28.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f8d10157560 con 0x7f8cec0683b0 2024-04-26T21:18:28.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d07400640 1 -- 172.21.15.106:0/2780176570 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8cf80096b0 con 0x7f8cec0683b0 2024-04-26T21:18:28.345 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T21:18:28.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8cec0683b0 msgr2=0x7f8cec06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8cec0683b0 0x7f8cec06a870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80af000 tx=0x7f8cf80046d0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d10156630 msgr2=0x7f8d10156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d10156630 0x7f8d10156ab0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800e780 tx=0x7f8d0800ec40 comp rx=0 tx=0).stop 2024-04-26T21:18:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 shutdown_connections 2024-04-26T21:18:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d100c9d30 0x7f8d100ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f8cec0683b0 0x7f8cec06a870 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d10156630 0x7f8d10156ab0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 --2- 172.21.15.106:0/2780176570 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8cf40039f0 0x7f8d101490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 >> 172.21.15.106:0/2780176570 conn(0x7f8d100d2c60 msgr2=0x7f8d10070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 shutdown_connections 2024-04-26T21:18:28.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.342+0000 7f8d15e00640 1 -- 172.21.15.106:0/2780176570 wait complete. 2024-04-26T21:18:28.367 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T21:18:28.367 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T21:18:28.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.502+0000 7f256ac00640 1 Processor -- start 2024-04-26T21:18:28.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256ac00640 1 -- start start 2024-04-26T21:18:28.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256ac00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f25640b3e00 0x7f25640cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256ac00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25640b38b0 0x7f2564163510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256ac00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25640b53c0 con 0x7f2564163130 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256ac00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f25640d1690 con 0x7f25640b38b0 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256ac00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f25640b5170 con 0x7f25640b3e00 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256a200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25640b38b0 0x7f2564163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256a200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25640b38b0 0x7f2564163510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33906/0 (socket says 172.21.15.106:33906) 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256a200640 1 -- 172.21.15.106:0/335270542 learned_addr learned my addr 172.21.15.106:0/335270542 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f2569800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2564163130 0x7f25640cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39172/0 (socket says 172.21.15.106:39172) 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256a200640 1 -- 172.21.15.106:0/335270542 >> v2:172.21.15.112:3300/0 conn(0x7f25640b3e00 msgr2=0x7f25640cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f2568e00640 1 --2- 172.21.15.106:0/335270542 >> v2:172.21.15.112:3300/0 conn(0x7f25640b3e00 0x7f25640cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256a200640 1 --2- 172.21.15.106:0/335270542 >> v2:172.21.15.112:3300/0 conn(0x7f25640b3e00 0x7f25640cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256a200640 1 -- 172.21.15.106:0/335270542 >> v1:172.21.15.106:6789/0 conn(0x7f2564163130 legacy=0x7f25640cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f256a200640 1 -- 172.21.15.106:0/335270542 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2564163ca0 con 0x7f25640b38b0 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f2563e00640 1 -- 172.21.15.106:0/335270542 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778568327 0 0) 0x7f25640b53c0 con 0x7f2564163130 2024-04-26T21:18:28.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.506+0000 7f2568e00640 1 --2- 172.21.15.106:0/335270542 >> v2:172.21.15.112:3300/0 conn(0x7f25640b3e00 0x7f25640cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:28.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256a200640 1 --2- 172.21.15.106:0/335270542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25640b38b0 0x7f2564163510 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2564076220 tx=0x7f255c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5764cba7d75b36ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f2563e00640 1 -- 172.21.15.106:0/335270542 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0a57d0 con 0x7f25640b38b0 2024-04-26T21:18:28.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f2563e00640 1 -- 172.21.15.106:0/335270542 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c0a5970 con 0x7f25640b38b0 2024-04-26T21:18:28.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f2563e00640 1 -- 172.21.15.106:0/335270542 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0a5d40 con 0x7f25640b38b0 2024-04-26T21:18:28.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 -- 172.21.15.106:0/335270542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25640b38b0 msgr2=0x7f2564163510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 --2- 172.21.15.106:0/335270542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25640b38b0 0x7f2564163510 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2564076220 tx=0x7f255c01c9f0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 -- 172.21.15.106:0/335270542 shutdown_connections 2024-04-26T21:18:28.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 --2- 172.21.15.106:0/335270542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25640b38b0 0x7f2564163510 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 --2- 172.21.15.106:0/335270542 >> v2:172.21.15.112:3300/0 conn(0x7f25640b3e00 0x7f25640cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 -- 172.21.15.106:0/335270542 >> 172.21.15.106:0/335270542 conn(0x7f25640b4680 msgr2=0x7f25640b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 -- 172.21.15.106:0/335270542 shutdown_connections 2024-04-26T21:18:28.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 -- 172.21.15.106:0/335270542 wait complete. 2024-04-26T21:18:28.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 Processor -- start 2024-04-26T21:18:28.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.510+0000 7f256ac00640 1 -- start start 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256ac00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25640b38b0 0x7f25641599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256ac00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25640b3e00 0x7f25640c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256ac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2564163130 0x7f25640cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256ac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f256406e670 con 0x7f2564163130 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256ac00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f256406e4f0 con 0x7f25640b38b0 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256ac00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f256406e7f0 con 0x7f25640b3e00 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256a200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2564163130 0x7f25640cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256a200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2564163130 0x7f25640cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33918/0 (socket says 172.21.15.106:33918) 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256a200640 1 -- 172.21.15.106:0/284298520 learned_addr learned my addr 172.21.15.106:0/284298520 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f2568e00640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25640b3e00 0x7f25640c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256a200640 1 -- 172.21.15.106:0/284298520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25640b3e00 msgr2=0x7f25640c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f2569800640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25640b38b0 0x7f25641599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256a200640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25640b3e00 0x7f25640c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256a200640 1 -- 172.21.15.106:0/284298520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25640b38b0 msgr2=0x7f25641599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256a200640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25640b38b0 0x7f25641599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256a200640 1 -- 172.21.15.106:0/284298520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25640c7e20 con 0x7f2564163130 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f2568e00640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f25640b3e00 0x7f25640c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f2569800640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25640b38b0 0x7f25641599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256a200640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2564163130 0x7f25640cab50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f255c0af040 tx=0x7f255c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f2561600640 1 -- 172.21.15.106:0/284298520 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0bc030 con 0x7f2564163130 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f2561600640 1 -- 172.21.15.106:0/284298520 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c0039a0 con 0x7f2564163130 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f2561600640 1 -- 172.21.15.106:0/284298520 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c003d50 con 0x7f2564163130 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25640c8100 con 0x7f2564163130 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25640c86c0 con 0x7f2564163130 2024-04-26T21:18:28.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25640c7bd0 con 0x7f2564163130 2024-04-26T21:18:28.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.514+0000 7f2561600640 1 -- 172.21.15.106:0/284298520 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f255c004020 con 0x7f2564163130 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2561600640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f25440683b0 0x7f254406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2561600640 1 -- 172.21.15.106:0/284298520 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f255c121700 con 0x7f2564163130 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2569800640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f25440683b0 0x7f254406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2561600640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f254406e8f0 0x7f2544070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2561600640 1 -- 172.21.15.106:0/284298520 --> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f255c0020c0 con 0x7f254406e8f0 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2561600640 1 -- 172.21.15.106:0/284298520 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f255c128050 con 0x7f2564163130 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2568e00640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f254406e8f0 0x7f2544070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2569800640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f25440683b0 0x7f254406a870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2558000f70 tx=0x7f2558009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2568e00640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f254406e8f0 0x7f2544070d30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.518+0000 7f2561600640 1 -- 172.21.15.106:0/284298520 <== osd.3 v2:172.21.15.106:6816/1343890463 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f255c0020c0 con 0x7f254406e8f0 2024-04-26T21:18:28.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.530+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 --> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2564069400 con 0x7f254406e8f0 2024-04-26T21:18:28.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.530+0000 7f2561600640 1 -- 172.21.15.106:0/284298520 <== osd.3 v2:172.21.15.106:6816/1343890463 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2564069400 con 0x7f254406e8f0 2024-04-26T21:18:28.535 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:18:28.535 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T21:18:28.535 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:18:28.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.530+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f254406e8f0 msgr2=0x7f2544070d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.530+0000 7f256ac00640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6816/1343890463,v1:172.21.15.106:6817/1343890463] conn(0x7f254406e8f0 0x7f2544070d30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.530+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f25440683b0 msgr2=0x7f254406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.530+0000 7f256ac00640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f25440683b0 0x7f254406a870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2558000f70 tx=0x7f2558009040 comp rx=0 tx=0).stop 2024-04-26T21:18:28.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.530+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2564163130 msgr2=0x7f25640cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.530+0000 7f256ac00640 1 --2- 172.21.15.106:0/284298520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2564163130 0x7f25640cab50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f255c0af040 tx=0x7f255c019790 comp rx=0 tx=0).stop 2024-04-26T21:18:28.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.530+0000 7f256a200640 1 -- 172.21.15.106:0/284298520 reap_dead start 2024-04-26T21:18:28.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.534+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 shutdown_connections 2024-04-26T21:18:28.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.534+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 >> 172.21.15.106:0/284298520 conn(0x7f25640b4680 msgr2=0x7f25640b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.534+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 shutdown_connections 2024-04-26T21:18:28.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.534+0000 7f256ac00640 1 -- 172.21.15.106:0/284298520 wait complete. 2024-04-26T21:18:28.553 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T21:18:28.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc10f000640 1 Processor -- start 2024-04-26T21:18:28.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc10f000640 1 -- start start 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc10f000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10806eb70 0x7fc10815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc10f000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1080b3d10 con 0x7fc10813f140 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc10f000640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1080b3ff0 con 0x7fc10813ed60 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc10f000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc1080b3ac0 con 0x7fc10806eb70 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc0ff400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc10813f140 0x7fc1080d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39184/0 (socket says 172.21.15.106:39184) 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc0ff400640 1 -- 172.21.15.106:0/2567343110 learned_addr learned my addr 172.21.15.106:0/2567343110 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc10d000640 1 --2- 172.21.15.106:0/2567343110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10806eb70 0x7fc10815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc107400640 1 -- 172.21.15.106:0/2567343110 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101753205 0 0) 0x7fc1080b3d10 con 0x7fc10813f140 2024-04-26T21:18:28.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.686+0000 7fc107400640 1 -- 172.21.15.106:0/2567343110 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ec003530 con 0x7fc10813f140 2024-04-26T21:18:28.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc107400640 1 -- 172.21.15.106:0/2567343110 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3763583638 0 0) 0x7fc1080b3ff0 con 0x7fc10813ed60 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc107400640 1 -- 172.21.15.106:0/2567343110 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1080b3d10 con 0x7fc10813ed60 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc10d000640 1 -- 172.21.15.106:0/2567343110 >> v1:172.21.15.112:6789/0 conn(0x7fc10813ed60 legacy=0x7fc1080b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc10d000640 1 -- 172.21.15.106:0/2567343110 >> v1:172.21.15.106:6789/0 conn(0x7fc10813f140 legacy=0x7fc1080d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc10d000640 1 -- 172.21.15.106:0/2567343110 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1080b42d0 con 0x7fc10806eb70 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc10d000640 1 --2- 172.21.15.106:0/2567343110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10806eb70 0x7fc10815c3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc100009dc0 tx=0x7fc10001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc4195d3faa39993 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc107400640 1 -- 172.21.15.106:0/2567343110 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000b2070 con 0x7fc10806eb70 2024-04-26T21:18:28.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc107400640 1 -- 172.21.15.106:0/2567343110 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1000a5840 con 0x7fc10806eb70 2024-04-26T21:18:28.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc107400640 1 -- 172.21.15.106:0/2567343110 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000a5c10 con 0x7fc10806eb70 2024-04-26T21:18:28.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc10f000640 1 -- 172.21.15.106:0/2567343110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10806eb70 msgr2=0x7fc10815c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc10f000640 1 --2- 172.21.15.106:0/2567343110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10806eb70 0x7fc10815c3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc100009dc0 tx=0x7fc10001c870 comp rx=0 tx=0).stop 2024-04-26T21:18:28.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc10f000640 1 -- 172.21.15.106:0/2567343110 shutdown_connections 2024-04-26T21:18:28.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc10f000640 1 --2- 172.21.15.106:0/2567343110 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10806eb70 0x7fc10815c3e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.690+0000 7fc10f000640 1 -- 172.21.15.106:0/2567343110 >> 172.21.15.106:0/2567343110 conn(0x7fc108068340 msgr2=0x7fc108068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 -- 172.21.15.106:0/2567343110 shutdown_connections 2024-04-26T21:18:28.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 -- 172.21.15.106:0/2567343110 wait complete. 2024-04-26T21:18:28.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 Processor -- start 2024-04-26T21:18:28.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 -- start start 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10813ed60 0x7fc10813d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10815b820 0x7fc108165350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc108165890 0x7fc10815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc108160400 con 0x7fc108165890 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc1080d1710 con 0x7fc10813ed60 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10f000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc108160580 con 0x7fc10815b820 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc108165890 0x7fc10815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc108165890 0x7fc10815d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33924/0 (socket says 172.21.15.106:33924) 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10d000640 1 -- 172.21.15.106:0/3447924946 learned_addr learned my addr 172.21.15.106:0/3447924946 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc0ff400640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10815b820 0x7fc108165350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc107e00640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10813ed60 0x7fc10813d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10d000640 1 -- 172.21.15.106:0/3447924946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10815b820 msgr2=0x7fc108165350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10d000640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10815b820 0x7fc108165350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10d000640 1 -- 172.21.15.106:0/3447924946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10813ed60 msgr2=0x7fc10813d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10d000640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10813ed60 0x7fc10813d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10d000640 1 -- 172.21.15.106:0/3447924946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc108165d80 con 0x7fc108165890 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc107e00640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10813ed60 0x7fc10813d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.694+0000 7fc10d000640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc108165890 0x7fc10815d2d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc10001a4a0 tx=0x7fc100019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc104c00640 1 -- 172.21.15.106:0/3447924946 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000b2050 con 0x7fc108165890 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc104c00640 1 -- 172.21.15.106:0/3447924946 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1000be070 con 0x7fc108165890 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc108166060 con 0x7fc108165890 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc104c00640 1 -- 172.21.15.106:0/3447924946 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100009450 con 0x7fc108165890 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc108166620 con 0x7fc108165890 2024-04-26T21:18:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc108069400 con 0x7fc108165890 2024-04-26T21:18:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc104c00640 1 -- 172.21.15.106:0/3447924946 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc1000adc40 con 0x7fc108165890 2024-04-26T21:18:28.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc104c00640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc0e4068380 0x7fc0e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc104c00640 1 -- 172.21.15.106:0/3447924946 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7fc1001218c0 con 0x7fc108165890 2024-04-26T21:18:28.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.698+0000 7fc107e00640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc0e4068380 0x7fc0e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.702+0000 7fc107e00640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc0e4068380 0x7fc0e406a840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc10815dfb0 tx=0x7fc0f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.702+0000 7fc104c00640 1 -- 172.21.15.106:0/3447924946 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc100016580 con 0x7fc108165890 2024-04-26T21:18:28.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.858+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc108166990 con 0x7fc0e4068380 2024-04-26T21:18:28.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.858+0000 7fc104c00640 1 -- 172.21.15.106:0/3447924946 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc108166990 con 0x7fc0e4068380 2024-04-26T21:18:28.863 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc0e4068380 msgr2=0x7fc0e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc0e4068380 0x7fc0e406a840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc10815dfb0 tx=0x7fc0f8009040 comp rx=0 tx=0).stop 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc108165890 msgr2=0x7fc10815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc108165890 0x7fc10815d2d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc10001a4a0 tx=0x7fc100019610 comp rx=0 tx=0).stop 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 shutdown_connections 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fc0e4068380 0x7fc0e406a840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc108165890 0x7fc10815d2d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc10815b820 0x7fc108165350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 --2- 172.21.15.106:0/3447924946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc10813ed60 0x7fc10813d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 >> 172.21.15.106:0/3447924946 conn(0x7fc108068340 msgr2=0x7fc1080b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 shutdown_connections 2024-04-26T21:18:28.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:28.862+0000 7fc10f000640 1 -- 172.21.15.106:0/3447924946 wait complete. 2024-04-26T21:18:28.883 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T21:18:28.883 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T21:18:29.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.018+0000 7f33d8a00640 1 Processor -- start 2024-04-26T21:18:29.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.018+0000 7f33d8a00640 1 -- start start 2024-04-26T21:18:29.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d8a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d4163130 0x7f33d4163510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d8a00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33d40b3e00 0x7f33d40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d8a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d40b53c0 con 0x7f33d40b38b0 2024-04-26T21:18:29.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d8a00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f33d40d1690 con 0x7f33d40b3e00 2024-04-26T21:18:29.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d8a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f33d40b5170 con 0x7f33d4163130 2024-04-26T21:18:29.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d3200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f33d40b38b0 0x7f33d40cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39186/0 (socket says 172.21.15.106:39186) 2024-04-26T21:18:29.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d3200640 1 -- 172.21.15.106:0/2735071586 learned_addr learned my addr 172.21.15.106:0/2735071586 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d2800640 1 --2- 172.21.15.106:0/2735071586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d4163130 0x7f33d4163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33c9e00640 1 --2- 172.21.15.106:0/2735071586 >> v2:172.21.15.112:3300/0 conn(0x7f33d40b3e00 0x7f33d40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d1e00640 1 -- 172.21.15.106:0/2735071586 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840733528 0 0) 0x7f33d40b53c0 con 0x7f33d40b38b0 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d1e00640 1 -- 172.21.15.106:0/2735071586 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b8003530 con 0x7f33d40b38b0 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33d1e00640 1 -- 172.21.15.106:0/2735071586 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 510508738 0 0) 0x7f33b8003530 con 0x7f33d40b38b0 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33c9e00640 1 -- 172.21.15.106:0/2735071586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d4163130 msgr2=0x7f33d4163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33c9e00640 1 --2- 172.21.15.106:0/2735071586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d4163130 0x7f33d4163510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33c9e00640 1 -- 172.21.15.106:0/2735071586 >> v1:172.21.15.106:6789/0 conn(0x7f33d40b38b0 legacy=0x7f33d40cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.022+0000 7f33c9e00640 1 -- 172.21.15.106:0/2735071586 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d4163ca0 con 0x7f33d40b3e00 2024-04-26T21:18:29.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33c9e00640 1 --2- 172.21.15.106:0/2735071586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d40b3e00 0x7f33d40cf4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0097c0 tx=0x7f33bc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16b90d80c3674340 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d1e00640 1 -- 172.21.15.106:0/2735071586 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0b0070 con 0x7f33d40b3e00 2024-04-26T21:18:29.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d1e00640 1 -- 172.21.15.106:0/2735071586 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc0ab400 con 0x7f33d40b3e00 2024-04-26T21:18:29.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d1e00640 1 -- 172.21.15.106:0/2735071586 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc001a00 con 0x7f33d40b3e00 2024-04-26T21:18:29.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 -- 172.21.15.106:0/2735071586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d40b3e00 msgr2=0x7f33d40cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 --2- 172.21.15.106:0/2735071586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d40b3e00 0x7f33d40cf4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0097c0 tx=0x7f33bc01c3c0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 -- 172.21.15.106:0/2735071586 shutdown_connections 2024-04-26T21:18:29.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 --2- 172.21.15.106:0/2735071586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d40b3e00 0x7f33d40cf4a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 --2- 172.21.15.106:0/2735071586 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d4163130 0x7f33d4163510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 -- 172.21.15.106:0/2735071586 >> 172.21.15.106:0/2735071586 conn(0x7f33d40b4680 msgr2=0x7f33d40b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:29.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 -- 172.21.15.106:0/2735071586 shutdown_connections 2024-04-26T21:18:29.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 -- 172.21.15.106:0/2735071586 wait complete. 2024-04-26T21:18:29.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 Processor -- start 2024-04-26T21:18:29.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.026+0000 7f33d8a00640 1 -- start start 2024-04-26T21:18:29.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d8a00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d40b38b0 0x7f33d40b8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d8a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33d40b3e00 0x7f33d4156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d8a00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d4163130 0x7f33d415e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d8a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f33d406e670 con 0x7f33d40b3e00 2024-04-26T21:18:29.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d8a00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33d406e4f0 con 0x7f33d4163130 2024-04-26T21:18:29.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d8a00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f33d406e7f0 con 0x7f33d40b38b0 2024-04-26T21:18:29.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33c9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33d40b3e00 0x7f33d4156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33c9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33d40b3e00 0x7f33d4156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33926/0 (socket says 172.21.15.106:33926) 2024-04-26T21:18:29.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33c9e00640 1 -- 172.21.15.106:0/1357060844 learned_addr learned my addr 172.21.15.106:0/1357060844 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:29.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d2800640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d40b38b0 0x7f33d40b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d3200640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d4163130 0x7f33d415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33c9e00640 1 -- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d40b38b0 msgr2=0x7f33d40b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33c9e00640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d40b38b0 0x7f33d40b8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33c9e00640 1 -- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d4163130 msgr2=0x7f33d415e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33c9e00640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d4163130 0x7f33d415e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33c9e00640 1 -- 172.21.15.106:0/1357060844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d40c6800 con 0x7f33d40b3e00 2024-04-26T21:18:29.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33c9e00640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33d40b3e00 0x7f33d4156480 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f33bc01aa70 tx=0x7f33bc019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33cb400640 1 -- 172.21.15.106:0/1357060844 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0ba070 con 0x7f33d40b3e00 2024-04-26T21:18:29.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33cb400640 1 -- 172.21.15.106:0/1357060844 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc003820 con 0x7f33d40b3e00 2024-04-26T21:18:29.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33cb400640 1 -- 172.21.15.106:0/1357060844 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0b0040 con 0x7f33d40b3e00 2024-04-26T21:18:29.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d40c6ae0 con 0x7f33d40b3e00 2024-04-26T21:18:29.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d4157da0 con 0x7f33d40b3e00 2024-04-26T21:18:29.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.030+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33d4069400 con 0x7f33d40b3e00 2024-04-26T21:18:29.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33cb400640 1 -- 172.21.15.106:0/1357060844 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33bc0bd070 con 0x7f33d40b3e00 2024-04-26T21:18:29.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33cb400640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33b0068380 0x7f33b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33cb400640 1 -- 172.21.15.106:0/1357060844 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f33bc11f8a0 con 0x7f33d40b3e00 2024-04-26T21:18:29.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33d2800640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33b0068380 0x7f33b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33cb400640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f33b006e8c0 0x7f33b0070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33cb400640 1 -- 172.21.15.106:0/1357060844 --> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33bc00af30 con 0x7f33b006e8c0 2024-04-26T21:18:29.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33cb400640 1 -- 172.21.15.106:0/1357060844 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f33bc1242a0 con 0x7f33d40b3e00 2024-04-26T21:18:29.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33d3200640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f33b006e8c0 0x7f33b0070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33d2800640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33b0068380 0x7f33b006a840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f33d40d1e50 tx=0x7f33c4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33d3200640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f33b006e8c0 0x7f33b0070d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.034+0000 7f33cb400640 1 -- 172.21.15.106:0/1357060844 <== osd.4 v2:172.21.15.112:6808/4133025482 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f33bc00af30 con 0x7f33b006e8c0 2024-04-26T21:18:29.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.046+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 --> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f33d40b8af0 con 0x7f33b006e8c0 2024-04-26T21:18:29.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33cb400640 1 -- 172.21.15.106:0/1357060844 <== osd.4 v2:172.21.15.112:6808/4133025482 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f33d40b8af0 con 0x7f33b006e8c0 2024-04-26T21:18:29.052 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:18:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T21:18:29.052 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:18:29.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f33b006e8c0 msgr2=0x7f33b0070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.112:6808/4133025482,v1:172.21.15.112:6809/4133025482] conn(0x7f33b006e8c0 0x7f33b0070d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33b0068380 msgr2=0x7f33b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f33b0068380 0x7f33b006a840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f33d40d1e50 tx=0x7f33c4009190 comp rx=0 tx=0).stop 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33d40b3e00 msgr2=0x7f33d4156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 --2- 172.21.15.106:0/1357060844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33d40b3e00 0x7f33d4156480 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f33bc01aa70 tx=0x7f33bc019160 comp rx=0 tx=0).stop 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d3200640 1 -- 172.21.15.106:0/1357060844 reap_dead start 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 shutdown_connections 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 >> 172.21.15.106:0/1357060844 conn(0x7f33d40b4680 msgr2=0x7f33d40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 shutdown_connections 2024-04-26T21:18:29.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.050+0000 7f33d8a00640 1 -- 172.21.15.106:0/1357060844 wait complete. 2024-04-26T21:18:29.070 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T21:18:29.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f09200640 1 Processor -- start 2024-04-26T21:18:29.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f09200640 1 -- start start 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f09200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6f0406fff0 0x7f6f04071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f09200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f04072490 0x7f6f0415f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f09200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f040d0550 con 0x7f6f04152710 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f09200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f6f040d0830 con 0x7f6f0406fff0 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f09200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6f040b3ac0 con 0x7f6f04072490 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f01e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6f04152710 0x7f6f0406f5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39192/0 (socket says 172.21.15.106:39192) 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f01e00640 1 -- 172.21.15.106:0/32758941 learned_addr learned my addr 172.21.15.106:0/32758941 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6ef9400640 1 --2- 172.21.15.106:0/32758941 >> v2:172.21.15.106:3300/0 conn(0x7f6f0406fff0 0x7f6f04071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f02800640 1 --2- 172.21.15.106:0/32758941 >> v2:172.21.15.112:3300/0 conn(0x7f6f04072490 0x7f6f0415f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f01400640 1 -- 172.21.15.106:0/32758941 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026843277 0 0) 0x7f6f040d0550 con 0x7f6f04152710 2024-04-26T21:18:29.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f01400640 1 -- 172.21.15.106:0/32758941 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ee8003450 con 0x7f6f04152710 2024-04-26T21:18:29.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6ef9400640 1 -- 172.21.15.106:0/32758941 >> v2:172.21.15.112:3300/0 conn(0x7f6f04072490 msgr2=0x7f6f0415f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:29.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6ef9400640 1 --2- 172.21.15.106:0/32758941 >> v2:172.21.15.112:3300/0 conn(0x7f6f04072490 0x7f6f0415f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6ef9400640 1 -- 172.21.15.106:0/32758941 >> v1:172.21.15.106:6789/0 conn(0x7f6f04152710 legacy=0x7f6f0406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6ef9400640 1 -- 172.21.15.106:0/32758941 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f040b3da0 con 0x7f6f0406fff0 2024-04-26T21:18:29.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.202+0000 7f6f02800640 1 --2- 172.21.15.106:0/32758941 >> v2:172.21.15.112:3300/0 conn(0x7f6f04072490 0x7f6f0415f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:29.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6ef9400640 1 --2- 172.21.15.106:0/32758941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f0406fff0 0x7f6f04071f50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6f040743d0 tx=0x7f6eec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab14270cc3d16bc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f01400640 1 -- 172.21.15.106:0/32758941 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0b0070 con 0x7f6f0406fff0 2024-04-26T21:18:29.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f01400640 1 -- 172.21.15.106:0/32758941 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec0ab600 con 0x7f6f0406fff0 2024-04-26T21:18:29.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f01400640 1 -- 172.21.15.106:0/32758941 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0ab9d0 con 0x7f6f0406fff0 2024-04-26T21:18:29.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f09200640 1 -- 172.21.15.106:0/32758941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f0406fff0 msgr2=0x7f6f04071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f09200640 1 --2- 172.21.15.106:0/32758941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f0406fff0 0x7f6f04071f50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6f040743d0 tx=0x7f6eec01c480 comp rx=0 tx=0).stop 2024-04-26T21:18:29.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f09200640 1 -- 172.21.15.106:0/32758941 shutdown_connections 2024-04-26T21:18:29.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f09200640 1 --2- 172.21.15.106:0/32758941 >> v2:172.21.15.112:3300/0 conn(0x7f6f04072490 0x7f6f0415f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f09200640 1 --2- 172.21.15.106:0/32758941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f0406fff0 0x7f6f04071f50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f09200640 1 -- 172.21.15.106:0/32758941 >> 172.21.15.106:0/32758941 conn(0x7f6f04068340 msgr2=0x7f6f04068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:29.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f09200640 1 -- 172.21.15.106:0/32758941 shutdown_connections 2024-04-26T21:18:29.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.206+0000 7f6f09200640 1 -- 172.21.15.106:0/32758941 wait complete. 2024-04-26T21:18:29.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 Processor -- start 2024-04-26T21:18:29.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 -- start start 2024-04-26T21:18:29.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f0406fff0 0x7f6f041fbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f04072490 0x7f6f04154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f04152710 0x7f6f040afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6f040b4930 con 0x7f6f04072490 2024-04-26T21:18:29.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6f040b47b0 con 0x7f6f04152710 2024-04-26T21:18:29.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6f040b4ab0 con 0x7f6f0406fff0 2024-04-26T21:18:29.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6ef9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f04072490 0x7f6f04154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6ef9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f04072490 0x7f6f04154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33940/0 (socket says 172.21.15.106:33940) 2024-04-26T21:18:29.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6ef9400640 1 -- 172.21.15.106:0/2939100208 learned_addr learned my addr 172.21.15.106:0/2939100208 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:29.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f01e00640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f0406fff0 0x7f6f041fbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f02800640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f04152710 0x7f6f040afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6ef9400640 1 -- 172.21.15.106:0/2939100208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f0406fff0 msgr2=0x7f6f041fbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6ef9400640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f0406fff0 0x7f6f041fbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6ef9400640 1 -- 172.21.15.106:0/2939100208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f04152710 msgr2=0x7f6f040afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6ef9400640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f04152710 0x7f6f040afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6ef9400640 1 -- 172.21.15.106:0/2939100208 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f04152cf0 con 0x7f6f04072490 2024-04-26T21:18:29.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6ef9400640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f04072490 0x7f6f04154430 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ae040 tx=0x7f6eec019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6efaa00640 1 -- 172.21.15.106:0/2939100208 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0b8020 con 0x7f6f04072490 2024-04-26T21:18:29.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6efaa00640 1 -- 172.21.15.106:0/2939100208 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec0b4630 con 0x7f6f04072490 2024-04-26T21:18:29.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6efaa00640 1 -- 172.21.15.106:0/2939100208 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0b0040 con 0x7f6f04072490 2024-04-26T21:18:29.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f04152fd0 con 0x7f6f04072490 2024-04-26T21:18:29.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.210+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f04154970 con 0x7f6f04072490 2024-04-26T21:18:29.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.214+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f04069400 con 0x7f6f04072490 2024-04-26T21:18:29.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.214+0000 7f6efaa00640 1 -- 172.21.15.106:0/2939100208 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6eec0bb020 con 0x7f6f04072490 2024-04-26T21:18:29.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.214+0000 7f6efaa00640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6ee0068380 0x7f6ee006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.214+0000 7f6efaa00640 1 -- 172.21.15.106:0/2939100208 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f6eec120550 con 0x7f6f04072490 2024-04-26T21:18:29.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.214+0000 7f6f01e00640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6ee0068380 0x7f6ee006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.214+0000 7f6f01e00640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6ee0068380 0x7f6ee006a840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4007fd0 tx=0x7f6ef4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.218+0000 7f6efaa00640 1 -- 172.21.15.106:0/2939100208 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6eec0c2030 con 0x7f6f04072490 2024-04-26T21:18:29.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f6f04073720 con 0x7f6ee0068380 2024-04-26T21:18:29.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6efaa00640 1 -- 172.21.15.106:0/2939100208 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6f04073720 con 0x7f6ee0068380 2024-04-26T21:18:29.381 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6ee0068380 msgr2=0x7f6ee006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6ee0068380 0x7f6ee006a840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4007fd0 tx=0x7f6ef4009040 comp rx=0 tx=0).stop 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f04072490 msgr2=0x7f6f04154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f04072490 0x7f6f04154430 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ae040 tx=0x7f6eec019220 comp rx=0 tx=0).stop 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 shutdown_connections 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f04152710 0x7f6f040afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6ee0068380 0x7f6ee006a840 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f04072490 0x7f6f04154430 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 --2- 172.21.15.106:0/2939100208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6f0406fff0 0x7f6f041fbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 >> 172.21.15.106:0/2939100208 conn(0x7f6f04068340 msgr2=0x7f6f0415e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:29.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 shutdown_connections 2024-04-26T21:18:29.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.378+0000 7f6f09200640 1 -- 172.21.15.106:0/2939100208 wait complete. 2024-04-26T21:18:29.403 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T21:18:29.403 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T21:18:29.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.538+0000 7f2f55200640 1 Processor -- start 2024-04-26T21:18:29.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.538+0000 7f2f55200640 1 -- start start 2024-04-26T21:18:29.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f55200640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f5015b570 0x7f2f500b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f55200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f500cd7f0 0x7f2f5015f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f55200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f50070180 con 0x7f2f5015f6f0 2024-04-26T21:18:29.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f55200640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5015fb60 con 0x7f2f5015b570 2024-04-26T21:18:29.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f55200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2f50072920 con 0x7f2f500cd7f0 2024-04-26T21:18:29.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4e800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2f5015f6f0 0x7f2f500b4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39194/0 (socket says 172.21.15.106:39194) 2024-04-26T21:18:29.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4e800640 1 -- 172.21.15.106:0/1371200899 learned_addr learned my addr 172.21.15.106:0/1371200899 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:29.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4de00640 1 --2- 172.21.15.106:0/1371200899 >> v2:172.21.15.112:3300/0 conn(0x7f2f5015b570 0x7f2f500b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4d400640 1 --2- 172.21.15.106:0/1371200899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f500cd7f0 0x7f2f5015f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4ca00640 1 -- 172.21.15.106:0/1371200899 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886406406 0 0) 0x7f2f48001120 con 0x7f2f5015f6f0 2024-04-26T21:18:29.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4ca00640 1 -- 172.21.15.106:0/1371200899 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f34003530 con 0x7f2f5015f6f0 2024-04-26T21:18:29.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4de00640 1 -- 172.21.15.106:0/1371200899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f500cd7f0 msgr2=0x7f2f5015f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:29.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4de00640 1 --2- 172.21.15.106:0/1371200899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f500cd7f0 0x7f2f5015f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4de00640 1 -- 172.21.15.106:0/1371200899 >> v1:172.21.15.106:6789/0 conn(0x7f2f5015f6f0 legacy=0x7f2f500b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.542+0000 7f2f4de00640 1 -- 172.21.15.106:0/1371200899 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f50072b70 con 0x7f2f5015b570 2024-04-26T21:18:29.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f4de00640 1 --2- 172.21.15.106:0/1371200899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f5015b570 0x7f2f500b5770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009d90 tx=0x7f2f4001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a19086cba8c3cc3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f4ca00640 1 -- 172.21.15.106:0/1371200899 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f400b2070 con 0x7f2f5015b570 2024-04-26T21:18:29.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f4ca00640 1 -- 172.21.15.106:0/1371200899 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f400a5730 con 0x7f2f5015b570 2024-04-26T21:18:29.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f4ca00640 1 -- 172.21.15.106:0/1371200899 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f400a5ae0 con 0x7f2f5015b570 2024-04-26T21:18:29.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 -- 172.21.15.106:0/1371200899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f5015b570 msgr2=0x7f2f500b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 --2- 172.21.15.106:0/1371200899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f5015b570 0x7f2f500b5770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009d90 tx=0x7f2f4001c970 comp rx=0 tx=0).stop 2024-04-26T21:18:29.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 -- 172.21.15.106:0/1371200899 shutdown_connections 2024-04-26T21:18:29.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 --2- 172.21.15.106:0/1371200899 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f500cd7f0 0x7f2f5015f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 --2- 172.21.15.106:0/1371200899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f5015b570 0x7f2f500b5770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 -- 172.21.15.106:0/1371200899 >> 172.21.15.106:0/1371200899 conn(0x7f2f500b27a0 msgr2=0x7f2f500b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:29.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 -- 172.21.15.106:0/1371200899 shutdown_connections 2024-04-26T21:18:29.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 -- 172.21.15.106:0/1371200899 wait complete. 2024-04-26T21:18:29.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 Processor -- start 2024-04-26T21:18:29.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.546+0000 7f2f55200640 1 -- start start 2024-04-26T21:18:29.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f55200640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f500cd7f0 0x7f2f5014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f55200640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f5015b570 0x7f2f500cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f55200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f5015f6f0 0x7f2f500d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f55200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5015b950 con 0x7f2f5015f6f0 2024-04-26T21:18:29.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f55200640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2f500b5cb0 con 0x7f2f500cd7f0 2024-04-26T21:18:29.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f55200640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5015fea0 con 0x7f2f5015b570 2024-04-26T21:18:29.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f5015f6f0 0x7f2f500d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f5015f6f0 0x7f2f500d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33944/0 (socket says 172.21.15.106:33944) 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4e800640 1 -- 172.21.15.106:0/1227938822 learned_addr learned my addr 172.21.15.106:0/1227938822 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4e800640 1 -- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f5015b570 msgr2=0x7f2f500cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4e800640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2f5015b570 0x7f2f500cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4e800640 1 -- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f500cd7f0 msgr2=0x7f2f5014d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4de00640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f500cd7f0 0x7f2f5014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4e800640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f500cd7f0 0x7f2f5014d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4e800640 1 -- 172.21.15.106:0/1227938822 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5014dc00 con 0x7f2f5015f6f0 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4de00640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f500cd7f0 0x7f2f5014d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f4e800640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f5015f6f0 0x7f2f500d01a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800c730 tx=0x7f2f4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f46000640 1 -- 172.21.15.106:0/1227938822 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48017070 con 0x7f2f5015f6f0 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f46000640 1 -- 172.21.15.106:0/1227938822 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f480058c0 con 0x7f2f5015f6f0 2024-04-26T21:18:29.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f46000640 1 -- 172.21.15.106:0/1227938822 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48005cf0 con 0x7f2f5015f6f0 2024-04-26T21:18:29.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5015dbc0 con 0x7f2f5015f6f0 2024-04-26T21:18:29.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5015e180 con 0x7f2f5015f6f0 2024-04-26T21:18:29.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f50069400 con 0x7f2f5015f6f0 2024-04-26T21:18:29.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.550+0000 7f2f46000640 1 -- 172.21.15.106:0/1227938822 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2f4801a070 con 0x7f2f5015f6f0 2024-04-26T21:18:29.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f46000640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2f30068380 0x7f2f3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f46000640 1 -- 172.21.15.106:0/1227938822 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f2f48085ca0 con 0x7f2f5015f6f0 2024-04-26T21:18:29.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f4de00640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2f30068380 0x7f2f3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f46000640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f2f3006e8c0 0x7f2f30070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f46000640 1 -- 172.21.15.106:0/1227938822 --> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f300713d0 con 0x7f2f3006e8c0 2024-04-26T21:18:29.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f46000640 1 -- 172.21.15.106:0/1227938822 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f2f4808a2a0 con 0x7f2f5015f6f0 2024-04-26T21:18:29.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f4d400640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f2f3006e8c0 0x7f2f30070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f4de00640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2f30068380 0x7f2f3006a840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2f400af000 tx=0x7f2f400a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f4d400640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f2f3006e8c0 0x7f2f30070d00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.554+0000 7f2f46000640 1 -- 172.21.15.106:0/1227938822 <== osd.5 v2:172.21.15.112:6800/2195698135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f300713d0 con 0x7f2f3006e8c0 2024-04-26T21:18:29.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.566+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 --> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2f500ccd40 con 0x7f2f3006e8c0 2024-04-26T21:18:29.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f46000640 1 -- 172.21.15.106:0/1227938822 <== osd.5 v2:172.21.15.112:6800/2195698135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2f500ccd40 con 0x7f2f3006e8c0 2024-04-26T21:18:29.572 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:18:29.572 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T21:18:29.572 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:18:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f2f3006e8c0 msgr2=0x7f2f30070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.112:6800/2195698135,v1:172.21.15.112:6801/2195698135] conn(0x7f2f3006e8c0 0x7f2f30070d00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2f30068380 msgr2=0x7f2f3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f2f30068380 0x7f2f3006a840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2f400af000 tx=0x7f2f400a7070 comp rx=0 tx=0).stop 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f5015f6f0 msgr2=0x7f2f500d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 --2- 172.21.15.106:0/1227938822 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f5015f6f0 0x7f2f500d01a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800c730 tx=0x7f2f4800cbf0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f4e800640 1 -- 172.21.15.106:0/1227938822 reap_dead start 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 shutdown_connections 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 >> 172.21.15.106:0/1227938822 conn(0x7f2f500b27a0 msgr2=0x7f2f50151520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 shutdown_connections 2024-04-26T21:18:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.570+0000 7f2f55200640 1 -- 172.21.15.106:0/1227938822 wait complete. 2024-04-26T21:18:29.589 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T21:18:29.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.722+0000 7f3948e00640 1 Processor -- start 2024-04-26T21:18:29.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.722+0000 7f3948e00640 1 -- start start 2024-04-26T21:18:29.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.722+0000 7f3948e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413f140 0x7f394415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.722+0000 7f3948e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39440b3d10 con 0x7f394406eb70 2024-04-26T21:18:29.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.722+0000 7f3948e00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39440b3ff0 con 0x7f394413ed60 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.722+0000 7f3948e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f39440b3ac0 con 0x7f394413f140 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.722+0000 7f3942800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f394406eb70 0x7f39440d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39198/0 (socket says 172.21.15.106:39198) 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.722+0000 7f3942800640 1 -- 172.21.15.106:0/412943163 learned_addr learned my addr 172.21.15.106:0/412943163 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.722+0000 7f3939400640 1 --2- 172.21.15.106:0/412943163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413f140 0x7f394415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3941400640 1 -- 172.21.15.106:0/412943163 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872029708 0 0) 0x7f39440b3d10 con 0x7f394406eb70 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3941400640 1 -- 172.21.15.106:0/412943163 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3928003530 con 0x7f394406eb70 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3941400640 1 -- 172.21.15.106:0/412943163 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317553601 0 0) 0x7f39440b3ff0 con 0x7f394413ed60 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3939400640 1 -- 172.21.15.106:0/412943163 >> v1:172.21.15.112:6789/0 conn(0x7f394413ed60 legacy=0x7f39440b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3939400640 1 -- 172.21.15.106:0/412943163 >> v1:172.21.15.106:6789/0 conn(0x7f394406eb70 legacy=0x7f39440d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3939400640 1 -- 172.21.15.106:0/412943163 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39440b42d0 con 0x7f394413f140 2024-04-26T21:18:29.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3939400640 1 --2- 172.21.15.106:0/412943163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413f140 0x7f394415c3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f392c0097f0 tx=0x7f392c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ef37273662f54c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3941400640 1 -- 172.21.15.106:0/412943163 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c0b0070 con 0x7f394413f140 2024-04-26T21:18:29.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3941400640 1 -- 172.21.15.106:0/412943163 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c0ab600 con 0x7f394413f140 2024-04-26T21:18:29.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.726+0000 7f3941400640 1 -- 172.21.15.106:0/412943163 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c0ab9b0 con 0x7f394413f140 2024-04-26T21:18:29.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 -- 172.21.15.106:0/412943163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413f140 msgr2=0x7f394415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 --2- 172.21.15.106:0/412943163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413f140 0x7f394415c3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f392c0097f0 tx=0x7f392c01c3c0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 -- 172.21.15.106:0/412943163 shutdown_connections 2024-04-26T21:18:29.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 --2- 172.21.15.106:0/412943163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413f140 0x7f394415c3e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 -- 172.21.15.106:0/412943163 >> 172.21.15.106:0/412943163 conn(0x7f3944068340 msgr2=0x7f3944068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:29.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 -- 172.21.15.106:0/412943163 shutdown_connections 2024-04-26T21:18:29.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 -- 172.21.15.106:0/412943163 wait complete. 2024-04-26T21:18:29.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 Processor -- start 2024-04-26T21:18:29.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 -- start start 2024-04-26T21:18:29.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f394413ed60 0x7f39441427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413c8f0 0x7f394413d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f394413d640 0x7f3944154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3944160420 con 0x7f394413ed60 2024-04-26T21:18:29.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f39441605a0 con 0x7f394413d640 2024-04-26T21:18:29.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3948e00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3944160720 con 0x7f394413c8f0 2024-04-26T21:18:29.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3941e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f394413ed60 0x7f39441427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3941e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f394413ed60 0x7f39441427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33948/0 (socket says 172.21.15.106:33948) 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3941e00640 1 -- 172.21.15.106:0/2037585128 learned_addr learned my addr 172.21.15.106:0/2037585128 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3939400640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413c8f0 0x7f394413d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3942800640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f394413d640 0x7f3944154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3941e00640 1 -- 172.21.15.106:0/2037585128 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413c8f0 msgr2=0x7f394413d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3941e00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413c8f0 0x7f394413d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3941e00640 1 -- 172.21.15.106:0/2037585128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f394413d640 msgr2=0x7f3944154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3941e00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f394413d640 0x7f3944154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.730+0000 7f3941e00640 1 -- 172.21.15.106:0/2037585128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394413f530 con 0x7f394413ed60 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f3941e00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f394413ed60 0x7f39441427b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f393400c480 tx=0x7f393400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f393aa00640 1 -- 172.21.15.106:0/2037585128 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934005480 con 0x7f394413ed60 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f393aa00640 1 -- 172.21.15.106:0/2037585128 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934003600 con 0x7f394413ed60 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f393aa00640 1 -- 172.21.15.106:0/2037585128 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340039f0 con 0x7f394413ed60 2024-04-26T21:18:29.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f394413f810 con 0x7f394413ed60 2024-04-26T21:18:29.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3944142cf0 con 0x7f394413ed60 2024-04-26T21:18:29.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3944069400 con 0x7f394413ed60 2024-04-26T21:18:29.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f393aa00640 1 -- 172.21.15.106:0/2037585128 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3934003b90 con 0x7f394413ed60 2024-04-26T21:18:29.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f393aa00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3920068380 0x7f392006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:29.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f393aa00640 1 -- 172.21.15.106:0/2037585128 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f39340864a0 con 0x7f394413ed60 2024-04-26T21:18:29.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f3939400640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3920068380 0x7f392006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:29.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.734+0000 7f3939400640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3920068380 0x7f392006a840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f392c0ad000 tx=0x7f392c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:29.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.738+0000 7f393aa00640 1 -- 172.21.15.106:0/2037585128 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3934056c10 con 0x7f394413ed60 2024-04-26T21:18:29.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.894+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f394413da20 con 0x7f3920068380 2024-04-26T21:18:29.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.894+0000 7f393aa00640 1 -- 172.21.15.106:0/2037585128 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f394413da20 con 0x7f3920068380 2024-04-26T21:18:29.899 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T21:18:29.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3920068380 msgr2=0x7f392006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3920068380 0x7f392006a840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f392c0ad000 tx=0x7f392c0a6000 comp rx=0 tx=0).stop 2024-04-26T21:18:29.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f394413ed60 msgr2=0x7f39441427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f394413ed60 0x7f39441427b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f393400c480 tx=0x7f393400c940 comp rx=0 tx=0).stop 2024-04-26T21:18:29.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 shutdown_connections 2024-04-26T21:18:29.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f394413d640 0x7f3944154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f3920068380 0x7f392006a840 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f394413c8f0 0x7f394413d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 --2- 172.21.15.106:0/2037585128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f394413ed60 0x7f39441427b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 >> 172.21.15.106:0/2037585128 conn(0x7f3944068340 msgr2=0x7f394415f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:29.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 shutdown_connections 2024-04-26T21:18:29.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:29.898+0000 7f3948e00640 1 -- 172.21.15.106:0/2037585128 wait complete. 2024-04-26T21:18:29.919 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T21:18:29.920 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T21:18:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef10800640 1 Processor -- start 2024-04-26T21:18:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef10800640 1 -- start start 2024-04-26T21:18:30.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef10800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0815f170 0x7fef080b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef10800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fef0815f550 0x7fef080cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef10800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0806fd70 con 0x7fef080cfb00 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef10800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fef080cdb60 con 0x7fef0815f550 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef10800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fef080cff20 con 0x7fef0815f170 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef0d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fef0815f550 0x7fef080cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef0e800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fef080cfb00 0x7fef0806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39200/0 (socket says 172.21.15.106:39200) 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef0e800640 1 -- 172.21.15.106:0/2993154041 learned_addr learned my addr 172.21.15.106:0/2993154041 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef0de00640 1 --2- 172.21.15.106:0/2993154041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0815f170 0x7fef080b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef0d400640 1 -- 172.21.15.106:0/2993154041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0815f170 msgr2=0x7fef080b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef0d400640 1 --2- 172.21.15.106:0/2993154041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0815f170 0x7fef080b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef0d400640 1 -- 172.21.15.106:0/2993154041 >> v1:172.21.15.106:6789/0 conn(0x7fef080cfb00 legacy=0x7fef0806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef0d400640 1 -- 172.21.15.106:0/2993154041 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef080b3a00 con 0x7fef0815f550 2024-04-26T21:18:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.058+0000 7fef0ca00640 1 -- 172.21.15.106:0/2993154041 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411730998 0 0) 0x7fef0806fd70 con 0x7fef080cfb00 2024-04-26T21:18:30.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef0d400640 1 --2- 172.21.15.106:0/2993154041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef0815f550 0x7fef080cf5c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7feef80097c0 tx=0x7feef801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d388f76e3c4c39e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef0ca00640 1 -- 172.21.15.106:0/2993154041 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef80b0070 con 0x7fef0815f550 2024-04-26T21:18:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef0ca00640 1 -- 172.21.15.106:0/2993154041 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef80ab600 con 0x7fef0815f550 2024-04-26T21:18:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef0ca00640 1 -- 172.21.15.106:0/2993154041 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef80ab9d0 con 0x7fef0815f550 2024-04-26T21:18:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef10800640 1 -- 172.21.15.106:0/2993154041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef0815f550 msgr2=0x7fef080cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef10800640 1 --2- 172.21.15.106:0/2993154041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef0815f550 0x7fef080cf5c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7feef80097c0 tx=0x7feef801c4a0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef10800640 1 -- 172.21.15.106:0/2993154041 shutdown_connections 2024-04-26T21:18:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef10800640 1 --2- 172.21.15.106:0/2993154041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef0815f550 0x7fef080cf5c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef10800640 1 --2- 172.21.15.106:0/2993154041 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0815f170 0x7fef080b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef10800640 1 -- 172.21.15.106:0/2993154041 >> 172.21.15.106:0/2993154041 conn(0x7fef0809ba60 msgr2=0x7fef0809be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef10800640 1 -- 172.21.15.106:0/2993154041 shutdown_connections 2024-04-26T21:18:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.062+0000 7fef10800640 1 -- 172.21.15.106:0/2993154041 wait complete. 2024-04-26T21:18:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 Processor -- start 2024-04-26T21:18:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 -- start start 2024-04-26T21:18:30.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef080cfb00 0x7fef080b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0815f170 0x7fef0815b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0815f550 0x7fef0814df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fef080b3740 con 0x7fef080cfb00 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fef080b35c0 con 0x7fef0815f170 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fef080d0400 con 0x7fef0815f550 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef080cfb00 0x7fef080b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef080cfb00 0x7fef080b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33964/0 (socket says 172.21.15.106:33964) 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0de00640 1 -- 172.21.15.106:0/467103790 learned_addr learned my addr 172.21.15.106:0/467103790 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0e800640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0815f550 0x7fef0814df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0d400640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0815f170 0x7fef0815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0de00640 1 -- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0815f550 msgr2=0x7fef0814df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0de00640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fef0815f550 0x7fef0814df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0de00640 1 -- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0815f170 msgr2=0x7fef0815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0de00640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0815f170 0x7fef0815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0de00640 1 -- 172.21.15.106:0/467103790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0815d950 con 0x7fef080cfb00 2024-04-26T21:18:30.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0d400640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0815f170 0x7fef0815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:30.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef0de00640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef080cfb00 0x7fef080b02a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7feefc00e870 tx=0x7feefc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef02000640 1 -- 172.21.15.106:0/467103790 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc017070 con 0x7fef080cfb00 2024-04-26T21:18:30.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef02000640 1 -- 172.21.15.106:0/467103790 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feefc00c8e0 con 0x7fef080cfb00 2024-04-26T21:18:30.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef02000640 1 -- 172.21.15.106:0/467103790 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc00cc90 con 0x7fef080cfb00 2024-04-26T21:18:30.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0815dc30 con 0x7fef080cfb00 2024-04-26T21:18:30.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef0815e1f0 con 0x7fef080cfb00 2024-04-26T21:18:30.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.066+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef08069400 con 0x7fef080cfb00 2024-04-26T21:18:30.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef02000640 1 -- 172.21.15.106:0/467103790 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feefc01a070 con 0x7fef080cfb00 2024-04-26T21:18:30.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef02000640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feeec068380 0x7feeec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef02000640 1 -- 172.21.15.106:0/467103790 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7feefc086ed0 con 0x7fef080cfb00 2024-04-26T21:18:30.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef0d400640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feeec068380 0x7feeec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef02000640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7feeec06e8c0 0x7feeec070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef02000640 1 -- 172.21.15.106:0/467103790 --> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feeec0713d0 con 0x7feeec06e8c0 2024-04-26T21:18:30.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef02000640 1 -- 172.21.15.106:0/467103790 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7feefc087280 con 0x7fef080cfb00 2024-04-26T21:18:30.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef0e800640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7feeec06e8c0 0x7feeec070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef0d400640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feeec068380 0x7feeec06a840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feef80ad000 tx=0x7feef8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.070+0000 7fef0e800640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7feeec06e8c0 0x7feeec070d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.074+0000 7fef02000640 1 -- 172.21.15.106:0/467103790 <== osd.6 v2:172.21.15.112:6810/3830481749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feeec0713d0 con 0x7feeec06e8c0 2024-04-26T21:18:30.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 --> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fef080743c0 con 0x7feeec06e8c0 2024-04-26T21:18:30.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef02000640 1 -- 172.21.15.106:0/467103790 <== osd.6 v2:172.21.15.112:6810/3830481749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fef080743c0 con 0x7feeec06e8c0 2024-04-26T21:18:30.089 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:18:30.089 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T21:18:30.089 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7feeec06e8c0 msgr2=0x7feeec070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.112:6810/3830481749,v1:172.21.15.112:6812/3830481749] conn(0x7feeec06e8c0 0x7feeec070d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feeec068380 msgr2=0x7feeec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7feeec068380 0x7feeec06a840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feef80ad000 tx=0x7feef8008040 comp rx=0 tx=0).stop 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef080cfb00 msgr2=0x7fef080b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 --2- 172.21.15.106:0/467103790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef080cfb00 0x7fef080b02a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7feefc00e870 tx=0x7feefc00ec70 comp rx=0 tx=0).stop 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef0e800640 1 -- 172.21.15.106:0/467103790 reap_dead start 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 shutdown_connections 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 >> 172.21.15.106:0/467103790 conn(0x7fef0809ba60 msgr2=0x7fef080afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 shutdown_connections 2024-04-26T21:18:30.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.086+0000 7fef10800640 1 -- 172.21.15.106:0/467103790 wait complete. 2024-04-26T21:18:30.107 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T21:18:30.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f3781800640 1 Processor -- start 2024-04-26T21:18:30.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f3781800640 1 -- start start 2024-04-26T21:18:30.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f3781800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f377c15f0b0 0x7f377c15f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f3781800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f377c0d0550 con 0x7f377c152710 2024-04-26T21:18:30.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f3781800640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f377c0d0830 con 0x7f377c06fff0 2024-04-26T21:18:30.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f3781800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f377c0b3ac0 con 0x7f377c15f0b0 2024-04-26T21:18:30.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f377b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f377c15f0b0 0x7f377c15f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f377b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f377c15f0b0 0x7f377c15f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33978/0 (socket says 172.21.15.106:33978) 2024-04-26T21:18:30.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f377aa00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f377c152710 0x7f377c06f5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39214/0 (socket says 172.21.15.106:39214) 2024-04-26T21:18:30.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f377b400640 1 -- 172.21.15.106:0/4241810576 learned_addr learned my addr 172.21.15.106:0/4241810576 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:30.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f377b400640 1 -- 172.21.15.106:0/4241810576 >> v1:172.21.15.112:6789/0 conn(0x7f377c06fff0 legacy=0x7f377c071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f377b400640 1 -- 172.21.15.106:0/4241810576 >> v1:172.21.15.106:6789/0 conn(0x7f377c152710 legacy=0x7f377c06f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.242+0000 7f377b400640 1 -- 172.21.15.106:0/4241810576 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c0b3da0 con 0x7f377c15f0b0 2024-04-26T21:18:30.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f377b400640 1 --2- 172.21.15.106:0/4241810576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 0x7f377c15f560 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3774009e50 tx=0x7f377401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846591013e91c0a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3779600640 1 -- 172.21.15.106:0/4241810576 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37740a5680 con 0x7f377c15f0b0 2024-04-26T21:18:30.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3779600640 1 -- 172.21.15.106:0/4241810576 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37740a5820 con 0x7f377c15f0b0 2024-04-26T21:18:30.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3779600640 1 -- 172.21.15.106:0/4241810576 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37740a5bf0 con 0x7f377c15f0b0 2024-04-26T21:18:30.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3781800640 1 -- 172.21.15.106:0/4241810576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 msgr2=0x7f377c15f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3781800640 1 --2- 172.21.15.106:0/4241810576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 0x7f377c15f560 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3774009e50 tx=0x7f377401ca30 comp rx=0 tx=0).stop 2024-04-26T21:18:30.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3781800640 1 -- 172.21.15.106:0/4241810576 shutdown_connections 2024-04-26T21:18:30.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3781800640 1 --2- 172.21.15.106:0/4241810576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 0x7f377c15f560 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3781800640 1 -- 172.21.15.106:0/4241810576 >> 172.21.15.106:0/4241810576 conn(0x7f377c068340 msgr2=0x7f377c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:30.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3781800640 1 -- 172.21.15.106:0/4241810576 shutdown_connections 2024-04-26T21:18:30.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3781800640 1 -- 172.21.15.106:0/4241810576 wait complete. 2024-04-26T21:18:30.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3781800640 1 Processor -- start 2024-04-26T21:18:30.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.246+0000 7f3781800640 1 -- start start 2024-04-26T21:18:30.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3781800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c06fff0 0x7f377c0b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3781800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c152710 0x7f377c155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3781800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 0x7f377c072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3781800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f377c0b4970 con 0x7f377c15f0b0 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3781800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f377c0b47f0 con 0x7f377c06fff0 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3781800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f377c0b4af0 con 0x7f377c152710 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 0x7f377c072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 0x7f377c072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33984/0 (socket says 172.21.15.106:33984) 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377b400640 1 -- 172.21.15.106:0/990708268 learned_addr learned my addr 172.21.15.106:0/990708268 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377a000640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c152710 0x7f377c155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377aa00640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c06fff0 0x7f377c0b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377b400640 1 -- 172.21.15.106:0/990708268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c152710 msgr2=0x7f377c155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377b400640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c152710 0x7f377c155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377b400640 1 -- 172.21.15.106:0/990708268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c06fff0 msgr2=0x7f377c0b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377b400640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c06fff0 0x7f377c0b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377b400640 1 -- 172.21.15.106:0/990708268 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c074180 con 0x7f377c15f0b0 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377aa00640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c06fff0 0x7f377c0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f377b400640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 0x7f377c072b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f37740af040 tx=0x7f37740197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3772a00640 1 -- 172.21.15.106:0/990708268 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37740bc020 con 0x7f377c15f0b0 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3772a00640 1 -- 172.21.15.106:0/990708268 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37740b8670 con 0x7f377c15f0b0 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377c0b0860 con 0x7f377c15f0b0 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3772a00640 1 -- 172.21.15.106:0/990708268 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37740b8a60 con 0x7f377c15f0b0 2024-04-26T21:18:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f377c0b0de0 con 0x7f377c15f0b0 2024-04-26T21:18:30.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.250+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f377c069400 con 0x7f377c15f0b0 2024-04-26T21:18:30.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.254+0000 7f3772a00640 1 -- 172.21.15.106:0/990708268 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f37740bf020 con 0x7f377c15f0b0 2024-04-26T21:18:30.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.254+0000 7f3772a00640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f375c068380 0x7f375c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.254+0000 7f3772a00640 1 -- 172.21.15.106:0/990708268 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f3774121880 con 0x7f377c15f0b0 2024-04-26T21:18:30.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.254+0000 7f377aa00640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f375c068380 0x7f375c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.254+0000 7f377aa00640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f375c068380 0x7f375c06a840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f376c000f70 tx=0x7f376c007d70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.258+0000 7f3772a00640 1 -- 172.21.15.106:0/990708268 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f37740c6030 con 0x7f377c15f0b0 2024-04-26T21:18:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.418+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f377c06e6c0 con 0x7f375c068380 2024-04-26T21:18:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.418+0000 7f3772a00640 1 -- 172.21.15.106:0/990708268 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f377c06e6c0 con 0x7f375c068380 2024-04-26T21:18:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f375c068380 msgr2=0x7f375c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f375c068380 0x7f375c06a840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f376c000f70 tx=0x7f376c007d70 comp rx=0 tx=0).stop 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 msgr2=0x7f377c072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 0x7f377c072b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f37740af040 tx=0x7f37740197d0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 shutdown_connections 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f375c068380 0x7f375c06a840 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f377c15f0b0 0x7f377c072b60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f377c152710 0x7f377c155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 --2- 172.21.15.106:0/990708268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f377c06fff0 0x7f377c0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 >> 172.21.15.106:0/990708268 conn(0x7f377c068340 msgr2=0x7f377c071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 shutdown_connections 2024-04-26T21:18:30.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.422+0000 7f3781800640 1 -- 172.21.15.106:0/990708268 wait complete. 2024-04-26T21:18:30.443 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T21:18:30.443 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T21:18:30.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.578+0000 7fdc5f400640 1 Processor -- start 2024-04-26T21:18:30.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.578+0000 7fdc5f400640 1 -- start start 2024-04-26T21:18:30.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.578+0000 7fdc5f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc58072010 0x7fdc5806f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.578+0000 7fdc5f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdc5806fe20 0x7fdc580b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.578+0000 7fdc5f400640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc58159d80 con 0x7fdc581599a0 2024-04-26T21:18:30.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.578+0000 7fdc5f400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7fdc58070270 con 0x7fdc5806fe20 2024-04-26T21:18:30.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.578+0000 7fdc5f400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5815cda0 con 0x7fdc58072010 2024-04-26T21:18:30.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc5d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdc5806fe20 0x7fdc580b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc5d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdc5806fe20 0x7fdc580b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33986/0 (socket says 172.21.15.106:33986) 2024-04-26T21:18:30.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc5d400640 1 -- 172.21.15.106:0/340349357 learned_addr learned my addr 172.21.15.106:0/340349357 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:30.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc4fe00640 1 --2- 172.21.15.106:0/340349357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc58072010 0x7fdc5806f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc5d400640 1 -- 172.21.15.106:0/340349357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc58072010 msgr2=0x7fdc5806f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:30.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc5d400640 1 --2- 172.21.15.106:0/340349357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc58072010 0x7fdc5806f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc5d400640 1 -- 172.21.15.106:0/340349357 >> v1:172.21.15.112:6789/0 conn(0x7fdc581599a0 legacy=0x7fdc580b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc5d400640 1 -- 172.21.15.106:0/340349357 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580b59e0 con 0x7fdc5806fe20 2024-04-26T21:18:30.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc57e00640 1 -- 172.21.15.106:0/340349357 <== mon.1 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388340747 0 0) 0x7fdc58159d80 con 0x7fdc581599a0 2024-04-26T21:18:30.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc5d400640 1 --2- 172.21.15.106:0/340349357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 0x7fdc580b3aa0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009e50 tx=0x7fdc5001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fbd41a6458ab90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc57e00640 1 -- 172.21.15.106:0/340349357 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc500a5830 con 0x7fdc5806fe20 2024-04-26T21:18:30.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc57e00640 1 -- 172.21.15.106:0/340349357 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc500a59d0 con 0x7fdc5806fe20 2024-04-26T21:18:30.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.582+0000 7fdc57e00640 1 -- 172.21.15.106:0/340349357 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc500a5da0 con 0x7fdc5806fe20 2024-04-26T21:18:30.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 -- 172.21.15.106:0/340349357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 msgr2=0x7fdc580b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 --2- 172.21.15.106:0/340349357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 0x7fdc580b3aa0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009e50 tx=0x7fdc5001c970 comp rx=0 tx=0).stop 2024-04-26T21:18:30.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 -- 172.21.15.106:0/340349357 shutdown_connections 2024-04-26T21:18:30.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 --2- 172.21.15.106:0/340349357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 0x7fdc580b3aa0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 --2- 172.21.15.106:0/340349357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc58072010 0x7fdc5806f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 -- 172.21.15.106:0/340349357 >> 172.21.15.106:0/340349357 conn(0x7fdc580b27a0 msgr2=0x7fdc580b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:30.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 -- 172.21.15.106:0/340349357 shutdown_connections 2024-04-26T21:18:30.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 -- 172.21.15.106:0/340349357 wait complete. 2024-04-26T21:18:30.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 Processor -- start 2024-04-26T21:18:30.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 -- start start 2024-04-26T21:18:30.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 0x7fdc580cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc58072010 0x7fdc58152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc581599a0 0x7fdc580ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5815d3b0 con 0x7fdc5806fe20 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5815d230 con 0x7fdc581599a0 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5f400640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5815c390 con 0x7fdc58072010 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 0x7fdc580cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 0x7fdc580cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33998/0 (socket says 172.21.15.106:33998) 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5ca00640 1 -- 172.21.15.106:0/4292399275 learned_addr learned my addr 172.21.15.106:0/4292399275 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc4fe00640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc58072010 0x7fdc58152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5d400640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc581599a0 0x7fdc580ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5ca00640 1 -- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc58072010 msgr2=0x7fdc58152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5ca00640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdc58072010 0x7fdc58152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5ca00640 1 -- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc581599a0 msgr2=0x7fdc580ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5ca00640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc581599a0 0x7fdc580ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5ca00640 1 -- 172.21.15.106:0/4292399275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580cf260 con 0x7fdc5806fe20 2024-04-26T21:18:30.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.586+0000 7fdc5d400640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc581599a0 0x7fdc580ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:30.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc5ca00640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 0x7fdc580cfb40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c450 tx=0x7fdc4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc55600640 1 -- 172.21.15.106:0/4292399275 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48017070 con 0x7fdc5806fe20 2024-04-26T21:18:30.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc55600640 1 -- 172.21.15.106:0/4292399275 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc48005480 con 0x7fdc5806fe20 2024-04-26T21:18:30.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc55600640 1 -- 172.21.15.106:0/4292399275 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48003840 con 0x7fdc5806fe20 2024-04-26T21:18:30.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5814a530 con 0x7fdc5806fe20 2024-04-26T21:18:30.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5814aaf0 con 0x7fdc5806fe20 2024-04-26T21:18:30.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc58069400 con 0x7fdc5806fe20 2024-04-26T21:18:30.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc55600640 1 -- 172.21.15.106:0/4292399275 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdc4801a070 con 0x7fdc5806fe20 2024-04-26T21:18:30.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc55600640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc34068380 0x7fdc3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc55600640 1 -- 172.21.15.106:0/4292399275 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7fdc48085ba0 con 0x7fdc5806fe20 2024-04-26T21:18:30.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc4fe00640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc34068380 0x7fdc3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc55600640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fdc3406e8c0 0x7fdc34070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc55600640 1 -- 172.21.15.106:0/4292399275 --> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc340713d0 con 0x7fdc3406e8c0 2024-04-26T21:18:30.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc55600640 1 -- 172.21.15.106:0/4292399275 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdc4808a2a0 con 0x7fdc5806fe20 2024-04-26T21:18:30.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc5d400640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fdc3406e8c0 0x7fdc34070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.590+0000 7fdc4fe00640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc34068380 0x7fdc3406a840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdc580cd870 tx=0x7fdc40009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.594+0000 7fdc5d400640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fdc3406e8c0 0x7fdc34070d00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.594+0000 7fdc55600640 1 -- 172.21.15.106:0/4292399275 <== osd.7 v2:172.21.15.112:6824/2983510698 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc340713d0 con 0x7fdc3406e8c0 2024-04-26T21:18:30.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 --> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdc5806e210 con 0x7fdc3406e8c0 2024-04-26T21:18:30.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc55600640 1 -- 172.21.15.106:0/4292399275 <== osd.7 v2:172.21.15.112:6824/2983510698 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdc5806e210 con 0x7fdc3406e8c0 2024-04-26T21:18:30.610 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T21:18:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T21:18:30.611 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T21:18:30.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fdc3406e8c0 msgr2=0x7fdc34070d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.112:6824/2983510698,v1:172.21.15.112:6825/2983510698] conn(0x7fdc3406e8c0 0x7fdc34070d00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc34068380 msgr2=0x7fdc3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fdc34068380 0x7fdc3406a840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdc580cd870 tx=0x7fdc40009190 comp rx=0 tx=0).stop 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 msgr2=0x7fdc580cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 --2- 172.21.15.106:0/4292399275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc5806fe20 0x7fdc580cfb40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c450 tx=0x7fdc4800c910 comp rx=0 tx=0).stop 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5d400640 1 -- 172.21.15.106:0/4292399275 reap_dead start 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 shutdown_connections 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 >> 172.21.15.106:0/4292399275 conn(0x7fdc580b27a0 msgr2=0x7fdc580aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 shutdown_connections 2024-04-26T21:18:30.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.606+0000 7fdc5f400640 1 -- 172.21.15.106:0/4292399275 wait complete. 2024-04-26T21:18:30.629 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T21:18:30.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b5a600640 1 Processor -- start 2024-04-26T21:18:30.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b5a600640 1 -- start start 2024-04-26T21:18:30.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b5a600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6b54146490 0x7f6b5415df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b5a600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6b54160ac0 0x7f6b540cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b5a600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 0x7f6b540d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b5a600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f6b540cf730 con 0x7f6b54146490 2024-04-26T21:18:30.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b5a600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6b540b3da0 con 0x7f6b54160ac0 2024-04-26T21:18:30.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b5a600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6b54160fa0 con 0x7f6b54146870 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b53400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6b54146490 0x7f6b5415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b53400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6b54146490 0x7f6b5415df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34014/0 (socket says 172.21.15.106:34014) 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b53400640 1 -- 172.21.15.106:0/736615820 learned_addr learned my addr 172.21.15.106:0/736615820 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b53e00640 1 --2- 172.21.15.106:0/736615820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 0x7f6b540d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b4aa00640 1 --2- 172.21.15.106:0/736615820 >> v2:172.21.15.112:3300/0 conn(0x7f6b54160ac0 0x7f6b540cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b53400640 1 -- 172.21.15.106:0/736615820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 msgr2=0x7f6b540d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.762+0000 7f6b53400640 1 --2- 172.21.15.106:0/736615820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 0x7f6b540d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b53400640 1 -- 172.21.15.106:0/736615820 >> v2:172.21.15.112:3300/0 conn(0x7f6b54160ac0 msgr2=0x7f6b540cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b53400640 1 --2- 172.21.15.106:0/736615820 >> v2:172.21.15.112:3300/0 conn(0x7f6b54160ac0 0x7f6b540cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b53400640 1 -- 172.21.15.106:0/736615820 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b54161280 con 0x7f6b54146490 2024-04-26T21:18:30.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b53400640 1 --2- 172.21.15.106:0/736615820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 0x7f6b5415df50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6b54157b20 tx=0x7f6b4401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b55a7f47bee585 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b52a00640 1 -- 172.21.15.106:0/736615820 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b440a5670 con 0x7f6b54146490 2024-04-26T21:18:30.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b52a00640 1 -- 172.21.15.106:0/736615820 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b440a5810 con 0x7f6b54146490 2024-04-26T21:18:30.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b52a00640 1 -- 172.21.15.106:0/736615820 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b440a5be0 con 0x7f6b54146490 2024-04-26T21:18:30.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b5a600640 1 -- 172.21.15.106:0/736615820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 msgr2=0x7f6b5415df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b5a600640 1 --2- 172.21.15.106:0/736615820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 0x7f6b5415df50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6b54157b20 tx=0x7f6b4401c9f0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.766+0000 7f6b5a600640 1 -- 172.21.15.106:0/736615820 shutdown_connections 2024-04-26T21:18:30.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 --2- 172.21.15.106:0/736615820 >> v2:172.21.15.112:3300/0 conn(0x7f6b54160ac0 0x7f6b540cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 --2- 172.21.15.106:0/736615820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 0x7f6b540d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 --2- 172.21.15.106:0/736615820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 0x7f6b5415df50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 -- 172.21.15.106:0/736615820 >> 172.21.15.106:0/736615820 conn(0x7f6b54068340 msgr2=0x7f6b54068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:30.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 -- 172.21.15.106:0/736615820 shutdown_connections 2024-04-26T21:18:30.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 -- 172.21.15.106:0/736615820 wait complete. 2024-04-26T21:18:30.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 Processor -- start 2024-04-26T21:18:30.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 -- start start 2024-04-26T21:18:30.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 0x7f6b5413b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 0x7f6b541fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b54160ac0 0x7f6b5413fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b540b4f40 con 0x7f6b54146490 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6b540b4dc0 con 0x7f6b54160ac0 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b5a600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6b540b50c0 con 0x7f6b54146870 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 0x7f6b5413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 0x7f6b5413b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34016/0 (socket says 172.21.15.106:34016) 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53400640 1 -- 172.21.15.106:0/1012381060 learned_addr learned my addr 172.21.15.106:0/1012381060 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b4aa00640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 0x7f6b541fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53e00640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b54160ac0 0x7f6b5413fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53400640 1 -- 172.21.15.106:0/1012381060 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 msgr2=0x7f6b541fbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53400640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 0x7f6b541fbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53400640 1 -- 172.21.15.106:0/1012381060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b54160ac0 msgr2=0x7f6b5413fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53400640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b54160ac0 0x7f6b5413fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53400640 1 -- 172.21.15.106:0/1012381060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b541fc6b0 con 0x7f6b54146490 2024-04-26T21:18:30.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b53400640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 0x7f6b5413b530 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6b440af040 tx=0x7f6b44019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b4be00640 1 -- 172.21.15.106:0/1012381060 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44009510 con 0x7f6b54146490 2024-04-26T21:18:30.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b4be00640 1 -- 172.21.15.106:0/1012381060 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b440be070 con 0x7f6b54146490 2024-04-26T21:18:30.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.770+0000 7f6b4be00640 1 -- 172.21.15.106:0/1012381060 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b440b88d0 con 0x7f6b54146490 2024-04-26T21:18:30.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.774+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b541fc990 con 0x7f6b54146490 2024-04-26T21:18:30.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.774+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b541432b0 con 0x7f6b54146490 2024-04-26T21:18:30.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.774+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b54069400 con 0x7f6b54146490 2024-04-26T21:18:30.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.774+0000 7f6b4be00640 1 -- 172.21.15.106:0/1012381060 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b440b8a70 con 0x7f6b54146490 2024-04-26T21:18:30.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.774+0000 7f6b4be00640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6b30068380 0x7f6b3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:30.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.774+0000 7f6b4be00640 1 -- 172.21.15.106:0/1012381060 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f6b441218d0 con 0x7f6b54146490 2024-04-26T21:18:30.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.774+0000 7f6b4aa00640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6b30068380 0x7f6b3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:30.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.774+0000 7f6b4aa00640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6b30068380 0x7f6b3006a840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6b541572f0 tx=0x7f6b3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:30.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.778+0000 7f6b4be00640 1 -- 172.21.15.106:0/1012381060 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6b440165e0 con 0x7f6b54146490 2024-04-26T21:18:30.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.938+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6b54142da0 con 0x7f6b30068380 2024-04-26T21:18:30.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.938+0000 7f6b4be00640 1 -- 172.21.15.106:0/1012381060 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6b54142da0 con 0x7f6b30068380 2024-04-26T21:18:30.942 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T21:18:30.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6b30068380 msgr2=0x7f6b3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6b30068380 0x7f6b3006a840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6b541572f0 tx=0x7f6b3c008040 comp rx=0 tx=0).stop 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 msgr2=0x7f6b5413b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 0x7f6b5413b530 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6b440af040 tx=0x7f6b44019790 comp rx=0 tx=0).stop 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 shutdown_connections 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b54160ac0 0x7f6b5413fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f6b30068380 0x7f6b3006a840 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b54146870 0x7f6b541fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 --2- 172.21.15.106:0/1012381060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b54146490 0x7f6b5413b530 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 >> 172.21.15.106:0/1012381060 conn(0x7f6b54068340 msgr2=0x7f6b540b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 shutdown_connections 2024-04-26T21:18:30.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:30.942+0000 7f6b5a600640 1 -- 172.21.15.106:0/1012381060 wait complete. 2024-04-26T21:18:30.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:18:31.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.094+0000 7f8200c00640 1 Processor -- start 2024-04-26T21:18:31.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.094+0000 7f8200c00640 1 -- start start 2024-04-26T21:18:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f8200c00640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f81fc152710 0x7f81fc06f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f8200c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f81fc06fff0 0x7f81fc071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f8200c00640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81fc06faf0 con 0x7f81fc072490 2024-04-26T21:18:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f8200c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f81fc0d0550 con 0x7f81fc06fff0 2024-04-26T21:18:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f8200c00640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f81fc0d0830 con 0x7f81fc152710 2024-04-26T21:18:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f81fc06fff0 0x7f81fc071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f81fc06fff0 0x7f81fc071f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34022/0 (socket says 172.21.15.106:34022) 2024-04-26T21:18:31.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f9400640 1 -- 172.21.15.106:0/2668352153 learned_addr learned my addr 172.21.15.106:0/2668352153 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:31.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f9400640 1 -- 172.21.15.106:0/2668352153 >> v2:172.21.15.112:3300/0 conn(0x7f81fc152710 msgr2=0x7f81fc06f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:31.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f9400640 1 --2- 172.21.15.106:0/2668352153 >> v2:172.21.15.112:3300/0 conn(0x7f81fc152710 0x7f81fc06f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:31.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f9400640 1 -- 172.21.15.106:0/2668352153 >> v1:172.21.15.112:6789/0 conn(0x7f81fc072490 legacy=0x7f81fc15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:31.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f9400640 1 -- 172.21.15.106:0/2668352153 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc0b3ac0 con 0x7f81fc06fff0 2024-04-26T21:18:31.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f9400640 1 --2- 172.21.15.106:0/2668352153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 0x7f81fc071f50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0d1ba0 tx=0x7f81e801e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1128c124d0d09bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:31.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f8a00640 1 -- 172.21.15.106:0/2668352153 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e80ad070 con 0x7f81fc06fff0 2024-04-26T21:18:31.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.098+0000 7f81f8a00640 1 -- 172.21.15.106:0/2668352153 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e8004230 con 0x7f81fc06fff0 2024-04-26T21:18:31.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f8a00640 1 -- 172.21.15.106:0/2668352153 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e80a7750 con 0x7f81fc06fff0 2024-04-26T21:18:31.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 -- 172.21.15.106:0/2668352153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 msgr2=0x7f81fc071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:31.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 --2- 172.21.15.106:0/2668352153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 0x7f81fc071f50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0d1ba0 tx=0x7f81e801e990 comp rx=0 tx=0).stop 2024-04-26T21:18:31.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 -- 172.21.15.106:0/2668352153 shutdown_connections 2024-04-26T21:18:31.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 --2- 172.21.15.106:0/2668352153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 0x7f81fc071f50 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:31.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 --2- 172.21.15.106:0/2668352153 >> v2:172.21.15.112:3300/0 conn(0x7f81fc152710 0x7f81fc06f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:31.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 -- 172.21.15.106:0/2668352153 >> 172.21.15.106:0/2668352153 conn(0x7f81fc068340 msgr2=0x7f81fc068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:31.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 -- 172.21.15.106:0/2668352153 shutdown_connections 2024-04-26T21:18:31.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 -- 172.21.15.106:0/2668352153 wait complete. 2024-04-26T21:18:31.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 Processor -- start 2024-04-26T21:18:31.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 -- start start 2024-04-26T21:18:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 0x7f81fc0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81fc072490 0x7f81fc14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81fc152710 0x7f81fc14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc0b45a0 con 0x7f81fc06fff0 2024-04-26T21:18:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc15fa10 con 0x7f81fc072490 2024-04-26T21:18:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f8200c00640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f81fc0b4720 con 0x7f81fc152710 2024-04-26T21:18:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 0x7f81fc0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 0x7f81fc0b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34036/0 (socket says 172.21.15.106:34036) 2024-04-26T21:18:31.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f9e00640 1 -- 172.21.15.106:0/3739461338 learned_addr learned my addr 172.21.15.106:0/3739461338 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f9400640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81fc072490 0x7f81fc14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81fa800640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81fc152710 0x7f81fc14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f9e00640 1 -- 172.21.15.106:0/3739461338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81fc152710 msgr2=0x7f81fc14b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f9e00640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81fc152710 0x7f81fc14b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f9e00640 1 -- 172.21.15.106:0/3739461338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81fc072490 msgr2=0x7f81fc14bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f9e00640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81fc072490 0x7f81fc14bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.102+0000 7f81f9e00640 1 -- 172.21.15.106:0/3739461338 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc14c1f0 con 0x7f81fc06fff0 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f81f9e00640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 0x7f81fc0b31e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00ba50 tx=0x7f81ec00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f81f2000640 1 -- 172.21.15.106:0/3739461338 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec019070 con 0x7f81fc06fff0 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f81f2000640 1 -- 172.21.15.106:0/3739461338 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec00cc00 con 0x7f81fc06fff0 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f81f2000640 1 -- 172.21.15.106:0/3739461338 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec014440 con 0x7f81fc06fff0 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc14c490 con 0x7f81fc06fff0 2024-04-26T21:18:31.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc14ca50 con 0x7f81fc06fff0 2024-04-26T21:18:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81fc153cb0 con 0x7f81fc06fff0 2024-04-26T21:18:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f81f2000640 1 -- 172.21.15.106:0/3739461338 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81ec01c070 con 0x7f81fc06fff0 2024-04-26T21:18:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f81f2000640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81dc068380 0x7f81dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:31.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f81f2000640 1 -- 172.21.15.106:0/3739461338 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f81ec0864f0 con 0x7f81fc06fff0 2024-04-26T21:18:31.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.106+0000 7f81f9400640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81dc068380 0x7f81dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:31.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.110+0000 7f81f9400640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81dc068380 0x7f81dc06a840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f81e80b1000 tx=0x7f81e80a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:31.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.110+0000 7f81f2000640 1 -- 172.21.15.106:0/3739461338 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f81fc153cb0 con 0x7f81fc06fff0 2024-04-26T21:18:31.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.262+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81fc151f40 con 0x7f81dc068380 2024-04-26T21:18:31.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f81f2000640 1 -- 172.21.15.106:0/3739461338 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13452 (secure 0 0 0) 0x7f81fc151f40 con 0x7f81dc068380 2024-04-26T21:18:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:31.268 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:18:31.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81dc068380 msgr2=0x7f81dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81dc068380 0x7f81dc06a840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f81e80b1000 tx=0x7f81e80a9070 comp rx=0 tx=0).stop 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 msgr2=0x7f81fc0b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 0x7f81fc0b31e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00ba50 tx=0x7f81ec00bf10 comp rx=0 tx=0).stop 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 shutdown_connections 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81fc072490 0x7f81fc14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f81dc068380 0x7f81dc06a840 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81fc152710 0x7f81fc14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 --2- 172.21.15.106:0/3739461338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81fc06fff0 0x7f81fc0b31e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 >> 172.21.15.106:0/3739461338 conn(0x7f81fc068340 msgr2=0x7f81fc068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 shutdown_connections 2024-04-26T21:18:31.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:31.266+0000 7f8200c00640 1 -- 172.21.15.106:0/3739461338 wait complete. 2024-04-26T21:18:31.288 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-04-26T21:18:30.316540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221636,"kb_used_data":5448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753084,"statfs":{"total":773094113280,"available":772867158016,"internally_reserved":0,"allocated":5578752,"data_stored":3090288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.953377"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T21:18:22.370845+0000","last_change":"2024-04-26T21:16:10.458225+0000","last_active":"2024-04-26T21:18:22.370845+0000","last_peered":"2024-04-26T21:18:22.370845+0000","last_clean":"2024-04-26T21:18:22.370845+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:18:22.370845+0000","last_undegraded":"2024-04-26T21:18:22.370845+0000","last_fullsized":"2024-04-26T21:18:22.370845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:16:09.242492+0000","last_clean_scrub_stamp":"2024-04-26T21:16:09.242492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:54.966901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":829062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":829062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:18:31.291 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T21:16:09.242492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=16, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=18, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T21:18:31.291 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T21:18:48.951 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:18:48.954 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:18:51.292 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:18:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46df600640 1 Processor -- start 2024-04-26T21:18:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46df600640 1 -- start start 2024-04-26T21:18:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46df600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f46d813ed60 0x7f46d815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46df600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813f140 0x7f46d80b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46df600640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d80b3d10 con 0x7f46d806eb70 2024-04-26T21:18:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46df600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f46d80b3ac0 con 0x7f46d813ed60 2024-04-26T21:18:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46df600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f46d80b4920 con 0x7f46d813f140 2024-04-26T21:18:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46d7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813f140 0x7f46d80b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46d7e00640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813f140 0x7f46d80b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.106:59478/0 (socket says 172.21.15.106:59478) 2024-04-26T21:18:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46d7e00640 1 -- 172.21.15.106:0/1447303420 learned_addr learned my addr 172.21.15.106:0/1447303420 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46dd600640 1 --1- 172.21.15.106:0/1447303420 >> v1:172.21.15.112:6789/0 conn(0x7f46d806eb70 0x7f46d80d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.106:41956/0 (socket says 172.21.15.106:41956) 2024-04-26T21:18:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.426+0000 7f46dcc00640 1 --2- 172.21.15.106:0/1447303420 >> v2:172.21.15.112:3300/0 conn(0x7f46d813ed60 0x7f46d815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.430+0000 7f46d7e00640 1 -- 172.21.15.106:0/1447303420 >> v2:172.21.15.112:3300/0 conn(0x7f46d813ed60 msgr2=0x7f46d815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.430+0000 7f46d7e00640 1 --2- 172.21.15.106:0/1447303420 >> v2:172.21.15.112:3300/0 conn(0x7f46d813ed60 0x7f46d815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.430+0000 7f46d7e00640 1 -- 172.21.15.106:0/1447303420 >> v1:172.21.15.112:6789/0 conn(0x7f46d806eb70 legacy=0x7f46d80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.430+0000 7f46d7e00640 1 -- 172.21.15.106:0/1447303420 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d80b3ff0 con 0x7f46d813f140 2024-04-26T21:18:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.430+0000 7f46d7e00640 1 --2- 172.21.15.106:0/1447303420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813f140 0x7f46d80b52e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009870 tx=0x7f46c401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2956dd61e665d208 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.430+0000 7f46d7400640 1 -- 172.21.15.106:0/1447303420 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c40ab640 con 0x7f46d813f140 2024-04-26T21:18:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.430+0000 7f46d7400640 1 -- 172.21.15.106:0/1447303420 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c40b0070 con 0x7f46d813f140 2024-04-26T21:18:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.430+0000 7f46d7400640 1 -- 172.21.15.106:0/1447303420 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c40aba00 con 0x7f46d813f140 2024-04-26T21:18:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 -- 172.21.15.106:0/1447303420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813f140 msgr2=0x7f46d80b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 --2- 172.21.15.106:0/1447303420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813f140 0x7f46d80b52e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009870 tx=0x7f46c401c440 comp rx=0 tx=0).stop 2024-04-26T21:18:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 -- 172.21.15.106:0/1447303420 shutdown_connections 2024-04-26T21:18:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 --2- 172.21.15.106:0/1447303420 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813f140 0x7f46d80b52e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 --2- 172.21.15.106:0/1447303420 >> v2:172.21.15.112:3300/0 conn(0x7f46d813ed60 0x7f46d815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 -- 172.21.15.106:0/1447303420 >> 172.21.15.106:0/1447303420 conn(0x7f46d8068340 msgr2=0x7f46d8068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:51.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 -- 172.21.15.106:0/1447303420 shutdown_connections 2024-04-26T21:18:51.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 -- 172.21.15.106:0/1447303420 wait complete. 2024-04-26T21:18:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 Processor -- start 2024-04-26T21:18:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 -- start start 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813ed60 0x7f46d815eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46d80af2e0 0x7f46d81523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46d813a4e0 0x7f46d813a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f46d80d1680 con 0x7f46d813a4e0 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f46d80d1500 con 0x7f46d80af2e0 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46df600640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f46d8160400 con 0x7f46d813ed60 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dd600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46d813a4e0 0x7f46d813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dd600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46d813a4e0 0x7f46d813a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50010/0 (socket says 172.21.15.106:50010) 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dd600640 1 -- 172.21.15.106:0/1412068271 learned_addr learned my addr 172.21.15.106:0/1412068271 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46d7e00640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46d80af2e0 0x7f46d81523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dcc00640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813ed60 0x7f46d815eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dd600640 1 -- 172.21.15.106:0/1412068271 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813ed60 msgr2=0x7f46d815eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dd600640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813ed60 0x7f46d815eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dd600640 1 -- 172.21.15.106:0/1412068271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46d80af2e0 msgr2=0x7f46d81523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dd600640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46d80af2e0 0x7f46d81523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dd600640 1 -- 172.21.15.106:0/1412068271 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d80af770 con 0x7f46d813a4e0 2024-04-26T21:18:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.434+0000 7f46dd600640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46d813a4e0 0x7f46d813a970 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c730 tx=0x7f46d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:51.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46d4c00640 1 -- 172.21.15.106:0/1412068271 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0017070 con 0x7f46d813a4e0 2024-04-26T21:18:51.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46d4c00640 1 -- 172.21.15.106:0/1412068271 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d000ce40 con 0x7f46d813a4e0 2024-04-26T21:18:51.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d80afa50 con 0x7f46d813a4e0 2024-04-26T21:18:51.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46d4c00640 1 -- 172.21.15.106:0/1412068271 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d000a840 con 0x7f46d813a4e0 2024-04-26T21:18:51.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d8167c00 con 0x7f46d813a4e0 2024-04-26T21:18:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d80afc20 con 0x7f46d813a4e0 2024-04-26T21:18:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46d4c00640 1 -- 172.21.15.106:0/1412068271 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f46d001a070 con 0x7f46d813a4e0 2024-04-26T21:18:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46d4c00640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f46b8068380 0x7f46b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46d4c00640 1 -- 172.21.15.106:0/1412068271 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f46d0085e50 con 0x7f46d813a4e0 2024-04-26T21:18:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.438+0000 7f46dcc00640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f46b8068380 0x7f46b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.442+0000 7f46dcc00640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f46b8068380 0x7f46b806a840 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f46c8009b60 tx=0x7f46c8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:51.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.442+0000 7f46d4c00640 1 -- 172.21.15.106:0/1412068271 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f46d0055e40 con 0x7f46d813a4e0 2024-04-26T21:18:51.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 --> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46d8069400 con 0x7f46b8068380 2024-04-26T21:18:51.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46d4c00640 1 -- 172.21.15.106:0/1412068271 <== mgr.4099 v2:172.21.15.106:6832/3357608223 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7f46d8069400 con 0x7f46b8068380 2024-04-26T21:18:51.600 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:51.601 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T21:18:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f46b8068380 msgr2=0x7f46b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f46b8068380 0x7f46b806a840 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f46c8009b60 tx=0x7f46c8009190 comp rx=0 tx=0).stop 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46d813a4e0 msgr2=0x7f46d813a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46d813a4e0 0x7f46d813a970 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c730 tx=0x7f46d000cbf0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 shutdown_connections 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46d80af2e0 0x7f46d81523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f46b8068380 0x7f46b806a840 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46d813a4e0 0x7f46d813a970 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 --2- 172.21.15.106:0/1412068271 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f46d813ed60 0x7f46d815eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 >> 172.21.15.106:0/1412068271 conn(0x7f46d8068340 msgr2=0x7f46d80cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 shutdown_connections 2024-04-26T21:18:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.598+0000 7f46df600640 1 -- 172.21.15.106:0/1412068271 wait complete. 2024-04-26T21:18:51.622 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-04-26T21:18:50.321160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221620,"kb_used_data":5448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753100,"statfs":{"total":773094113280,"available":772867174400,"internally_reserved":0,"allocated":5578752,"data_stored":3090288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002858"},"pg_stats":[{"pgid":"1.0","version":"47'119","reported_seq":230,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T21:18:31.747287+0000","last_change":"2024-04-26T21:18:31.747316+0000","last_active":"2024-04-26T21:18:31.747287+0000","last_peered":"2024-04-26T21:18:31.747287+0000","last_clean":"2024-04-26T21:18:31.747287+0000","last_became_active":"2024-04-26T21:16:10.457264+0000","last_became_peered":"2024-04-26T21:16:10.457264+0000","last_unstale":"2024-04-26T21:18:31.747287+0000","last_undegraded":"2024-04-26T21:18:31.747287+0000","last_fullsized":"2024-04-26T21:18:31.747287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'119","last_scrub_stamp":"2024-04-26T21:18:31.747215+0000","last_deep_scrub":"47'119","last_deep_scrub_stamp":"2024-04-26T21:18:31.747215+0000","last_clean_scrub_stamp":"2024-04-26T21:18:31.747215+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:34.633002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1142784,"data_stored":829062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1142784,"data_stored":829062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":238694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:18:51.623 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T21:18:51.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.754+0000 7fb831000640 1 Processor -- start 2024-04-26T21:18:51.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.754+0000 7fb831000640 1 -- start start 2024-04-26T21:18:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb831000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15c4e0 0x7fb82c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb831000640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb82c15da80 0x7fb82c15df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb831000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82c15ce00 con 0x7fb82c15d080 2024-04-26T21:18:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb831000640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb82c15d5f0 con 0x7fb82c15da80 2024-04-26T21:18:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb831000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c0b4f00 con 0x7fb82c15c4e0 2024-04-26T21:18:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb829400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb82c15d080 0x7fb82c0b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39694/0 (socket says 172.21.15.106:39694) 2024-04-26T21:18:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb829400640 1 -- 172.21.15.106:0/4255481692 learned_addr learned my addr 172.21.15.106:0/4255481692 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb829e00640 1 --2- 172.21.15.106:0/4255481692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15c4e0 0x7fb82c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb82a800640 1 --2- 172.21.15.106:0/4255481692 >> v2:172.21.15.112:3300/0 conn(0x7fb82c15da80 0x7fb82c15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb828a00640 1 -- 172.21.15.106:0/4255481692 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679693364 0 0) 0x7fb82c15ce00 con 0x7fb82c15d080 2024-04-26T21:18:51.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb828a00640 1 -- 172.21.15.106:0/4255481692 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb810003530 con 0x7fb82c15d080 2024-04-26T21:18:51.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb829e00640 1 -- 172.21.15.106:0/4255481692 >> v2:172.21.15.112:3300/0 conn(0x7fb82c15da80 msgr2=0x7fb82c15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:51.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb829e00640 1 --2- 172.21.15.106:0/4255481692 >> v2:172.21.15.112:3300/0 conn(0x7fb82c15da80 0x7fb82c15df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb829e00640 1 -- 172.21.15.106:0/4255481692 >> v1:172.21.15.106:6789/0 conn(0x7fb82c15d080 legacy=0x7fb82c0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb829e00640 1 -- 172.21.15.106:0/4255481692 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c0b51e0 con 0x7fb82c15c4e0 2024-04-26T21:18:51.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.758+0000 7fb82a800640 1 --2- 172.21.15.106:0/4255481692 >> v2:172.21.15.112:3300/0 conn(0x7fb82c15da80 0x7fb82c15df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:18:51.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb829e00640 1 --2- 172.21.15.106:0/4255481692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15c4e0 0x7fb82c15c8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8140097c0 tx=0x7fb81401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57bb65a64130b4a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:51.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb828a00640 1 -- 172.21.15.106:0/4255481692 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8140b2070 con 0x7fb82c15c4e0 2024-04-26T21:18:51.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb828a00640 1 -- 172.21.15.106:0/4255481692 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8140ad640 con 0x7fb82c15c4e0 2024-04-26T21:18:51.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb828a00640 1 -- 172.21.15.106:0/4255481692 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8140ada10 con 0x7fb82c15c4e0 2024-04-26T21:18:51.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 -- 172.21.15.106:0/4255481692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15c4e0 msgr2=0x7fb82c15c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 --2- 172.21.15.106:0/4255481692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15c4e0 0x7fb82c15c8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8140097c0 tx=0x7fb81401c4a0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 -- 172.21.15.106:0/4255481692 shutdown_connections 2024-04-26T21:18:51.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 --2- 172.21.15.106:0/4255481692 >> v2:172.21.15.112:3300/0 conn(0x7fb82c15da80 0x7fb82c15df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 --2- 172.21.15.106:0/4255481692 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15c4e0 0x7fb82c15c8c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 -- 172.21.15.106:0/4255481692 >> 172.21.15.106:0/4255481692 conn(0x7fb82c0b2910 msgr2=0x7fb82c0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:51.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 -- 172.21.15.106:0/4255481692 shutdown_connections 2024-04-26T21:18:51.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 -- 172.21.15.106:0/4255481692 wait complete. 2024-04-26T21:18:51.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 Processor -- start 2024-04-26T21:18:51.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.762+0000 7fb831000640 1 -- start start 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb831000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb82c15c4e0 0x7fb82c1f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb831000640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c15d080 0x7fb82c0d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb831000640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15da80 0x7fb82c140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb831000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c166f30 con 0x7fb82c15c4e0 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb831000640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c166db0 con 0x7fb82c15d080 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb831000640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c1670b0 con 0x7fb82c15da80 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb82c15c4e0 0x7fb82c1f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb82c15c4e0 0x7fb82c1f92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50016/0 (socket says 172.21.15.106:50016) 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829e00640 1 -- 172.21.15.106:0/4201130557 learned_addr learned my addr 172.21.15.106:0/4201130557 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb82a800640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15da80 0x7fb82c140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829400640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c15d080 0x7fb82c0d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829e00640 1 -- 172.21.15.106:0/4201130557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15da80 msgr2=0x7fb82c140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829e00640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15da80 0x7fb82c140390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829e00640 1 -- 172.21.15.106:0/4201130557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c15d080 msgr2=0x7fb82c0d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829e00640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c15d080 0x7fb82c0d0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829e00640 1 -- 172.21.15.106:0/4201130557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c149be0 con 0x7fb82c15c4e0 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb82a800640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15da80 0x7fb82c140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb829e00640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb82c15c4e0 0x7fb82c1f92c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb81401a0d0 tx=0x7fb814019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb822000640 1 -- 172.21.15.106:0/4201130557 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8140b2040 con 0x7fb82c15c4e0 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb822000640 1 -- 172.21.15.106:0/4201130557 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8140bd070 con 0x7fb82c15c4e0 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb822000640 1 -- 172.21.15.106:0/4201130557 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814006e20 con 0x7fb82c15c4e0 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c1f87e0 con 0x7fb82c15c4e0 2024-04-26T21:18:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c1f8da0 con 0x7fb82c15c4e0 2024-04-26T21:18:51.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82c1f85e0 con 0x7fb82c15c4e0 2024-04-26T21:18:51.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.766+0000 7fb822000640 1 -- 172.21.15.106:0/4201130557 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb82c15ec60 con 0x7fb82c15c4e0 2024-04-26T21:18:51.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.770+0000 7fb822000640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb808068380 0x7fb80806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:51.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.770+0000 7fb822000640 1 -- 172.21.15.106:0/4201130557 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7fb814120650 con 0x7fb82c15c4e0 2024-04-26T21:18:51.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.770+0000 7fb829400640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb808068380 0x7fb80806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:51.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.770+0000 7fb829400640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb808068380 0x7fb80806a840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb82c15aee0 tx=0x7fb81c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:51.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.774+0000 7fb822000640 1 -- 172.21.15.106:0/4201130557 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb814016090 con 0x7fb82c15c4e0 2024-04-26T21:18:51.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.930+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb82c069400 con 0x7fb82c15c4e0 2024-04-26T21:18:51.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.934+0000 7fb822000640 1 -- 172.21.15.106:0/4201130557 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fb8140f0db0 con 0x7fb82c15c4e0 2024-04-26T21:18:51.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.934+0000 7fb822000640 1 -- 172.21.15.106:0/4201130557 <== mon.0 v2:172.21.15.106:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb8140ad640 con 0x7fb82c15c4e0 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb808068380 msgr2=0x7fb80806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb808068380 0x7fb80806a840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb82c15aee0 tx=0x7fb81c009040 comp rx=0 tx=0).stop 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb82c15c4e0 msgr2=0x7fb82c1f92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb82c15c4e0 0x7fb82c1f92c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb81401a0d0 tx=0x7fb814019240 comp rx=0 tx=0).stop 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 shutdown_connections 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb82c15d080 0x7fb82c0d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7fb808068380 0x7fb80806a840 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb82c15da80 0x7fb82c140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 --2- 172.21.15.106:0/4201130557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb82c15c4e0 0x7fb82c1f92c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 >> 172.21.15.106:0/4201130557 conn(0x7fb82c0b2910 msgr2=0x7fb82c15c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:51.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 shutdown_connections 2024-04-26T21:18:51.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:51.938+0000 7fb831000640 1 -- 172.21.15.106:0/4201130557 wait complete. 2024-04-26T21:18:51.960 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T21:18:51.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:18:52.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17cb800640 1 Processor -- start 2024-04-26T21:18:52.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17cb800640 1 -- start start 2024-04-26T21:18:52.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17cb800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c413ed60 0x7f17c415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:52.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17cb800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17c413f140 0x7f17c40b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:52.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17cb800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c40b3d10 con 0x7f17c406eb70 2024-04-26T21:18:52.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17cb800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 -- 0x7f17c40b3ac0 con 0x7f17c413f140 2024-04-26T21:18:52.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17cb800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17c40b4920 con 0x7f17c413ed60 2024-04-26T21:18:52.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17c413f140 0x7f17c40b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:52.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c9800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f17c406eb70 0x7f17c40d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39708/0 (socket says 172.21.15.106:39708) 2024-04-26T21:18:52.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c9800640 1 -- 172.21.15.106:0/3701324499 learned_addr learned my addr 172.21.15.106:0/3701324499 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T21:18:52.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c8e00640 1 --2- 172.21.15.106:0/3701324499 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c413ed60 0x7f17c415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:52.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c3e00640 1 -- 172.21.15.106:0/3701324499 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c413ed60 msgr2=0x7f17c415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:18:52.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c3e00640 1 --2- 172.21.15.106:0/3701324499 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c413ed60 0x7f17c415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c3e00640 1 -- 172.21.15.106:0/3701324499 >> v1:172.21.15.106:6789/0 conn(0x7f17c406eb70 legacy=0x7f17c40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:52.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c3400640 1 -- 172.21.15.106:0/3701324499 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 813369428 0 0) 0x7f17c40b3d10 con 0x7f17c406eb70 2024-04-26T21:18:52.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c3e00640 1 -- 172.21.15.106:0/3701324499 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c40b3ff0 con 0x7f17c413f140 2024-04-26T21:18:52.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.094+0000 7f17c8e00640 1 --2- 172.21.15.106:0/3701324499 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c413ed60 0x7f17c415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:52.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17c3e00640 1 --2- 172.21.15.106:0/3701324499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413f140 0x7f17c40b52e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671be5091445819c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:52.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17c3400640 1 -- 172.21.15.106:0/3701324499 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00b2070 con 0x7f17c413f140 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17c3400640 1 -- 172.21.15.106:0/3701324499 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f17b00ad680 con 0x7f17c413f140 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17c3400640 1 -- 172.21.15.106:0/3701324499 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00ada70 con 0x7f17c413f140 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17cb800640 1 -- 172.21.15.106:0/3701324499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413f140 msgr2=0x7f17c40b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17cb800640 1 --2- 172.21.15.106:0/3701324499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413f140 0x7f17c40b52e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b001c380 comp rx=0 tx=0).stop 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17cb800640 1 -- 172.21.15.106:0/3701324499 shutdown_connections 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17cb800640 1 --2- 172.21.15.106:0/3701324499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413f140 0x7f17c40b52e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17cb800640 1 --2- 172.21.15.106:0/3701324499 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c413ed60 0x7f17c415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17cb800640 1 -- 172.21.15.106:0/3701324499 >> 172.21.15.106:0/3701324499 conn(0x7f17c4068340 msgr2=0x7f17c4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17cb800640 1 -- 172.21.15.106:0/3701324499 shutdown_connections 2024-04-26T21:18:52.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.098+0000 7f17cb800640 1 -- 172.21.15.106:0/3701324499 wait complete. 2024-04-26T21:18:52.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 Processor -- start 2024-04-26T21:18:52.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 -- start start 2024-04-26T21:18:52.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413ed60 0x7f17c413d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c41f8120 0x7f17c4157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c41576c0 0x7f17c415ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f17c40d1680 con 0x7f17c413ed60 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f17c40d1500 con 0x7f17c41f8120 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f17c4160400 con 0x7f17c41576c0 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413ed60 0x7f17c413d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413ed60 0x7f17c413d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50034/0 (socket says 172.21.15.106:50034) 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c8e00640 1 -- 172.21.15.106:0/2751324068 learned_addr learned my addr 172.21.15.106:0/2751324068 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c3e00640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c41f8120 0x7f17c4157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c8e00640 1 -- 172.21.15.106:0/2751324068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c41576c0 msgr2=0x7f17c415ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c8e00640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c41576c0 0x7f17c415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c8e00640 1 -- 172.21.15.106:0/2751324068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c41f8120 msgr2=0x7f17c4157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:52.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c8e00640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c41f8120 0x7f17c4157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c8e00640 1 -- 172.21.15.106:0/2751324068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c4157c20 con 0x7f17c413ed60 2024-04-26T21:18:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c3e00640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c41f8120 0x7f17c4157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c8e00640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413ed60 0x7f17c413d6e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f17b400cfc0 tx=0x7f17b400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c0c00640 1 -- 172.21.15.106:0/2751324068 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b401a070 con 0x7f17c413ed60 2024-04-26T21:18:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c0c00640 1 -- 172.21.15.106:0/2751324068 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f17b400d840 con 0x7f17c413ed60 2024-04-26T21:18:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17c0c00640 1 -- 172.21.15.106:0/2751324068 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b400dc30 con 0x7f17c413ed60 2024-04-26T21:18:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c40b1720 con 0x7f17c413ed60 2024-04-26T21:18:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.102+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c40b1ce0 con 0x7f17c413ed60 2024-04-26T21:18:52.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.106+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c4069400 con 0x7f17c413ed60 2024-04-26T21:18:52.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.106+0000 7f17c0c00640 1 -- 172.21.15.106:0/2751324068 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17b401d070 con 0x7f17c413ed60 2024-04-26T21:18:52.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.106+0000 7f17c0c00640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f17a4068380 0x7f17a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:52.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.106+0000 7f17c0c00640 1 -- 172.21.15.106:0/2751324068 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5421+0+0 (secure 0 0 0) 0x7f17b4087140 con 0x7f17c413ed60 2024-04-26T21:18:52.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.106+0000 7f17c3e00640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f17a4068380 0x7f17a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:52.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.106+0000 7f17c3e00640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f17a4068380 0x7f17a406a840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f17b00af000 tx=0x7f17b00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:52.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.110+0000 7f17c0c00640 1 -- 172.21.15.106:0/2751324068 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f17b40570a0 con 0x7f17c413ed60 2024-04-26T21:18:52.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.298+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17c4072eb0 con 0x7f17c413ed60 2024-04-26T21:18:52.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.298+0000 7f17c0c00640 1 -- 172.21.15.106:0/2751324068 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+3866 (secure 0 0 0) 0x7f17b405b3a0 con 0x7f17c413ed60 2024-04-26T21:18:52.301 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T21:18:52.301 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6834/3323600957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3323600957},{"type":"v1","addr":"172.21.15.112:6834","nonce":3323600957}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/28739805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6833","nonce":28739805},{"type":"v1","addr":"172.21.15.112:6835","nonce":28739805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/791761080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":791761080},{"type":"v1","addr":"172.21.15.106:6836","nonce":791761080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5880,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/88386556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":88386556},{"type":"v1","addr":"172.21.15.106:6837","nonce":88386556}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[]} 2024-04-26T21:18:52.302 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 26 2024-04-26T21:18:52.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f17a4068380 msgr2=0x7f17a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f17a4068380 0x7f17a406a840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f17b00af000 tx=0x7f17b00a7000 comp rx=0 tx=0).stop 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413ed60 msgr2=0x7f17c413d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413ed60 0x7f17c413d6e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f17b400cfc0 tx=0x7f17b400a7d0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 shutdown_connections 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17c41f8120 0x7f17c4157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:6832/3357608223,v1:172.21.15.106:6833/3357608223] conn(0x7f17a4068380 0x7f17a406a840 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f17c41576c0 0x7f17c415ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 --2- 172.21.15.106:0/2751324068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c413ed60 0x7f17c413d6e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 >> 172.21.15.106:0/2751324068 conn(0x7f17c4068340 msgr2=0x7f17c40cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 shutdown_connections 2024-04-26T21:18:52.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T21:18:52.302+0000 7f17cb800640 1 -- 172.21.15.106:0/2751324068 wait complete. 2024-04-26T21:18:52.324 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-26T21:18:52.324 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T21:18:52.324 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T21:18:52.324 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:52.337 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T21:18:52.337 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T21:18:52.337 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:52.394 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T21:18:52.394 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T21:18:52.394 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:52.408 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T21:18:52.409 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T21:18:52.409 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:52.464 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T21:18:52.465 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T21:18:52.465 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T21:18:52.465 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:52.554 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T21:18:52.554 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T21:18:52.554 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:55.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T21:18:58.656 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T21:18:58.656 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T21:18:58.656 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:58.727 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T21:18:58.727 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T21:18:58.727 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:58.815 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T21:18:58.815 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T21:18:58.815 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:58.888 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T21:18:58.888 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T21:18:58.888 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:18:58.985 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T21:18:58.985 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T21:18:58.985 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:19:00.917 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-26T21:19:00.917 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T21:19:05.087 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T21:19:05.088 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T21:19:05.088 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:19:05.159 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T21:19:05.159 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T21:19:05.159 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T21:19:05.159 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:19:05.218 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T21:19:05.219 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T21:19:05.219 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:19:05.273 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T21:19:05.273 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T21:19:05.273 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T21:19:05.274 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:19:05.291 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T21:19:05.291 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T21:19:05.291 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:19:05.307 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T21:19:05.307 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T21:19:05.308 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:19:05.370 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T21:19:05.370 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T21:19:05.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Replacing daemon mds.a' | head -n 1 2024-04-26T21:19:05.407 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:19:05.407 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T21:19:05.663 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:19:05.663 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T21:19:05.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:19:05.815 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T21:19:05.917 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-26T21:19:05.974 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:19:05.974 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T21:19:06.115 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:19:06.115 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T21:19:06.430 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:19:06.430 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T21:19:06.595 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:19:06.595 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T21:19:06.778 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:19:06.778 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T21:19:06.965 INFO:tasks.ceph:Archiving mon data... 2024-04-26T21:19:06.966 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/data/mon.a.tgz 2024-04-26T21:19:06.966 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-26T21:19:06.975 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.Tpp9cdjEBQ 2024-04-26T21:19:06.975 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Tpp9cdjEBQ 2024-04-26T21:19:07.100 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.Tpp9cdjEBQ 2024-04-26T21:19:07.179 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.Tpp9cdjEBQ is 327KB 2024-04-26T21:19:07.245 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.Tpp9cdjEBQ 2024-04-26T21:19:07.253 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/data/mon.b.tgz 2024-04-26T21:19:07.253 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-04-26T21:19:07.262 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.NEYopwJaam 2024-04-26T21:19:07.262 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.NEYopwJaam 2024-04-26T21:19:07.409 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.NEYopwJaam 2024-04-26T21:19:07.486 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.NEYopwJaam is 433KB 2024-04-26T21:19:07.549 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.NEYopwJaam 2024-04-26T21:19:07.557 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/data/mon.c.tgz 2024-04-26T21:19:07.557 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-04-26T21:19:07.610 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.QKBc4zvMev 2024-04-26T21:19:07.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QKBc4zvMev 2024-04-26T21:19:07.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.QKBc4zvMev 2024-04-26T21:19:07.827 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.QKBc4zvMev is 433KB 2024-04-26T21:19:07.894 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.QKBc4zvMev 2024-04-26T21:19:07.902 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T21:19:07.902 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T21:19:07.905 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T21:19:07.975 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T21:19:08.010 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T21:19:08.010 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T21:19:08.012 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/remote/smithi106/crash 2024-04-26T21:19:08.012 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T21:19:08.038 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/remote/smithi112/crash 2024-04-26T21:19:08.039 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T21:19:08.068 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T21:19:08.068 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:19:08.085 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:19:08.161 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T21:19:08.182 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T21:19:08.200 INFO:tasks.ceph:Compressing logs... 2024-04-26T21:19:08.200 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T21:19:08.225 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T21:19:08.258 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39645.log 2024-04-26T21:19:08.258 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34090.log 2024-04-26T21:19:08.259 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34128.log 2024-04-26T21:19:08.260 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39645.log.gz 2024-04-26T21:19:08.260 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39768.log 2024-04-26T21:19:08.261 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34090.log.gz 2024-04-26T21:19:08.261 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34740.log 2024-04-26T21:19:08.261 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34128.log.gz 2024-04-26T21:19:08.263 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37406.log 2024-04-26T21:19:08.263 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39768.log.gz 2024-04-26T21:19:08.263 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36533.log 2024-04-26T21:19:08.263 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34740.log.gz 2024-04-26T21:19:08.263 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39299.log 2024-04-26T21:19:08.265 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37406.log.gz 2024-04-26T21:19:08.265 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40182.log 2024-04-26T21:19:08.265 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36533.log.gz 2024-04-26T21:19:08.265 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33538.log 2024-04-26T21:19:08.265 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39299.log.gz 2024-04-26T21:19:08.266 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40182.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T21:19:08.266 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40182.log.gz 2024-04-26T21:19:08.267 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40208.log 2024-04-26T21:19:08.267 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33538.log.gz 2024-04-26T21:19:08.267 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34332.log 2024-04-26T21:19:08.268 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40052.log 2024-04-26T21:19:08.268 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40208.log.gz 2024-04-26T21:19:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37952.log 2024-04-26T21:19:08.269 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34332.log.gz 2024-04-26T21:19:08.269 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27826.log 2024-04-26T21:19:08.270 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35637.log 2024-04-26T21:19:08.271 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40052.log.gz 2024-04-26T21:19:08.272 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39870.log 2024-04-26T21:19:08.272 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37952.log.gz 2024-04-26T21:19:08.272 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32734.log 2024-04-26T21:19:08.272 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35637.log.gz 2024-04-26T21:19:08.273 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27658.log 2024-04-26T21:19:08.273 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27826.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T21:19:08.273 INFO:teuthology.orchestra.run.smithi112.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27826.log.gz 2024-04-26T21:19:08.274 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27658.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T21:19:08.274 INFO:teuthology.orchestra.run.smithi112.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27658.log.gz 2024-04-26T21:19:08.274 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27706.log 2024-04-26T21:19:08.274 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T21:19:08.276 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27778.log 2024-04-26T21:19:08.276 INFO:teuthology.orchestra.run.smithi112.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27706.log.gz 2024-04-26T21:19:08.276 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39273.log 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39870.log.gz 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34348.log 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32734.log.gz 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35770.log 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39273.log.gz 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34064.log 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34348.log.gz 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35026.log 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35770.log.gz 2024-04-26T21:19:08.279 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33198.log 2024-04-26T21:19:08.280 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34064.log.gz 2024-04-26T21:19:08.280 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33454.log 2024-04-26T21:19:08.280 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35026.log.gz 2024-04-26T21:19:08.280 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33198.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T21:19:08.284 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33198.log.gz 2024-04-26T21:19:08.284 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2024-04-26T21:19:08.285 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36108.log 2024-04-26T21:19:08.285 INFO:teuthology.orchestra.run.smithi106.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.33454.log.gz 2024-04-26T21:19:08.285 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36376.log 2024-04-26T21:19:08.285 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz 2024-04-26T21:19:08.285 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36108.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.34330.log -- replaced with /var/log/ceph/ceph-client.admin.36108.log.gz 2024-04-26T21:19:08.285 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T21:19:08.285 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35132.log 2024-04-26T21:19:08.285 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36376.log.gz 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27778.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27778.log.gz 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27754.log 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.27754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33492.log 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27754.log.gz 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T21:19:08.286 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T21:19:08.287 INFO:teuthology.orchestra.run.smithi112.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T21:19:08.287 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.3.33492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33373.log 2024-04-26T21:19:08.287 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.d.log: 91.4% -- replaced with /var/log/ceph/ceph-client.3.33492.log.gz 2024-04-26T21:19:08.287 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T21:19:08.289 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.33373.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T21:19:08.289 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.b.log: 90.6% -- replaced with /var/log/ceph/ceph-client.1.33373.log.gz 2024-04-26T21:19:08.290 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T21:19:08.290 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27682.log 2024-04-26T21:19:08.292 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37978.log 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34330.log.gz 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37510.log 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35132.log.gz 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38745.log 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37978.log.gz 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38427.log 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37510.log.gz 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40416.log 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38745.log.gz 2024-04-26T21:19:08.293 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37302.log 2024-04-26T21:19:08.294 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38427.log.gz 2024-04-26T21:19:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33616.log 2024-04-26T21:19:08.294 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40416.log.gz 2024-04-26T21:19:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34132.log 2024-04-26T21:19:08.294 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37302.log.gz 2024-04-26T21:19:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33856.log 2024-04-26T21:19:08.297 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27802.log 2024-04-26T21:19:08.297 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27682.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27682.log.gz 2024-04-26T21:19:08.297 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.27802.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27802.log.gz 2024-04-26T21:19:08.297 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T21:19:08.297 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27730.log 2024-04-26T21:19:08.297 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27730.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27730.log.gz 2024-04-26T21:19:08.298 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33616.log.gz 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38336.log 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34132.log.gz 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33856.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33856.log.gz 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38284.log 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39591.log 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38336.log.gz 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39105.log 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38284.log.gz 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39922.log 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39591.log.gz 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39539.log 2024-04-26T21:19:08.299 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39105.log.gz 2024-04-26T21:19:08.300 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37640.log 2024-04-26T21:19:08.301 INFO:teuthology.orchestra.run.smithi106.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39922.log.gz 2024-04-26T21:19:08.301 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39539.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T21:19:08.301 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39539.log.gz 2024-04-26T21:19:08.302 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39351.log 2024-04-26T21:19:08.302 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37640.log.gz 2024-04-26T21:19:08.302 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38127.log 2024-04-26T21:19:08.304 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39351.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39351.log.gz 2024-04-26T21:19:08.304 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34532.log 2024-04-26T21:19:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.38127.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36585.log 2024-04-26T21:19:08.305 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34532.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38127.log.gz 2024-04-26T21:19:08.306 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35509.log 2024-04-26T21:19:08.306 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34532.log.gz 2024-04-26T21:19:08.307 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36585.log: gzip -5 88.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.36585.log.gz -- 2024-04-26T21:19:08.307 INFO:teuthology.orchestra.run.smithi106.stderr: /var/log/ceph/ceph-client.admin.35978.log 2024-04-26T21:19:08.309 INFO:teuthology.orchestra.run.smithi106.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T21:19:08.309 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37010.log 2024-04-26T21:19:08.309 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.2.35509.log: /var/log/ceph/ceph-client.admin.35978.log: 91.5% -- replaced with /var/log/ceph/ceph-client.2.35509.log.gz 2024-04-26T21:19:08.309 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36668.log 2024-04-26T21:19:08.310 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35978.log.gz 2024-04-26T21:19:08.312 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34143.log 2024-04-26T21:19:08.312 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37010.log.gz 2024-04-26T21:19:08.312 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34038.log 2024-04-26T21:19:08.312 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36668.log.gz 2024-04-26T21:19:08.312 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38180.log 2024-04-26T21:19:08.313 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34143.log.gz 2024-04-26T21:19:08.315 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38561.log 2024-04-26T21:19:08.315 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34038.log.gz 2024-04-26T21:19:08.315 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39131.log 2024-04-26T21:19:08.315 INFO:teuthology.orchestra.run.smithi106.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38180.log.gz 2024-04-26T21:19:08.315 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38561.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T21:19:08.315 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38561.log.gz 2024-04-26T21:19:08.317 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36798.log 2024-04-26T21:19:08.318 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39131.log.gz 2024-04-26T21:19:08.318 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33250.log 2024-04-26T21:19:08.318 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36798.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36798.log.gz 2024-04-26T21:19:08.318 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39487.log 2024-04-26T21:19:08.319 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27700.log 2024-04-26T21:19:08.320 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33250.log: /var/log/ceph/ceph-client.admin.39487.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33250.log.gz 2024-04-26T21:19:08.320 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39487.log.gz 2024-04-26T21:19:08.320 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37036.log 2024-04-26T21:19:08.321 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36746.log 2024-04-26T21:19:08.321 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27700.log: 87.1%/var/log/ceph/ceph-client.admin.37036.log: -- replaced with /var/log/ceph/ceph-client.admin.27700.log.gz 2024-04-26T21:19:08.321 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37036.log.gz 2024-04-26T21:19:08.321 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37245.log 2024-04-26T21:19:08.322 INFO:teuthology.orchestra.run.smithi112.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T21:19:08.322 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40130.log 2024-04-26T21:19:08.323 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36746.log: /var/log/ceph/ceph-client.admin.37245.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36746.log.gz 2024-04-26T21:19:08.323 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 89.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.37245.log.gz -- 2024-04-26T21:19:08.323 INFO:teuthology.orchestra.run.smithi106.stderr: /var/log/ceph/ceph-client.admin.33120.log 2024-04-26T21:19:08.324 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34974.log 2024-04-26T21:19:08.325 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40130.log: /var/log/ceph/ceph-client.admin.33120.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40130.log.gz 2024-04-26T21:19:08.325 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33695.log 2024-04-26T21:19:08.326 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33120.log.gz 2024-04-26T21:19:08.326 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36290.log 2024-04-26T21:19:08.327 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34974.log.gz 2024-04-26T21:19:08.327 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33695.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.33695.log.gz --verbose 2024-04-26T21:19:08.328 INFO:teuthology.orchestra.run.smithi106.stderr: -- /var/log/ceph/ceph-client.admin.38953.log 2024-04-26T21:19:08.328 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35414.log 2024-04-26T21:19:08.329 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36290.log.gz 2024-04-26T21:19:08.330 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37167.log 2024-04-26T21:19:08.330 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38953.log.gz 2024-04-26T21:19:08.331 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36428.log 2024-04-26T21:19:08.331 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35414.log.gz 2024-04-26T21:19:08.332 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36902.log 2024-04-26T21:19:08.332 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37167.log.gz 2024-04-26T21:19:08.333 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32930.log 2024-04-26T21:19:08.333 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36428.log.gz 2024-04-26T21:19:08.334 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39188.log 2024-04-26T21:19:08.334 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36902.log.gz 2024-04-26T21:19:08.335 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32930.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32930.log.gz 2024-04-26T21:19:08.335 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33014.log 2024-04-26T21:19:08.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36454.log 2024-04-26T21:19:08.337 INFO:teuthology.orchestra.run.smithi106.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.39188.log.gz 2024-04-26T21:19:08.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35184.log 2024-04-26T21:19:08.338 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36454.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33014.log.gz 2024-04-26T21:19:08.338 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36454.log.gz 2024-04-26T21:19:08.339 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34896.log 2024-04-26T21:19:08.339 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38613.log 2024-04-26T21:19:08.340 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39058.log 2024-04-26T21:19:08.341 INFO:teuthology.orchestra.run.smithi106.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35184.log.gz 2024-04-26T21:19:08.341 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34896.log.gz 2024-04-26T21:19:08.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37692.log 2024-04-26T21:19:08.342 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38613.log.gz 2024-04-26T21:19:08.343 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37770.log 2024-04-26T21:19:08.343 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39058.log.gz 2024-04-26T21:19:08.344 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39435.log 2024-04-26T21:19:08.344 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37692.log.gz 2024-04-26T21:19:08.345 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37796.log 2024-04-26T21:19:08.345 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37770.log.gz 2024-04-26T21:19:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.39435.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32633.log 2024-04-26T21:19:08.347 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37796.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.39435.log.gz 2024-04-26T21:19:08.347 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39325.log 2024-04-26T21:19:08.348 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37796.log.gz 2024-04-26T21:19:08.348 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40026.log 2024-04-26T21:19:08.348 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32633.log.gz 2024-04-26T21:19:08.349 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32799.log 2024-04-26T21:19:08.350 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40026.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39325.log.gz 2024-04-26T21:19:08.350 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40026.log.gz 2024-04-26T21:19:08.350 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37874.log 2024-04-26T21:19:08.351 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35078.log 2024-04-26T21:19:08.352 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32799.log.gz 2024-04-26T21:19:08.352 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37874.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37874.log.gz 2024-04-26T21:19:08.352 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37458.log 2024-04-26T21:19:08.353 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.35078.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38509.log 2024-04-26T21:19:08.354 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35078.log.gz 2024-04-26T21:19:08.354 INFO:teuthology.orchestra.run.smithi112.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T21:19:08.355 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37458.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37458.log.gz 2024-04-26T21:19:08.355 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34347.log 2024-04-26T21:19:08.355 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33276.log 2024-04-26T21:19:08.356 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38509.log.gz 2024-04-26T21:19:08.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34347.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34347.log.gz 2024-04-26T21:19:08.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40286.log 2024-04-26T21:19:08.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37354.log 2024-04-26T21:19:08.358 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33276.log: /var/log/ceph/ceph-client.admin.40286.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40286.log.gz 2024-04-26T21:19:08.358 INFO:teuthology.orchestra.run.smithi106.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33276.log.gz 2024-04-26T21:19:08.358 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37614.log 2024-04-26T21:19:08.359 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35000.log 2024-04-26T21:19:08.360 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37354.log: /var/log/ceph/ceph-client.admin.37614.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37354.log.gz 2024-04-26T21:19:08.360 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 87.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.37614.log.gz /var/log/ceph/ceph-client.admin.39896.log 2024-04-26T21:19:08.361 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T21:19:08.361 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log 2024-04-26T21:19:08.362 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35000.log.gz 2024-04-26T21:19:08.363 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40078.log 2024-04-26T21:19:08.363 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39896.log.gz 2024-04-26T21:19:08.363 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32904.log 2024-04-26T21:19:08.364 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33172.log.gz 2024-04-26T21:19:08.365 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38310.log 2024-04-26T21:19:08.365 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40078.log.gz 2024-04-26T21:19:08.365 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40156.log 2024-04-26T21:19:08.366 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32904.log.gz 2024-04-26T21:19:08.367 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38364.log 2024-04-26T21:19:08.367 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38310.log.gz 2024-04-26T21:19:08.367 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40156.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T21:19:08.368 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40156.log.gz 2024-04-26T21:19:08.369 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40392.log 2024-04-26T21:19:08.369 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38364.log.gz 2024-04-26T21:19:08.370 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39383.log 2024-04-26T21:19:08.371 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40392.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40392.log.gz 2024-04-26T21:19:08.371 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34140.log 2024-04-26T21:19:08.372 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37926.log 2024-04-26T21:19:08.372 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39383.log.gz 2024-04-26T21:19:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36030.log 2024-04-26T21:19:08.373 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34140.log.gz 2024-04-26T21:19:08.374 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35848.log 2024-04-26T21:19:08.374 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37926.log.gz 2024-04-26T21:19:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37328.log 2024-04-26T21:19:08.376 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36030.log.gz 2024-04-26T21:19:08.377 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32956.log 2024-04-26T21:19:08.377 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35848.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35848.log.gz 2024-04-26T21:19:08.378 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40104.log 2024-04-26T21:19:08.378 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37328.log.gz 2024-04-26T21:19:08.378 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-04-26T21:19:08.379 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32956.log.gz 2024-04-26T21:19:08.379 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36642.log 2024-04-26T21:19:08.379 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40104.log.gz 2024-04-26T21:19:08.380 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33642.log 2024-04-26T21:19:08.380 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-04-26T21:19:08.381 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38587.log 2024-04-26T21:19:08.381 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36642.log.gz 2024-04-26T21:19:08.382 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39948.log 2024-04-26T21:19:08.383 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33642.log.gz 2024-04-26T21:19:08.384 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log 2024-04-26T21:19:08.384 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-04-26T21:19:08.384 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39948.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T21:19:08.385 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39948.log.gz 2024-04-26T21:19:08.386 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36984.log 2024-04-26T21:19:08.386 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34542.log.gz 2024-04-26T21:19:08.387 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33590.log 2024-04-26T21:19:08.388 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34559.log 2024-04-26T21:19:08.388 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36984.log.gz 2024-04-26T21:19:08.389 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40234.log 2024-04-26T21:19:08.389 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33590.log.gz 2024-04-26T21:19:08.390 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36850.log 2024-04-26T21:19:08.390 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34559.log.gz 2024-04-26T21:19:08.392 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34922.log 2024-04-26T21:19:08.392 INFO:teuthology.orchestra.run.smithi106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40234.log.gz 2024-04-26T21:19:08.393 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36850.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36850.log.gz 2024-04-26T21:19:08.394 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34922.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34922.log.gz 2024-04-26T21:19:08.394 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37848.log 2024-04-26T21:19:08.395 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37744.log 2024-04-26T21:19:08.396 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33882.log 2024-04-26T21:19:08.397 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37848.log.gz 2024-04-26T21:19:08.398 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38453.log 2024-04-26T21:19:08.398 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37744.log.gz 2024-04-26T21:19:08.399 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32852.log 2024-04-26T21:19:08.399 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33882.log.gz 2024-04-26T21:19:08.400 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35663.log 2024-04-26T21:19:08.401 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38453.log.gz 2024-04-26T21:19:08.401 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35052.log 2024-04-26T21:19:08.401 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32852.log.gz 2024-04-26T21:19:08.402 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36772.log 2024-04-26T21:19:08.402 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35663.log.gz 2024-04-26T21:19:08.403 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34336.log 2024-04-26T21:19:08.404 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35052.log.gz 2024-04-26T21:19:08.405 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36772.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.36772.log.gz /var/log/ceph/ceph-client.admin.36928.log 2024-04-26T21:19:08.405 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T21:19:08.406 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36238.log 2024-04-26T21:19:08.406 INFO:teuthology.orchestra.run.smithi112.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T21:19:08.406 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34336.log.gz 2024-04-26T21:19:08.407 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36212.log 2024-04-26T21:19:08.407 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36928.log.gz 2024-04-26T21:19:08.408 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36481.log 2024-04-26T21:19:08.408 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36238.log.gz 2024-04-26T21:19:08.409 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34844.log 2024-04-26T21:19:08.409 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36212.log.gz 2024-04-26T21:19:08.411 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36264.log 2024-04-26T21:19:08.411 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36481.log.gz 2024-04-26T21:19:08.412 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34844.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34844.log.gz 2024-04-26T21:19:08.412 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39565.log 2024-04-26T21:19:08.413 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36264.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36264.log.gz 2024-04-26T21:19:08.413 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35158.log 2024-04-26T21:19:08.417 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36507.log 2024-04-26T21:19:08.418 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39565.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39565.log.gz 2024-04-26T21:19:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35158.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35158.log.gz 2024-04-26T21:19:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33721.log 2024-04-26T21:19:08.419 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36507.log.gz 2024-04-26T21:19:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38639.log 2024-04-26T21:19:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34352.log 2024-04-26T21:19:08.419 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33721.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33721.log.gz 2024-04-26T21:19:08.420 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34544.log 2024-04-26T21:19:08.420 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38639.log: 89.0%/var/log/ceph/ceph-client.admin.34352.log: -- replaced with /var/log/ceph/ceph-client.admin.38639.log.gz 2024-04-26T21:19:08.421 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34352.log.gz 2024-04-26T21:19:08.422 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34544.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34544.log.gz 2024-04-26T21:19:08.422 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40442.log 2024-04-26T21:19:08.423 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35715.log 2024-04-26T21:19:08.425 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37588.log 2024-04-26T21:19:08.425 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40442.log.gz 2024-04-26T21:19:08.426 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35715.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35715.log.gz 2024-04-26T21:19:08.427 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37588.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37588.log.gz 2024-04-26T21:19:08.427 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35370.log 2024-04-26T21:19:08.428 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33326.log 2024-04-26T21:19:08.430 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.35370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35245.log 2024-04-26T21:19:08.430 INFO:teuthology.orchestra.run.smithi106.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.35370.log.gz/var/log/ceph/ceph-client.admin.33326.log: 2024-04-26T21:19:08.431 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33326.log.gz 2024-04-26T21:19:08.432 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35245.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35245.log.gz 2024-04-26T21:19:08.433 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39844.log 2024-04-26T21:19:08.433 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34818.log 2024-04-26T21:19:08.435 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34545.log 2024-04-26T21:19:08.435 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39844.log.gz 2024-04-26T21:19:08.436 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34818.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34818.log.gz 2024-04-26T21:19:08.437 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34545.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34545.log.gz 2024-04-26T21:19:08.437 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T21:19:08.438 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37536.log 2024-04-26T21:19:08.440 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33986.log 2024-04-26T21:19:08.441 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37536.log: 85.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T21:19:08.441 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37536.log.gz 2024-04-26T21:19:08.442 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33986.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33986.log.gz 2024-04-26T21:19:08.442 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36134.log 2024-04-26T21:19:08.443 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40364.log 2024-04-26T21:19:08.445 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35579.log 2024-04-26T21:19:08.445 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36134.log.gz 2024-04-26T21:19:08.446 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34340.log 2024-04-26T21:19:08.446 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40364.log.gz 2024-04-26T21:19:08.447 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38101.log 2024-04-26T21:19:08.448 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35579.log.gz 2024-04-26T21:19:08.448 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34340.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34340.log.gz 2024-04-26T21:19:08.449 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37562.log 2024-04-26T21:19:08.449 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38101.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38101.log.gz 2024-04-26T21:19:08.450 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36958.log 2024-04-26T21:19:08.451 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40000.log 2024-04-26T21:19:08.452 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37562.log.gz 2024-04-26T21:19:08.452 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39742.log 2024-04-26T21:19:08.452 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36958.log.gz 2024-04-26T21:19:08.454 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39974.log 2024-04-26T21:19:08.454 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40000.log.gz 2024-04-26T21:19:08.454 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39742.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39742.log.gz 2024-04-26T21:19:08.455 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33960.log 2024-04-26T21:19:08.456 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39974.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39974.log.gz 2024-04-26T21:19:08.456 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36402.log 2024-04-26T21:19:08.457 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33773.log 2024-04-26T21:19:08.457 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33960.log.gz 2024-04-26T21:19:08.458 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38392.log 2024-04-26T21:19:08.458 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36402.log.gz 2024-04-26T21:19:08.460 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35106.log 2024-04-26T21:19:08.460 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33773.log.gz 2024-04-26T21:19:08.461 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39162.log 2024-04-26T21:19:08.461 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38392.log.gz 2024-04-26T21:19:08.462 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35106.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35106.log.gz 2024-04-26T21:19:08.463 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39162.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39162.log.gz 2024-04-26T21:19:08.463 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37484.log 2024-04-26T21:19:08.464 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39409.log 2024-04-26T21:19:08.466 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38479.log 2024-04-26T21:19:08.466 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37484.log.gz 2024-04-26T21:19:08.467 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39409.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39409.log.gz 2024-04-26T21:19:08.468 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38479.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38479.log.gz 2024-04-26T21:19:08.468 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37380.log 2024-04-26T21:19:08.469 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35796.log 2024-04-26T21:19:08.471 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37062.log 2024-04-26T21:19:08.471 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37380.log.gz 2024-04-26T21:19:08.472 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35796.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35796.log.gz 2024-04-26T21:19:08.473 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37062.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37062.log.gz 2024-04-26T21:19:08.474 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38206.log 2024-04-26T21:19:08.475 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36056.log 2024-04-26T21:19:08.476 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33908.log 2024-04-26T21:19:08.476 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38206.log.gz 2024-04-26T21:19:08.477 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37666.log 2024-04-26T21:19:08.477 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36056.log.gz 2024-04-26T21:19:08.478 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33908.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33908.log.gz 2024-04-26T21:19:08.479 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33512.log 2024-04-26T21:19:08.479 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37666.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37666.log.gz 2024-04-26T21:19:08.480 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32825.log 2024-04-26T21:19:08.481 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33934.log 2024-04-26T21:19:08.481 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33512.log.gz 2024-04-26T21:19:08.482 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38903.log 2024-04-26T21:19:08.482 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32825.log.gz 2024-04-26T21:19:08.483 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36559.log 2024-04-26T21:19:08.484 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33934.log.gz 2024-04-26T21:19:08.484 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.38903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37432.log 2024-04-26T21:19:08.486 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36559.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36559.log.gz 2024-04-26T21:19:08.487 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34560.log 2024-04-26T21:19:08.487 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37432.log.gz 2024-04-26T21:19:08.487 INFO:teuthology.orchestra.run.smithi106.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.38903.log.gz 2024-04-26T21:19:08.488 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34792.log 2024-04-26T21:19:08.489 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35900.log 2024-04-26T21:19:08.489 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34560.log.gz 2024-04-26T21:19:08.490 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38010.log 2024-04-26T21:19:08.490 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34792.log.gz 2024-04-26T21:19:08.491 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34558.log 2024-04-26T21:19:08.492 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35900.log.gz 2024-04-26T21:19:08.493 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33747.log 2024-04-26T21:19:08.493 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38010.log.gz 2024-04-26T21:19:08.493 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34558.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34558.log.gz 2024-04-26T21:19:08.495 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33747.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33747.log.gz 2024-04-26T21:19:08.495 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39513.log 2024-04-26T21:19:08.496 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22775.log 2024-04-26T21:19:08.498 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32984.log 2024-04-26T21:19:08.498 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39513.log.gz 2024-04-26T21:19:08.498 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.tmp-client.admin.22775.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22775.log.gz 2024-04-26T21:19:08.499 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37141.log 2024-04-26T21:19:08.500 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38983.log 2024-04-26T21:19:08.501 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32984.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32984.log.gz 2024-04-26T21:19:08.501 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37219.log 2024-04-26T21:19:08.501 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37141.log.gz 2024-04-26T21:19:08.502 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38983.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38983.log.gz 2024-04-26T21:19:08.503 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37219.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37219.log.gz 2024-04-26T21:19:08.504 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39617.log 2024-04-26T21:19:08.505 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T21:19:08.506 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39617.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T21:19:08.506 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39617.log.gz 2024-04-26T21:19:08.508 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T21:19:08.511 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37193.log 2024-04-26T21:19:08.512 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36824.log 2024-04-26T21:19:08.513 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37193.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37193.log.gz 2024-04-26T21:19:08.514 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36824.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T21:19:08.515 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36824.log.gz 2024-04-26T21:19:08.515 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33094.log 2024-04-26T21:19:08.518 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.33094.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33094.log.gz 2024-04-26T21:19:08.518 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38258.log 2024-04-26T21:19:08.521 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38258.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38258.log.gz 2024-04-26T21:19:08.521 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38535.log 2024-04-26T21:19:08.524 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38535.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38535.log.gz 2024-04-26T21:19:08.524 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34137.log 2024-04-26T21:19:08.527 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34137.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34137.log.gz 2024-04-26T21:19:08.527 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36349.log 2024-04-26T21:19:08.530 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36349.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36349.log.gz 2024-04-26T21:19:08.530 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36082.log 2024-04-26T21:19:08.531 INFO:teuthology.orchestra.run.smithi106.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T21:19:08.531 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33224.log 2024-04-26T21:19:08.533 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36082.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36082.log.gz 2024-04-26T21:19:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34766.log 2024-04-26T21:19:08.534 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33224.log.gz 2024-04-26T21:19:08.535 INFO:teuthology.orchestra.run.smithi106.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T21:19:08.536 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33564.log 2024-04-26T21:19:08.536 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34766.log.gz 2024-04-26T21:19:08.536 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34142.log 2024-04-26T21:19:08.538 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39671.log 2024-04-26T21:19:08.538 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33564.log.gz 2024-04-26T21:19:08.539 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34142.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34142.log.gz 2024-04-26T21:19:08.541 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39671.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39671.log.gz 2024-04-26T21:19:08.541 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33799.log 2024-04-26T21:19:08.542 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37718.log 2024-04-26T21:19:08.543 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34126.log 2024-04-26T21:19:08.543 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33799.log.gz 2024-04-26T21:19:08.544 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37718.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37718.log.gz 2024-04-26T21:19:08.545 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34126.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34126.log.gz 2024-04-26T21:19:08.546 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33669.log 2024-04-26T21:19:08.546 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35744.log 2024-04-26T21:19:08.548 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33830.log 2024-04-26T21:19:08.548 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33669.log.gz 2024-04-26T21:19:08.549 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35744.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35744.log.gz 2024-04-26T21:19:08.550 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33830.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33830.log.gz 2024-04-26T21:19:08.551 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33040.log 2024-04-26T21:19:08.551 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36004.log 2024-04-26T21:19:08.553 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33066.log 2024-04-26T21:19:08.553 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33040.log.gz 2024-04-26T21:19:08.554 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36004.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36004.log.gz 2024-04-26T21:19:08.555 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33066.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33066.log.gz 2024-04-26T21:19:08.555 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40338.log 2024-04-26T21:19:08.556 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37115.log 2024-04-26T21:19:08.558 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34948.log 2024-04-26T21:19:08.558 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40338.log.gz 2024-04-26T21:19:08.559 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37115.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37115.log.gz 2024-04-26T21:19:08.560 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34948.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34948.log.gz 2024-04-26T21:19:08.561 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32701.log 2024-04-26T21:19:08.561 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38154.log 2024-04-26T21:19:08.563 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38797.log 2024-04-26T21:19:08.563 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32701.log.gz 2024-04-26T21:19:08.564 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38154.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38154.log.gz 2024-04-26T21:19:08.565 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38797.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.38797.log.gz 2024-04-26T21:19:08.566 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39461.log 2024-04-26T21:19:08.567 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39019.log 2024-04-26T21:19:08.568 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37088.log 2024-04-26T21:19:08.568 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39461.log.gz 2024-04-26T21:19:08.569 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39019.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39019.log.gz 2024-04-26T21:19:08.570 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37088.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37088.log.gz 2024-04-26T21:19:08.571 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37900.log 2024-04-26T21:19:08.572 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36323.log 2024-04-26T21:19:08.573 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35689.log 2024-04-26T21:19:08.573 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37900.log.gz 2024-04-26T21:19:08.574 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36323.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36323.log.gz 2024-04-26T21:19:08.575 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35689.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35689.log.gz 2024-04-26T21:19:08.576 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34338.log 2024-04-26T21:19:08.577 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38847.log 2024-04-26T21:19:08.680 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39247.log 2024-04-26T21:19:08.680 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34338.log.gz 2024-04-26T21:19:08.680 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38847.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32878.log 2024-04-26T21:19:08.680 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38847.log.gz 2024-04-26T21:19:08.680 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38075.log 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39247.log.gz 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32878.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32878.log.gz 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27802.log 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38075.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38075.log.gz 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35611.log 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34870.log 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27802.log.gz 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39716.log 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35611.log.gz 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35822.log 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34870.log.gz 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40312.log 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39716.log.gz 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35822.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35822.log.gz 2024-04-26T21:19:08.681 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40312.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40312.log.gz 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37822.log 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36720.log 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27583.log 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37822.log.gz 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36720.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36720.log.gz 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37276.log 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36160.log 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27583.log.gz 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35952.log 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37276.log.gz 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36160.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36160.log.gz 2024-04-26T21:19:08.682 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35952.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35952.log.gz 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38771.log 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38232.log 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39794.log 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38771.log.gz 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38232.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38232.log.gz 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39794.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39794.log.gz 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34012.log 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33146.log 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35874.log 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34012.log.gz 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33146.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33146.log.gz 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35874.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35874.log.gz 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35553.log 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38691.log 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36876.log 2024-04-26T21:19:08.683 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35553.log.gz 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38691.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38691.log.gz 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36876.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36876.log.gz 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36694.log 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40260.log 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36694.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36694.log.gz 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34144.log 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34548.log 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40260.log.gz 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35926.log 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34144.log.gz 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34548.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34548.log.gz 2024-04-26T21:19:08.684 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35926.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35926.log.gz 2024-04-26T21:19:08.685 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38719.log 2024-04-26T21:19:08.685 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38719.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38719.log.gz 2024-04-26T21:19:08.685 INFO:teuthology.orchestra.run.smithi106.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T21:19:08.912 INFO:teuthology.orchestra.run.smithi112.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T21:19:08.958 INFO:teuthology.orchestra.run.smithi112.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T21:19:08.977 INFO:teuthology.orchestra.run.smithi112.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T21:19:09.021 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T21:19:09.021 INFO:teuthology.orchestra.run.smithi106.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T21:19:09.023 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-04-26T21:19:09.023 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m0.775s 2024-04-26T21:19:09.023 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m2.843s 2024-04-26T21:19:09.023 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.227s 2024-04-26T21:19:09.044 INFO:teuthology.orchestra.run.smithi106.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T21:19:09.092 INFO:teuthology.orchestra.run.smithi106.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T21:19:09.153 INFO:teuthology.orchestra.run.smithi106.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T21:19:09.156 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T21:19:09.156 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m0.926s 2024-04-26T21:19:09.156 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m3.493s 2024-04-26T21:19:09.156 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m0.669s 2024-04-26T21:19:09.156 INFO:tasks.ceph:Archiving logs... 2024-04-26T21:19:09.157 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/remote/smithi106/log 2024-04-26T21:19:09.157 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T21:19:09.790 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/remote/smithi112/log 2024-04-26T21:19:09.790 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T21:19:10.184 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T21:19:10.193 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T21:19:10.194 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T21:19:10.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T21:19:10.282 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T21:19:10.291 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T21:19:10.292 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:19:10.295 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:19:10.307 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T21:19:10.307 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-04-26T21:19:10.308 INFO:teuthology.orchestra.run.smithi106.stdout:+hv01.front.sepi 67.205.162.81 3 u 52 64 177 0.089 -2.603 0.970 2024-04-26T21:19:10.308 INFO:teuthology.orchestra.run.smithi106.stdout:+hv02.front.sepi 63.231.80.2 3 u 47 64 177 0.089 +0.434 1.257 2024-04-26T21:19:10.308 INFO:teuthology.orchestra.run.smithi106.stdout:*hv03.front.sepi 74.6.168.72 3 u 57 64 177 0.075 -2.875 2.274 2024-04-26T21:19:10.308 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:19:10.310 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T21:19:10.310 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-04-26T21:19:10.310 INFO:teuthology.orchestra.run.smithi112.stdout:+hv01.front.sepi 67.205.162.81 3 u 53 64 177 0.088 -2.819 1.376 2024-04-26T21:19:10.310 INFO:teuthology.orchestra.run.smithi112.stdout:+hv02.front.sepi 63.231.80.2 3 u 58 64 177 0.161 -0.699 1.449 2024-04-26T21:19:10.310 INFO:teuthology.orchestra.run.smithi112.stdout:*hv03.front.sepi 74.6.168.72 3 u 54 64 177 0.100 -1.139 1.279 2024-04-26T21:19:10.311 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T21:19:10.311 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T21:19:10.320 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T21:19:10.321 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T21:19:10.329 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T21:19:10.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T21:19:10.346 INFO:teuthology.task.internal:Duration was 920.093765 seconds 2024-04-26T21:19:10.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T21:19:10.356 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T21:19:10.356 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T21:19:10.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T21:19:10.476 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T21:19:10.476 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T21:19:10.476 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T21:19:10.497 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T21:19:10.498 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T21:19:10.518 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T21:19:10.518 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T21:19:10.541 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T21:19:10.599 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T21:19:10.600 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T21:19:10.625 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T21:19:10.711 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T21:19:10.722 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T21:19:10.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T21:19:10.742 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T21:19:10.762 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T21:19:10.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:19:10.789 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:19:10.802 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-04-26T21:19:10.819 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-04-26T21:19:10.838 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:19:10.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:19:10.873 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:19:10.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:19:10.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T21:19:10.896 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T21:19:10.897 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/remote/smithi106 2024-04-26T21:19:10.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T21:19:10.940 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675201/remote/smithi112 2024-04-26T21:19:10.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T21:19:10.966 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T21:19:10.966 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T21:19:10.981 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T21:19:11.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T21:19:11.026 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T21:19:11.026 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T21:19:11.036 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T21:19:11.036 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T21:19:11.039 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T21:19:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 21:19 /home/ubuntu/cephtest 2024-04-26T21:19:11.070 INFO:teuthology.orchestra.run.smithi112.stdout: 658121 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 21:19 /home/ubuntu/cephtest 2024-04-26T21:19:11.072 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T21:19:11.084 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T21:19:11.109 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/cap-flush} duration: 920.0937654972076 flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology success: true 2024-04-26T21:19:11.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T21:19:11.187 INFO:teuthology.run:pass